2024-04-22T19:39:52.710 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-22T19:39:52.711 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489 --name cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi --owner scheduled_cbodley@teuthology --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} -- /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/orig.config.yaml 2024-04-22T19:39:52.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T19:39:52.818 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489 branch: wip-65551 description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7668489' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-65551 ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-65551 sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 7738 sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe sleep_before_teardown: 0 suite: rgw suite_branch: wip-65551 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9ed8263edff7e87907bf24b054e5c7144c194dbe/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZG3YWCy9d9mPtnYW76KKYvmukaQJMgjVM6txz5wu/LQzWvUZSkaO4QHGF7xSkpcF9CVo7mbEjPGTwXLnKft1o= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdqhCxIWped4KVmbudmcZObHEAM3rTHIx6OWwuZ2NmixZF7fC8IqPDo1wVU4swsvKF7OJDVyLftvb0ZxNfvb3o= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-22_19:31:26 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-22T19:39:52.819 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9ed8263edff7e87907bf24b054e5c7144c194dbe/qa; will attempt to use it 2024-04-22T19:39:52.819 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9ed8263edff7e87907bf24b054e5c7144c194dbe/qa/tasks 2024-04-22T19:39:52.819 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-22T19:39:52.821 INFO:teuthology.task.internal:Checking packages... 2024-04-22T19:39:52.842 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9ed8263edff7e87907bf24b054e5c7144c194dbe' 2024-04-22T19:39:52.842 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-22T19:39:52.843 INFO:teuthology.packaging:ref: None 2024-04-22T19:39:52.843 INFO:teuthology.packaging:tag: None 2024-04-22T19:39:52.843 INFO:teuthology.packaging:branch: wip-65551 2024-04-22T19:39:52.843 INFO:teuthology.packaging:sha1: 9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:39:52.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-65551 2024-04-22T19:39:52.990 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:39:52.991 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-22T19:39:52.998 INFO:teuthology.task.internal:no buildpackages task found 2024-04-22T19:39:52.998 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-22T19:39:53.011 INFO:teuthology.task.internal:Saving configuration 2024-04-22T19:39:53.024 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-22T19:39:53.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T19:39:53.053 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 19:32:36.606400', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICajzBLO/HctwBh5X/F0kw0iwdSu+fBun9w671sw+YuL'} 2024-04-22T19:39:53.071 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 19:32:36.607971', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHYkniVSQzsc2ARNd1irrZYl2zpIH9/IywjTuOhZXdVm'} 2024-04-22T19:39:53.071 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-22T19:39:53.077 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-22T19:39:53.077 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-22T19:39:53.077 INFO:teuthology.run_tasks:Running task console_log... 2024-04-22T19:39:53.139 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f209fabde50>, signals=[15]) 2024-04-22T19:39:53.140 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-22T19:39:53.146 INFO:teuthology.task.internal:Opening connections... 2024-04-22T19:39:53.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:39:53.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:39:53.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:39:53.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:39:53.311 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-22T19:39:53.317 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-22T19:39:53.322 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-22T19:39:53.322 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-22T19:39:53.372 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-22T19:39:53.372 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-22T19:39:53.372 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-22T19:39:53.373 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-22T19:39:53.374 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-22T19:39:53.397 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-22T19:39:53.401 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-22T19:39:53.401 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-22T19:39:53.452 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-22T19:39:53.453 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-04-22T19:39:53.453 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-22T19:39:53.471 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-22T19:39:53.480 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-22T19:39:53.485 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-22T19:39:53.485 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-04-22T19:39:53.487 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-04-22T19:39:53.500 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-22T19:39:53.506 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-22T19:39:53.506 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-04-22T19:39:53.534 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-04-22T19:39:53.605 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-22T19:39:53.656 INFO:teuthology.run_tasks:Running task kernel... 2024-04-22T19:39:53.671 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-22T19:39:53.671 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-22T19:39:53.672 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T19:39:53.672 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T19:39:53.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:39:53.676 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-22T19:39:53.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:39:53.677 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-22T19:39:53.725 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-04-22T19:39:53.725 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-04-22T19:39:53.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-22T19:39:53.726 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-04-22T19:39:53.726 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-04-22T19:39:53.727 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-04-22T19:39:53.845 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-22T19:39:53.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-22T19:39:54.046 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:39:54.054 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-22T19:39:54.054 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-22T19:39:54.132 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:39:54.134 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-22T19:39:54.173 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-22T19:39:54.191 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-22T19:39:54.274 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-22T19:39:54.346 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-22T19:39:54.400 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-22T19:39:54.407 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-22T19:39:54.411 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-22T19:39:54.412 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-22T19:39:54.412 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-22T19:39:54.447 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-22T19:39:54.450 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-22T19:39:54.451 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-22T19:39:54.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-22T19:39:54.467 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-22T19:39:54.469 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-22T19:39:54.514 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-22T19:39:54.514 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-22T19:39:54.514 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-22T19:39:54.515 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-22T19:39:54.515 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-22T19:39:54.526 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-22T19:39:54.531 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-22T19:39:54.532 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-22T19:39:54.534 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-22T19:39:54.551 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-22T19:39:54.552 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-22T19:39:54.564 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-22T19:39:54.568 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-22T19:39:54.568 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-22T19:39:54.577 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-22T19:39:54.587 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-22T19:39:54.591 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-22T19:39:54.602 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-22T19:39:54.603 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-22T19:39:54.603 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-22T19:39:54.604 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-22T19:39:54.613 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-22T19:39:54.614 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-22T19:39:54.614 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-22T19:39:54.615 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-22T19:39:54.615 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-22T19:39:54.623 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-22T19:39:54.643 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-22T19:39:54.644 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-22T19:39:54.741 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-22T19:39:54.842 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-22T19:39:54.964 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-22T19:39:55.010 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-22T19:39:55.023 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-22T19:39:55.023 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-22T19:39:55.025 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-22T19:39:55.102 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-22T19:39:55.106 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-22T19:39:55.114 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-22T19:39:55.114 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-22T19:39:55.116 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-22T19:39:55.130 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-22T19:39:55.130 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-22T19:39:55.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-22T19:39:55.182 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-22T19:39:55.189 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-22T19:39:55.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-22T19:39:55.353 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-22T19:39:55.720 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-22T19:39:55.725 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-22T19:39:55.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-22T19:39:55.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-22T19:39:55.742 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-22T19:39:56.028 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-22T19:39:56.104 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-22T19:39:56.127 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-22T19:39:56.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-22T19:39:56.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-22T19:39:56.132 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-22T19:39:56.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-22T19:39:56.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-22T19:39:56.142 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-22T19:39:56.149 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-22T19:39:56.314 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-22T19:39:56.397 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-22T19:39:56.478 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-22T19:39:56.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-22T19:39:56.589 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-22T19:40:00.216 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 13.2 MB in 2s (7,063 kB/s) 2024-04-22T19:40:00.794 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 13.2 MB in 3s (4,951 kB/s) 2024-04-22T19:40:01.595 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:40:01.613 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-22T19:40:01.674 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:40:01.875 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-22T19:40:01.875 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-22T19:40:02.052 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:40:02.052 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:40:02.052 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:40:02.052 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:40:02.053 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-22T19:40:02.053 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-04-22T19:40:02.053 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:40:02.053 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-22T19:40:02.054 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-22T19:40:02.054 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-22T19:40:02.054 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-22T19:40:02.055 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-22T19:40:02.055 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-22T19:40:02.055 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-22T19:40:02.056 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-04-22T19:40:02.098 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-22T19:40:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-22T19:40:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-22T19:40:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-22T19:40:02.100 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-04-22T19:40:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-22T19:40:02.116 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:40:02.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-22T19:40:02.234 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:40:02.425 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-22T19:40:02.425 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-22T19:40:02.588 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:40:02.588 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:40:02.588 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:40:02.589 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:40:02.589 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-22T19:40:02.589 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-04-22T19:40:02.589 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:40:02.590 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-22T19:40:02.590 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-22T19:40:02.590 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-22T19:40:02.591 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-22T19:40:02.592 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-22T19:40:02.592 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-22T19:40:02.592 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-04-22T19:40:02.592 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-04-22T19:40:02.635 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-22T19:40:02.635 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-22T19:40:02.636 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-22T19:40:02.636 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-22T19:40:02.637 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-04-22T19:40:02.637 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-22T19:40:02.695 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-22T19:40:02.695 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-04-22T19:40:02.695 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-22T19:40:02.695 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-22T19:40:02.709 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-22T19:40:02.709 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-04-22T19:40:02.709 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-22T19:40:02.709 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-22T19:40:03.209 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-22T19:40:03.335 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-22T19:40:04.224 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-22T19:40:04.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-22T19:40:04.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-22T19:40:04.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-22T19:40:04.475 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-22T19:40:04.510 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-22T19:40:04.571 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-22T19:40:04.890 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 2s (60.7 MB/s) 2024-04-22T19:40:05.060 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-22T19:40:06.893 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-22T19:40:06.893 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-22T19:40:06.893 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-22T19:40:07.086 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-22T19:40:07.091 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:07.232 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:07.726 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-22T19:40:07.793 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-22T19:40:08.177 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 6s (19.9 MB/s) 2024-04-22T19:40:08.371 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-22T19:40:09.292 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-22T19:40:09.313 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:09.397 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:09.803 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-22T19:40:09.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:09.885 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:10.362 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-22T19:40:10.369 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:10.461 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:12.971 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-22T19:40:12.992 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:13.078 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:13.591 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-22T19:40:13.611 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:13.649 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:16.411 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:16.513 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:16.880 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:17.017 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:17.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-22T19:40:17.309 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-22T19:40:17.344 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-22T19:40:19.858 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:19.960 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:20.276 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:20.397 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:20.717 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-22T19:40:20.739 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-22T19:40:20.783 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-22T19:40:22.976 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-22T19:40:23.013 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:23.051 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:25.625 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:25.748 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:26.082 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-22T19:40:26.195 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:26.216 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-22T19:40:26.253 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-22T19:40:26.291 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:26.296 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-22T19:40:26.424 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:27.858 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:27.858 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:27.858 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:27.858 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:28.011 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:30.155 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:30.229 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-22T19:40:30.354 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-22T19:40:30.653 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-22T19:40:30.758 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:30.868 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-22T19:40:30.996 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:31.530 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-22T19:40:31.657 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-22T19:40:31.783 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:31.856 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-22T19:40:31.856 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:32.312 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:32.312 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:32.312 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:32.312 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:32.465 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:33.867 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:35.218 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-22T19:40:36.170 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-22T19:40:36.296 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-22T19:40:36.358 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-22T19:40:36.358 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:46.472 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-22T19:40:46.473 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-04-22T19:40:46.476 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-22T19:40:46.499 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-04-22T19:40:46.843 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:46.875 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:47.240 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:47.248 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:47.313 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-22T19:40:47.319 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-22T19:40:47.477 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-22T19:40:47.477 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-22T19:40:47.477 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-22T19:40:47.526 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-04-22T19:40:47.979 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-04-22T19:40:48.002 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-04-22T19:40:48.002 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-04-22T19:40:48.002 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-04-22T19:40:48.002 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.105.102 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-22T19:40:48.005 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-22T19:40:48.006 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-04-22T19:40:48.006 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-04-22T19:40:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-04-22T19:40:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-04-22T19:40:48.007 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-22T19:40:48.007 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-22T19:40:48.007 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-22T19:40:48.007 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-22T19:40:48.007 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-04-22T19:40:48.007 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-04-22T19:40:48.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-22T19:40:48.283 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-22T19:40:48.397 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:40:48.481 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-22T19:40:48.568 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-22T19:40:49.715 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:40:49.731 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-22T19:40:49.784 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:40:49.967 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-22T19:40:49.967 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-22T19:40:50.124 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-22T19:40:50.124 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:40:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:40:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:40:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:40:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-22T19:40:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-22T19:40:50.125 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:40:50.162 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-22T19:40:50.164 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-04-22T19:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.105.102 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-04-22T19:40:50.220 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-04-22T19:40:50.220 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-22T19:40:50.264 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.7caqc8oSGy 2024-04-22T19:40:50.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7caqc8oSGy 2024-04-22T19:40:50.315 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-22T19:40:50.315 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-04-22T19:40:50.330 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.7caqc8oSGy 2024-04-22T19:40:50.342 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-22T19:40:50.358 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-04-22T19:40:50.446 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.7caqc8oSGy is 10KB 2024-04-22T19:40:50.459 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.7caqc8oSGy 2024-04-22T19:40:50.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-22T19:40:50.516 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:40:50.516 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-22T19:40:50.516 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-22T19:40:50.580 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-22T19:40:50.580 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-04-22T19:40:50.653 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:50.674 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:50.965 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:50.971 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:51.041 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-22T19:40:51.046 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-22T19:40:51.218 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-22T19:40:51.218 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-22T19:40:51.218 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-22T19:40:51.264 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-04-22T19:40:51.693 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-22T19:40:51.720 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.105.102 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-22T19:40:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-22T19:40:51.722 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-22T19:40:51.722 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-22T19:40:51.722 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-22T19:40:51.722 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-22T19:40:51.722 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-04-22T19:40:51.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-22T19:40:51.880 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-04-22T19:40:51.881 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-22T19:40:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-04-22T19:40:51.886 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-22T19:40:51.998 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-22T19:40:52.115 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:40:52.123 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:52.130 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:52.213 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-22T19:40:52.277 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-22T19:40:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:52.430 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:52.471 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-22T19:40:52.476 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-22T19:40:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-22T19:40:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-22T19:40:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-22T19:40:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-04-22T19:40:52.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-04-22T19:40:53.368 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:40:53.386 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-22T19:40:53.438 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:40:53.615 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-22T19:40:53.615 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-22T19:40:53.772 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:40:53.813 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-22T19:40:53.815 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.105.102 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-22T19:40:53.871 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-22T19:40:53.872 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-22T19:40:53.872 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-22T19:40:53.872 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-22T19:40:53.872 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-22T19:40:53.916 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.hKhhn9NkSO 2024-04-22T19:40:53.916 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hKhhn9NkSO 2024-04-22T19:40:53.972 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.hKhhn9NkSO 2024-04-22T19:40:54.099 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.hKhhn9NkSO is 10KB 2024-04-22T19:40:54.113 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.hKhhn9NkSO 2024-04-22T19:40:54.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-22T19:40:54.173 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:40:54.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-22T19:40:54.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-22T19:40:54.239 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-22T19:40:54.240 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-04-22T19:40:55.472 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-04-22T19:40:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-22T19:40:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-04-22T19:40:55.652 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-22T19:40:55.658 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-22T19:40:55.892 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-22T19:40:55.897 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-22T19:40:55.937 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-22T19:40:55.942 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-22T19:40:56.069 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-22T19:40:56.069 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-22T19:40:56.070 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-22T19:40:56.089 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-04-22T19:40:56.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-04-22T19:41:22.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-22T19:41:22.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:41:22.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:41:26.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-22T19:41:26.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:41:26.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:41:41.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-22T19:41:44.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-22T19:41:50.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:41:50.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:41:53.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-22T19:41:53.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:41:53.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:41:56.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-22T19:42:05.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:42:05.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:42:08.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:42:08.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:42:11.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-22T19:42:23.518 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-22T19:42:26.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:42:26.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:42:29.822 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-22T19:42:38.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:42:38.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:42:38.790 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-22T19:42:39.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:42:39.256 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-22T19:42:39.257 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-22T19:42:39.304 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-105-generic 2024-04-22T19:42:39.304 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-22T19:42:39.304 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-22T19:42:39.305 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-22T19:42:40.306 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-22T19:42:40.306 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-22T19:42:40.667 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-04-22T19:42:40.694 DEBUG:teuthology.parallel:result is None 2024-04-22T19:42:47.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:42:47.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:42:49.855 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-22T19:43:10.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:43:10.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:43:11.139 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-22T19:43:11.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:43:11.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-22T19:43:11.746 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-22T19:43:11.793 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-105-generic 2024-04-22T19:43:11.793 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-22T19:43:11.793 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-22T19:43:11.793 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-22T19:43:12.795 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-22T19:43:12.795 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-22T19:43:13.132 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-04-22T19:43:13.164 DEBUG:teuthology.parallel:result is None 2024-04-22T19:43:13.164 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-22T19:43:13.177 INFO:teuthology.task.internal:Creating test directory... 2024-04-22T19:43:13.177 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T19:43:13.180 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T19:43:13.187 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-22T19:43:13.196 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-22T19:43:13.204 INFO:teuthology.task.internal:Creating archive directory... 2024-04-22T19:43:13.204 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T19:43:13.229 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T19:43:13.262 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-22T19:43:13.271 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-22T19:43:13.271 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T19:43:13.298 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T19:43:13.317 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T19:43:13.320 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T19:43:13.325 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T19:43:13.328 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T19:43:13.330 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-22T19:43:13.337 INFO:teuthology.task.internal:Configuring sudo... 2024-04-22T19:43:13.338 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T19:43:13.370 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T19:43:13.383 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-22T19:43:13.393 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-22T19:43:13.393 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T19:43:13.426 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T19:43:13.432 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T19:43:13.478 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T19:43:13.526 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:43:13.526 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T19:43:13.590 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T19:43:13.596 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T19:43:13.644 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:43:13.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T19:43:13.738 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-04-22T19:43:13.741 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-04-22T19:43:13.814 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-22T19:43:13.821 INFO:teuthology.task.internal:Starting timer... 2024-04-22T19:43:13.822 INFO:teuthology.run_tasks:Running task pcp... 2024-04-22T19:43:13.837 INFO:teuthology.run_tasks:Running task selinux... 2024-04-22T19:43:13.846 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-04-22T19:43:13.846 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-04-22T19:43:13.847 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-22T19:43:13.847 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-22T19:43:13.847 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-22T19:43:13.847 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-22T19:43:13.863 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-22T19:43:13.886 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-22T19:43:13.888 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-22T19:50:41.397 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-04-22T19:50:41.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:50:41.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:50:41.530 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-22T19:50:41.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-22T19:50:41.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:50:41.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T19:50:41.690 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-22T19:50:41.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-22T19:50:41.771 INFO:teuthology.run_tasks:Running task clock... 2024-04-22T19:50:41.781 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-22T19:50:41.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T19:50:41.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T19:50:41.785 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T19:50:41.785 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T19:50:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-22T19:50:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Command line: ntpd -gq 2024-04-22T19:50:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: ---------------------------------------------------- 2024-04-22T19:50:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: ntp-4 is maintained by Network Time Foundation, 2024-04-22T19:50:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: corporation. Support and training for ntp-4 are 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: available at https://www.nwtime.org/support 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: ---------------------------------------------------- 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: proto: precision = 0.044 usec (-24) 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: basedate set to 2022-02-04 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: gps base set to 2022-02-06 (week 2196) 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: restrict ::: KOD does nothing without LIMITED. 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-22T19:50:41.814 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-22T19:50:41.815 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen and drop on 0 v6wildcard [::]:123 2024-04-22T19:50:41.815 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-22T19:50:41.815 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen normally on 2 lo 127.0.0.1:123 2024-04-22T19:50:41.816 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-04-22T19:50:41.816 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen normally on 4 lo [::1]:123 2024-04-22T19:50:41.816 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-04-22T19:50:41.816 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:41 ntpd[17207]: Listening on routing socket on fd #22 for interface updates 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Command line: ntpd -gq 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: ---------------------------------------------------- 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: ntp-4 is maintained by Network Time Foundation, 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: corporation. Support and training for ntp-4 are 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: available at https://www.nwtime.org/support 2024-04-22T19:50:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: ---------------------------------------------------- 2024-04-22T19:50:41.847 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: proto: precision = 0.057 usec (-24) 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: basedate set to 2022-02-04 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: gps base set to 2022-02-06 (week 2196) 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: restrict ::: KOD does nothing without LIMITED. 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-22T19:50:41.850 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-22T19:50:41.851 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen and drop on 0 v6wildcard [::]:123 2024-04-22T19:50:41.851 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-22T19:50:41.852 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen normally on 2 lo 127.0.0.1:123 2024-04-22T19:50:41.852 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-04-22T19:50:41.852 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen normally on 4 lo [::1]:123 2024-04-22T19:50:41.852 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-04-22T19:50:41.852 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:41 ntpd[17208]: Listening on routing socket on fd #22 for interface updates 2024-04-22T19:50:42.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:42.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:42 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:42.846 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:42 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:43.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:43.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:43.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:43.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:43.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:43.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:43 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:43.846 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:43.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:43.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:43.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:43.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:43.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:43 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:44.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:44 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:44 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:45.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:45.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:45 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:45 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:46 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:46 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:47.812 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:47.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:47 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:47 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:48.813 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:48.814 INFO:teuthology.orchestra.run.smithi111.stdout:22 Apr 19:50:48 ntpd[17207]: ntpd: time slew -0.001645 s 2024-04-22T19:50:48.814 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.001645s 2024-04-22T19:50:48.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-22T19:50:48.814 INFO:teuthology.orchestra.run.smithi111.stderr:22 Apr 19:50:48 ntpd[17207]: can't open /var/log/ntpstats/loopstats.20240422: Permission denied 2024-04-22T19:50:48.846 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:48 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240422: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-22T19:50:49.848 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240422: Permission denied 2024-04-22T19:50:49.849 INFO:teuthology.orchestra.run.smithi138.stdout:22 Apr 19:50:49 ntpd[17208]: ntpd: time slew -0.000078 s 2024-04-22T19:50:49.849 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.000078s 2024-04-22T19:50:49.849 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-22T19:50:49.849 INFO:teuthology.orchestra.run.smithi138.stderr:22 Apr 19:50:49 ntpd[17208]: can't open /var/log/ntpstats/loopstats.20240422: Permission denied 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:49.893 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-22T19:50:49.894 INFO:teuthology.run_tasks:Running task install... 2024-04-22T19:50:49.903 DEBUG:teuthology.task.install:project ceph 2024-04-22T19:50:49.904 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}} 2024-04-22T19:50:49.904 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'} 2024-04-22T19:50:49.904 INFO:teuthology.task.install:Using flavor: default 2024-04-22T19:50:49.910 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-22T19:50:49.910 INFO:teuthology.task.install:extra packages: [] 2024-04-22T19:50:49.910 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-04-22T19:50:49.911 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-04-22T19:50:49.972 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-22T19:50:49.995 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-22T19:50:49.999 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-22T19:50:49.999 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-04-22T19:50:50.000 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-22T19:50:50.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:50:50.024 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-22T19:50:50.024 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-04-22T19:50:50.024 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-22T19:50:50.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:50:50.168 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default/ 2024-04-22T19:50:50.168 INFO:teuthology.task.install.deb:Package version is 19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:50:50.221 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default/ 2024-04-22T19:50:50.221 INFO:teuthology.task.install.deb:Package version is 19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:50:50.473 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:50:50.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-22T19:50:50.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-22T19:50:50.520 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:50:50.520 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-22T19:50:50.537 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-22T19:50:50.660 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:50:50.660 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-22T19:50:50.672 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-22T19:50:50.693 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-22T19:50:50.834 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-22T19:50:50.907 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-22T19:50:50.953 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy InRelease 2024-04-22T19:50:51.010 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy InRelease 2024-04-22T19:50:51.037 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-22T19:50:51.094 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-22T19:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-22T19:50:51.176 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-22T19:50:51.197 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-22T19:50:51.206 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-22T19:50:51.256 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-22T19:50:51.269 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-22T19:50:51.284 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-04-22T19:50:51.342 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-04-22T19:50:51.366 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.2 kB in 1s (42.2 kB/s) 2024-04-22T19:50:51.491 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 148 kB in 1s (191 kB/s) 2024-04-22T19:50:52.337 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:50:52.352 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3152-g9ed8263e-1jammy cephadm=19.0.0-3152-g9ed8263e-1jammy ceph-mds=19.0.0-3152-g9ed8263e-1jammy ceph-mgr=19.0.0-3152-g9ed8263e-1jammy ceph-common=19.0.0-3152-g9ed8263e-1jammy ceph-fuse=19.0.0-3152-g9ed8263e-1jammy ceph-test=19.0.0-3152-g9ed8263e-1jammy ceph-volume=19.0.0-3152-g9ed8263e-1jammy radosgw=19.0.0-3152-g9ed8263e-1jammy python3-rados=19.0.0-3152-g9ed8263e-1jammy python3-rgw=19.0.0-3152-g9ed8263e-1jammy python3-cephfs=19.0.0-3152-g9ed8263e-1jammy python3-rbd=19.0.0-3152-g9ed8263e-1jammy libcephfs2=19.0.0-3152-g9ed8263e-1jammy libcephfs-dev=19.0.0-3152-g9ed8263e-1jammy librados2=19.0.0-3152-g9ed8263e-1jammy librbd1=19.0.0-3152-g9ed8263e-1jammy rbd-fuse=19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:50:52.414 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-22T19:50:52.483 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:50:52.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3152-g9ed8263e-1jammy cephadm=19.0.0-3152-g9ed8263e-1jammy ceph-mds=19.0.0-3152-g9ed8263e-1jammy ceph-mgr=19.0.0-3152-g9ed8263e-1jammy ceph-common=19.0.0-3152-g9ed8263e-1jammy ceph-fuse=19.0.0-3152-g9ed8263e-1jammy ceph-test=19.0.0-3152-g9ed8263e-1jammy ceph-volume=19.0.0-3152-g9ed8263e-1jammy radosgw=19.0.0-3152-g9ed8263e-1jammy python3-rados=19.0.0-3152-g9ed8263e-1jammy python3-rgw=19.0.0-3152-g9ed8263e-1jammy python3-cephfs=19.0.0-3152-g9ed8263e-1jammy python3-rbd=19.0.0-3152-g9ed8263e-1jammy libcephfs2=19.0.0-3152-g9ed8263e-1jammy libcephfs-dev=19.0.0-3152-g9ed8263e-1jammy librados2=19.0.0-3152-g9ed8263e-1jammy librbd1=19.0.0-3152-g9ed8263e-1jammy rbd-fuse=19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:50:52.560 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-22T19:50:52.613 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-22T19:50:52.614 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-22T19:50:52.760 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-22T19:50:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-22T19:50:52.801 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:50:52.801 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:50:52.801 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:50:52.801 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:50:52.801 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-22T19:50:52.802 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-22T19:50:52.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-22T19:50:52.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-04-22T19:50:52.806 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-04-22T19:50:52.904 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-22T19:50:52.904 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-22T19:50:52.904 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-22T19:50:52.905 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-22T19:50:52.905 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-22T19:50:52.905 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-22T19:50:52.905 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-22T19:50:52.906 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-22T19:50:52.907 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-22T19:50:52.946 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-22T19:50:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-22T19:50:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-22T19:50:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-22T19:50:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-22T19:50:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-22T19:50:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-22T19:50:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-22T19:50:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-22T19:50:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-22T19:50:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-22T19:50:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-22T19:50:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet zip 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-22T19:50:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-04-22T19:50:53.050 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-22T19:50:53.051 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-22T19:50:53.052 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-22T19:50:53.053 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-22T19:50:53.095 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-22T19:50:53.096 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 181 MB of archives. 2024-04-22T19:50:53.096 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-22T19:50:53.096 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-22T19:50:53.132 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-22T19:50:53.133 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 181 MB of archives. 2024-04-22T19:50:53.133 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-22T19:50:53.133 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-22T19:50:53.145 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3152-g9ed8263e-1jammy [3,554 kB] 2024-04-22T19:50:53.294 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-22T19:50:53.298 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-22T19:50:53.318 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3152-g9ed8263e-1jammy [3,554 kB] 2024-04-22T19:50:53.326 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-22T19:50:53.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-22T19:50:53.430 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-22T19:50:53.447 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-22T19:50:53.453 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-22T19:50:53.454 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-22T19:50:53.455 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-22T19:50:53.466 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-22T19:50:53.469 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-22T19:50:53.472 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-22T19:50:53.476 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-22T19:50:53.507 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-22T19:50:53.511 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-22T19:50:53.513 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-22T19:50:53.515 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-22T19:50:53.516 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-22T19:50:53.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-22T19:50:53.518 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-22T19:50:53.519 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-22T19:50:53.519 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-22T19:50:53.522 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-22T19:50:53.535 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-22T19:50:53.552 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-22T19:50:53.553 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-22T19:50:53.574 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-22T19:50:53.575 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-22T19:50:53.580 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-22T19:50:53.582 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-22T19:50:53.583 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-22T19:50:53.584 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-22T19:50:53.585 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-22T19:50:53.586 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-22T19:50:53.600 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-22T19:50:53.602 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-22T19:50:53.616 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-22T19:50:53.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-22T19:50:53.627 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-22T19:50:53.638 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-22T19:50:53.638 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-22T19:50:53.640 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-22T19:50:53.641 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-22T19:50:53.643 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-22T19:50:53.647 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-22T19:50:53.653 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-22T19:50:53.656 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-22T19:50:53.683 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-22T19:50:53.685 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-22T19:50:53.686 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-22T19:50:53.688 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-22T19:50:53.693 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-22T19:50:53.839 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-22T19:50:53.840 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-22T19:50:53.842 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-22T19:50:53.842 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-22T19:50:53.844 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-22T19:50:53.846 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-22T19:50:53.857 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-22T19:50:53.885 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-22T19:50:53.887 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-22T19:50:53.888 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-22T19:50:53.889 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-22T19:50:53.897 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-22T19:50:53.898 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-22T19:50:53.899 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-22T19:50:53.918 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-22T19:50:53.932 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-22T19:50:53.933 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-22T19:50:53.946 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-22T19:50:53.946 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-22T19:50:53.947 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-22T19:50:53.951 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-22T19:50:53.951 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-22T19:50:53.989 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-22T19:50:53.996 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-22T19:50:53.999 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-22T19:50:54.002 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-22T19:50:54.003 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-22T19:50:54.039 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-22T19:50:54.044 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-22T19:50:54.046 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-22T19:50:54.048 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-22T19:50:54.057 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-22T19:50:54.086 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-22T19:50:54.090 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-22T19:50:54.097 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-22T19:50:54.097 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-22T19:50:54.099 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-22T19:50:54.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-22T19:50:54.140 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-22T19:50:54.142 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-22T19:50:54.159 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-22T19:50:54.160 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-22T19:50:54.160 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-22T19:50:54.190 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-22T19:50:54.192 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-22T19:50:54.364 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3152-g9ed8263e-1jammy [3,224 kB] 2024-04-22T19:50:54.494 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-22T19:50:54.527 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-22T19:50:54.529 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-22T19:50:54.609 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-22T19:50:54.661 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-22T19:50:54.663 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3152-g9ed8263e-1jammy [712 kB] 2024-04-22T19:50:54.683 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-22T19:50:54.689 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-22T19:50:54.690 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-22T19:50:54.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-22T19:50:54.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-22T19:50:54.731 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3152-g9ed8263e-1jammy [356 kB] 2024-04-22T19:50:54.738 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3152-g9ed8263e-1jammy [32.8 kB] 2024-04-22T19:50:54.739 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3152-g9ed8263e-1jammy [180 kB] 2024-04-22T19:50:54.770 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3152-g9ed8263e-1jammy [66.9 kB] 2024-04-22T19:50:54.771 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3152-g9ed8263e-1jammy [330 kB] 2024-04-22T19:50:54.777 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3152-g9ed8263e-1jammy [6,893 kB] 2024-04-22T19:50:54.856 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3152-g9ed8263e-1jammy [3,224 kB] 2024-04-22T19:50:54.868 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-22T19:50:54.951 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-22T19:50:54.980 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-22T19:50:54.997 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-22T19:50:55.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-22T19:50:55.148 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3152-g9ed8263e-1jammy [112 kB] 2024-04-22T19:50:55.150 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3152-g9ed8263e-1jammy [466 kB] 2024-04-22T19:50:55.183 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3152-g9ed8263e-1jammy [25.8 MB] 2024-04-22T19:50:55.251 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-22T19:50:55.266 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-22T19:50:55.274 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-22T19:50:55.278 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-22T19:50:55.300 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-22T19:50:55.303 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-22T19:50:55.470 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-22T19:50:55.787 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-22T19:50:55.824 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-22T19:50:55.835 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-22T19:50:56.040 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-22T19:50:56.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-22T19:50:56.047 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-22T19:50:56.053 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-22T19:50:56.068 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-22T19:50:56.089 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-22T19:50:56.095 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-22T19:50:56.270 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-22T19:50:56.432 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3152-g9ed8263e-1jammy [5,092 kB] 2024-04-22T19:50:56.534 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-22T19:50:56.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3152-g9ed8263e-1jammy [244 kB] 2024-04-22T19:50:56.632 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3152-g9ed8263e-1jammy [124 kB] 2024-04-22T19:50:56.635 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3152-g9ed8263e-1jammy [1,526 kB] 2024-04-22T19:50:56.662 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3152-g9ed8263e-1jammy [712 kB] 2024-04-22T19:50:56.699 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3152-g9ed8263e-1jammy [6,257 kB] 2024-04-22T19:50:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-22T19:50:56.728 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-22T19:50:56.747 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-22T19:50:56.812 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-22T19:50:56.994 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3152-g9ed8263e-1jammy [22.8 MB] 2024-04-22T19:50:57.100 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-22T19:50:57.103 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-22T19:50:57.106 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-22T19:50:57.108 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3152-g9ed8263e-1jammy [356 kB] 2024-04-22T19:50:57.108 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-22T19:50:57.110 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-22T19:50:57.328 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-22T19:50:57.357 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3152-g9ed8263e-1jammy [32.8 kB] 2024-04-22T19:50:57.358 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3152-g9ed8263e-1jammy [180 kB] 2024-04-22T19:50:57.526 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3152-g9ed8263e-1jammy [66.9 kB] 2024-04-22T19:50:57.531 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3152-g9ed8263e-1jammy [330 kB] 2024-04-22T19:50:57.751 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3152-g9ed8263e-1jammy [6,893 kB] 2024-04-22T19:50:57.762 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-22T19:50:57.768 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-22T19:50:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-22T19:50:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-22T19:50:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-22T19:50:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-22T19:50:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-22T19:50:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-22T19:50:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-22T19:50:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-22T19:50:58.250 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-22T19:50:58.300 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3152-g9ed8263e-1jammy [14.0 kB] 2024-04-22T19:50:58.300 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3152-g9ed8263e-1jammy [870 kB] 2024-04-22T19:50:58.318 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3152-g9ed8263e-1jammy [2,436 kB] 2024-04-22T19:50:58.459 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3152-g9ed8263e-1jammy [791 kB] 2024-04-22T19:50:58.501 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3152-g9ed8263e-1jammy [148 kB] 2024-04-22T19:50:58.522 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3152-g9ed8263e-1jammy [2,297 kB] 2024-04-22T19:50:58.644 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3152-g9ed8263e-1jammy [8,625 kB] 2024-04-22T19:50:58.667 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-22T19:50:58.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-22T19:50:58.749 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-22T19:50:58.846 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-22T19:50:58.886 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-22T19:50:58.897 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-22T19:50:58.903 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-22T19:50:58.949 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-22T19:50:58.953 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-22T19:50:58.974 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-22T19:50:59.140 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-22T19:50:59.196 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3152-g9ed8263e-1jammy [14.2 kB] 2024-04-22T19:50:59.197 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3152-g9ed8263e-1jammy [51.6 MB] 2024-04-22T19:50:59.405 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-22T19:50:59.423 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-22T19:50:59.575 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-22T19:50:59.604 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-22T19:50:59.762 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-22T19:50:59.764 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-22T19:50:59.766 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-22T19:50:59.789 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-22T19:50:59.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-22T19:51:01.329 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3152-g9ed8263e-1jammy [112 kB] 2024-04-22T19:51:01.387 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3152-g9ed8263e-1jammy [466 kB] 2024-04-22T19:51:01.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3152-g9ed8263e-1jammy [25.8 MB] 2024-04-22T19:51:03.504 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3152-g9ed8263e-1jammy [124 kB] 2024-04-22T19:51:03.507 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3152-g9ed8263e-1jammy [38.9 kB] 2024-04-22T19:51:03.508 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3152-g9ed8263e-1jammy [13.6 MB] 2024-04-22T19:51:05.989 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3152-g9ed8263e-1jammy [91.4 kB] 2024-04-22T19:51:06.544 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 181 MB in 13s (14.0 MB/s) 2024-04-22T19:51:06.709 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-22T19:51:06.809 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-22T19:51:06.814 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-22T19:51:06.899 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-22T19:51:07.185 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-22T19:51:07.211 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-22T19:51:07.251 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-22T19:51:07.546 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-22T19:51:07.573 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-22T19:51:07.630 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-22T19:51:08.050 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-22T19:51:08.077 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:08.125 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:08.520 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-22T19:51:08.546 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:08.586 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:08.948 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-22T19:51:08.974 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:09.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:09.342 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-22T19:51:09.369 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-22T19:51:09.409 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-22T19:51:09.670 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-04-22T19:51:09.697 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-librados2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:09.736 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:10.198 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-04-22T19:51:10.224 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-librbd1_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:10.264 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:10.717 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-04-22T19:51:10.744 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:10.783 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:11.069 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-04-22T19:51:11.096 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:11.136 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:11.430 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-22T19:51:11.446 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:11.899 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-04-22T19:51:11.926 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:11.966 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:12.277 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-22T19:51:12.303 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:12.343 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:12.672 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-22T19:51:12.698 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-22T19:51:12.738 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-22T19:51:13.032 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-04-22T19:51:13.048 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-22T19:51:13.082 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-22T19:51:13.318 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-04-22T19:51:13.334 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:13.376 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:13.713 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-22T19:51:13.740 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-22T19:51:13.804 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-22T19:51:14.082 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-22T19:51:14.108 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-22T19:51:14.148 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-22T19:51:14.206 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3152-g9ed8263e-1jammy [5,092 kB] 2024-04-22T19:51:14.451 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-22T19:51:14.466 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-22T19:51:14.501 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-22T19:51:14.796 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-04-22T19:51:14.822 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-22T19:51:14.871 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-22T19:51:15.190 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-04-22T19:51:15.217 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-22T19:51:15.257 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-22T19:51:15.394 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3152-g9ed8263e-1jammy [244 kB] 2024-04-22T19:51:15.439 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3152-g9ed8263e-1jammy [124 kB] 2024-04-22T19:51:15.461 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3152-g9ed8263e-1jammy [1,526 kB] 2024-04-22T19:51:15.484 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-04-22T19:51:15.508 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-22T19:51:15.551 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-04-22T19:51:15.757 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3152-g9ed8263e-1jammy [6,257 kB] 2024-04-22T19:51:15.846 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-04-22T19:51:15.872 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-22T19:51:15.912 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-22T19:51:16.283 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-04-22T19:51:16.309 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-22T19:51:16.349 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-22T19:51:16.853 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3152-g9ed8263e-1jammy [22.8 MB] 2024-04-22T19:51:16.890 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-04-22T19:51:16.917 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-librgw2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:16.948 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:17.492 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-04-22T19:51:17.508 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:17.550 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:17.887 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-22T19:51:17.913 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-22T19:51:17.953 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-22T19:51:18.273 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-04-22T19:51:18.300 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:18.339 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:18.693 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-04-22T19:51:18.719 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:18.759 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:20.073 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-04-22T19:51:20.099 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:20.149 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:20.190 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3152-g9ed8263e-1jammy [14.0 kB] 2024-04-22T19:51:20.190 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3152-g9ed8263e-1jammy [870 kB] 2024-04-22T19:51:20.254 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3152-g9ed8263e-1jammy [2,436 kB] 2024-04-22T19:51:20.510 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3152-g9ed8263e-1jammy [791 kB] 2024-04-22T19:51:20.596 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3152-g9ed8263e-1jammy [148 kB] 2024-04-22T19:51:20.611 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3152-g9ed8263e-1jammy [2,297 kB] 2024-04-22T19:51:20.735 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-22T19:51:20.762 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-22T19:51:20.801 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-22T19:51:20.895 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3152-g9ed8263e-1jammy [8,625 kB] 2024-04-22T19:51:21.104 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-04-22T19:51:21.131 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-22T19:51:21.179 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-22T19:51:21.490 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-22T19:51:21.517 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-22T19:51:21.557 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-22T19:51:21.818 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-22T19:51:21.830 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3152-g9ed8263e-1jammy [14.2 kB] 2024-04-22T19:51:21.830 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3152-g9ed8263e-1jammy [51.6 MB] 2024-04-22T19:51:21.833 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-22T19:51:21.868 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-22T19:51:22.121 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-22T19:51:22.147 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-22T19:51:22.179 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-22T19:51:22.499 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-04-22T19:51:22.525 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-22T19:51:22.565 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-22T19:51:22.893 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-04-22T19:51:22.920 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-22T19:51:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-22T19:51:23.237 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-22T19:51:23.264 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-22T19:51:23.304 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-22T19:51:23.574 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-22T19:51:23.600 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-22T19:51:23.640 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-22T19:51:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-04-22T19:51:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-22T19:51:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-22T19:51:24.297 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-04-22T19:51:24.323 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-22T19:51:24.355 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-22T19:51:24.641 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-22T19:51:24.667 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-22T19:51:24.707 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-22T19:51:24.797 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3152-g9ed8263e-1jammy [124 kB] 2024-04-22T19:51:24.799 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3152-g9ed8263e-1jammy [38.9 kB] 2024-04-22T19:51:24.800 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3152-g9ed8263e-1jammy [13.6 MB] 2024-04-22T19:51:25.157 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-65551/9ed8263edff7e87907bf24b054e5c7144c194dbe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3152-g9ed8263e-1jammy [91.4 kB] 2024-04-22T19:51:25.686 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-04-22T19:51:25.712 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-22T19:51:25.752 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-22T19:51:25.860 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 181 MB in 32s (5,602 kB/s) 2024-04-22T19:51:26.114 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-22T19:51:26.140 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-22T19:51:26.180 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-22T19:51:26.441 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-22T19:51:26.456 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-22T19:51:26.491 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-22T19:51:26.592 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-22T19:51:26.694 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-22T19:51:26.700 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-22T19:51:26.782 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-22T19:51:26.794 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-04-22T19:51:26.821 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-22T19:51:27.010 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-22T19:51:27.135 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-22T19:51:27.162 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-22T19:51:27.202 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-22T19:51:27.364 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-04-22T19:51:27.390 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-22T19:51:27.433 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-22T19:51:27.547 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-22T19:51:27.573 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-22T19:51:27.613 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-22T19:51:27.741 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-04-22T19:51:27.768 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-22T19:51:27.808 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-22T19:51:27.983 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-22T19:51:28.010 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:28.058 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:28.069 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-04-22T19:51:28.095 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-22T19:51:28.135 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-22T19:51:28.436 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-22T19:51:28.455 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-22T19:51:28.462 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:28.471 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-22T19:51:28.503 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:28.514 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-22T19:51:28.816 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-22T19:51:28.839 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-22T19:51:28.843 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-22T19:51:28.866 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-22T19:51:28.883 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-22T19:51:28.906 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:51:29.203 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-04-22T19:51:29.230 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-22T19:51:29.259 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-22T19:51:29.269 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-22T19:51:29.285 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-22T19:51:29.325 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-22T19:51:29.564 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-04-22T19:51:29.591 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-22T19:51:29.622 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-22T19:51:29.670 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-04-22T19:51:29.696 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:29.737 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:29.976 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-04-22T19:51:30.003 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-22T19:51:30.043 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-22T19:51:30.148 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-04-22T19:51:30.174 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librbd1_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:30.214 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:30.304 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-04-22T19:51:30.330 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-22T19:51:30.362 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-22T19:51:30.649 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-04-22T19:51:30.675 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-22T19:51:30.716 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-22T19:51:30.919 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-04-22T19:51:30.943 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:30.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:31.043 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-04-22T19:51:31.070 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-22T19:51:31.110 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-22T19:51:31.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-04-22T19:51:31.301 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:31.344 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:31.421 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-22T19:51:31.447 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-22T19:51:31.487 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-22T19:51:31.656 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-22T19:51:31.682 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:31.722 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:31.766 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-22T19:51:31.792 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:31.824 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:31.941 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-04-22T19:51:31.957 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:32.000 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:32.237 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-22T19:51:32.264 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:32.303 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:32.319 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-22T19:51:32.345 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:32.385 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:32.575 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-22T19:51:32.590 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-22T19:51:32.625 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-22T19:51:32.714 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-22T19:51:32.740 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-22T19:51:32.780 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-22T19:51:32.869 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-04-22T19:51:32.896 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-22T19:51:32.936 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-22T19:51:33.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-04-22T19:51:33.134 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-22T19:51:33.175 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-22T19:51:33.272 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-04-22T19:51:33.298 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:33.338 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:33.419 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-04-22T19:51:33.434 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:33.469 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:33.734 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-04-22T19:51:33.760 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:33.797 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-22T19:51:33.800 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:33.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-22T19:51:33.863 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-22T19:51:34.116 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-22T19:51:34.131 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-22T19:51:34.174 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-22T19:51:34.337 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-04-22T19:51:34.364 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:34.395 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:34.485 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-22T19:51:34.500 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-22T19:51:34.543 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-22T19:51:34.880 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-04-22T19:51:34.906 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-22T19:51:34.947 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-22T19:51:35.266 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-04-22T19:51:35.282 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-22T19:51:35.316 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-22T19:51:35.440 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-04-22T19:51:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:35.498 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:35.544 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-04-22T19:51:35.570 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-22T19:51:35.611 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-04-22T19:51:35.826 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-04-22T19:51:35.853 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:35.893 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:36.064 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-04-22T19:51:36.090 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-22T19:51:36.131 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-22T19:51:36.213 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-04-22T19:51:36.240 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:36.271 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:36.526 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-04-22T19:51:36.552 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-22T19:51:36.592 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-22T19:51:36.649 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-04-22T19:51:36.675 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-cephadm_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:36.724 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:36.950 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-04-22T19:51:36.976 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-librgw2_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:37.017 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:37.035 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-22T19:51:37.062 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-22T19:51:37.101 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-22T19:51:37.528 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-04-22T19:51:37.537 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-22T19:51:37.543 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:37.564 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-22T19:51:37.586 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:37.604 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-22T19:51:37.947 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-22T19:51:37.973 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-22T19:51:38.014 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-22T19:51:38.325 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-04-22T19:51:38.351 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:38.391 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:38.634 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-04-22T19:51:38.661 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-22T19:51:38.700 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-22T19:51:38.820 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-04-22T19:51:38.846 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:38.886 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:38.978 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-04-22T19:51:39.005 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-22T19:51:39.037 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-22T19:51:39.331 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-22T19:51:39.358 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:39.389 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:39.702 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-22T19:51:39.728 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-22T19:51:39.759 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-22T19:51:40.029 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-04-22T19:51:40.056 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-22T19:51:40.095 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-22T19:51:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-04-22T19:51:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:40.350 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:40.390 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-22T19:51:40.418 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:40.457 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:40.954 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-22T19:51:40.980 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-22T19:51:41.029 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-22T19:51:41.332 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-04-22T19:51:41.358 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-22T19:51:41.399 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-22T19:51:41.662 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-22T19:51:41.678 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-22T19:51:41.718 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-22T19:51:41.720 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-22T19:51:41.745 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-22T19:51:41.785 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-22T19:51:42.121 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-22T19:51:42.147 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-22T19:51:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-22T19:51:42.224 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-04-22T19:51:42.251 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-22T19:51:42.299 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-22T19:51:42.491 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-22T19:51:42.517 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-22T19:51:42.557 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-22T19:51:42.678 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-22T19:51:42.705 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-22T19:51:42.744 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-22T19:51:42.860 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-04-22T19:51:42.886 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-22T19:51:42.927 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-22T19:51:43.047 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-04-22T19:51:43.074 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-22T19:51:43.113 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-22T19:51:43.229 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-04-22T19:51:43.256 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-22T19:51:43.326 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-22T19:51:43.632 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-22T19:51:43.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-22T19:51:43.699 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-22T19:51:43.789 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-22T19:51:43.816 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:43.941 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:44.002 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-22T19:51:44.028 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-22T19:51:44.060 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-22T19:51:44.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-04-22T19:51:44.432 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-22T19:51:44.472 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-22T19:51:44.783 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-04-22T19:51:44.810 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-22T19:51:44.850 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-22T19:51:44.878 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-04-22T19:51:44.905 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-22T19:51:44.944 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-22T19:51:45.136 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-22T19:51:45.163 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-22T19:51:45.194 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-22T19:51:45.247 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-22T19:51:45.274 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-22T19:51:45.314 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-22T19:51:45.497 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-04-22T19:51:45.524 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-22T19:51:45.564 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-22T19:51:45.642 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-22T19:51:45.669 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-22T19:51:45.709 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-22T19:51:45.892 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-22T19:51:45.918 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-22T19:51:45.959 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-22T19:51:46.004 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-04-22T19:51:46.030 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-22T19:51:46.145 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-22T19:51:46.386 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-22T19:51:46.413 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-22T19:51:46.444 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-22T19:51:46.457 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-04-22T19:51:46.484 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-22T19:51:46.524 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-22T19:51:46.731 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-04-22T19:51:46.758 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-22T19:51:46.797 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-22T19:51:46.827 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-22T19:51:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-22T19:51:46.885 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-22T19:51:47.117 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-04-22T19:51:47.144 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-22T19:51:47.155 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-04-22T19:51:47.179 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-22T19:51:47.182 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-22T19:51:47.221 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-22T19:51:47.495 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-04-22T19:51:47.522 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-22T19:51:47.541 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-22T19:51:47.561 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-22T19:51:47.568 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-22T19:51:47.608 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-22T19:51:47.867 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-04-22T19:51:47.893 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-22T19:51:47.933 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-22T19:51:48.245 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-22T19:51:48.261 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-22T19:51:48.271 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-22T19:51:48.288 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:48.303 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-22T19:51:48.321 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:48.607 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-22T19:51:48.624 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-22T19:51:48.633 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-22T19:51:48.652 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-22T19:51:48.673 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-22T19:51:48.716 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-22T19:51:48.935 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-04-22T19:51:48.962 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-22T19:51:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-22T19:51:49.053 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-22T19:51:49.080 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-22T19:51:49.119 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-22T19:51:49.289 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-04-22T19:51:49.315 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-22T19:51:49.355 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-22T19:51:49.363 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-04-22T19:51:49.390 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-22T19:51:49.430 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-22T19:51:49.641 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-04-22T19:51:49.657 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-22T19:51:49.699 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-22T19:51:49.719 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-04-22T19:51:49.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-22T19:51:49.786 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-22T19:51:50.003 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-04-22T19:51:50.030 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-22T19:51:50.069 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-22T19:51:50.114 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-04-22T19:51:50.141 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-22T19:51:50.181 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-22T19:51:50.416 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-04-22T19:51:50.443 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:50.476 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-04-22T19:51:50.482 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:50.502 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-22T19:51:50.534 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-22T19:51:50.830 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-04-22T19:51:50.856 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-22T19:51:50.888 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-22T19:51:51.150 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-22T19:51:51.176 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-22T19:51:51.216 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-22T19:51:51.537 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-22T19:51:51.563 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:51.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:52.001 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-22T19:51:52.027 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:52.362 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-22T19:51:52.389 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-22T19:51:52.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-22T19:51:52.603 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-04-22T19:51:52.631 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:52.661 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:52.707 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-04-22T19:51:52.734 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-22T19:51:52.773 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-22T19:51:52.973 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-22T19:51:52.990 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:53.119 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-04-22T19:51:53.145 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:53.185 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:53.215 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:53.534 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-22T19:51:53.563 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-22T19:51:53.589 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-04-22T19:51:53.601 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-22T19:51:53.616 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:53.656 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:53.939 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-22T19:51:53.967 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-22T19:51:54.005 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-22T19:51:54.277 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-04-22T19:51:54.303 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:54.343 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:54.368 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-04-22T19:51:54.395 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-22T19:51:54.434 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-22T19:51:54.848 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-04-22T19:51:54.875 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-22T19:51:54.914 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-22T19:51:55.167 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-22T19:51:55.183 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-22T19:51:55.225 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-22T19:51:55.413 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-04-22T19:51:55.429 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:55.472 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:55.629 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-22T19:51:55.657 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-22T19:51:55.695 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-22T19:51:55.800 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-04-22T19:51:55.827 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:55.858 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:55.948 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-04-22T19:51:55.975 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-22T19:51:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-22T19:51:56.245 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-04-22T19:51:56.272 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:56.293 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-04-22T19:51:56.312 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:56.320 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-22T19:51:56.359 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-22T19:51:56.671 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-04-22T19:51:56.698 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-22T19:51:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-04-22T19:51:56.742 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-cephadm_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:51:56.745 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-22T19:51:56.782 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:57.077 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-22T19:51:57.082 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-04-22T19:51:57.104 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-22T19:51:57.109 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-22T19:51:57.148 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-22T19:51:57.160 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-22T19:51:57.472 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-22T19:51:57.477 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-04-22T19:51:57.498 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-22T19:51:57.504 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-22T19:51:57.538 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-22T19:51:57.543 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-22T19:51:57.989 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-22T19:51:58.017 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-22T19:51:58.055 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-22T19:51:58.366 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-04-22T19:51:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-22T19:51:58.433 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-22T19:51:58.494 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-04-22T19:51:58.521 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-22T19:51:58.561 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-22T19:51:58.728 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-04-22T19:51:58.755 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-22T19:51:58.794 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-22T19:51:58.881 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-04-22T19:51:58.908 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-22T19:51:58.948 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-22T19:51:59.122 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-04-22T19:51:59.150 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-22T19:51:59.189 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-22T19:51:59.301 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-22T19:51:59.328 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:51:59.368 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:51:59.458 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-22T19:51:59.486 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-22T19:51:59.525 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-22T19:51:59.738 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-22T19:51:59.765 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-22T19:51:59.805 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-22T19:52:00.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-04-22T19:52:00.135 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-22T19:52:00.175 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-22T19:52:00.204 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-04-22T19:52:00.232 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-radosgw_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:00.262 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:00.512 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-22T19:52:00.539 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:52:00.579 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:01.073 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-04-22T19:52:01.089 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:01.131 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:01.428 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-22T19:52:01.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-22T19:52:01.796 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-22T19:52:02.036 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-22T19:52:02.093 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-22T19:52:02.109 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-22T19:52:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-22T19:52:02.374 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-22T19:52:02.638 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-04-22T19:52:02.665 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-22T19:52:02.705 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-22T19:52:02.800 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-22T19:52:02.864 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:03.051 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-22T19:52:03.078 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-22T19:52:03.109 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-22T19:52:03.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-04-22T19:52:03.415 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-04-22T19:52:03.431 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-22T19:52:03.470 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-22T19:52:03.537 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-22T19:52:03.805 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-22T19:52:04.056 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-22T19:52:04.182 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-22T19:52:04.222 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-22T19:52:04.250 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:52:04.391 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:04.442 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-22T19:52:04.702 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-22T19:52:04.803 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-22T19:52:05.096 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-22T19:52:05.388 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-04-22T19:52:05.415 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-22T19:52:05.432 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-22T19:52:05.454 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-22T19:52:05.683 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-22T19:52:05.757 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-22T19:52:05.784 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-22T19:52:05.824 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-22T19:52:05.951 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-22T19:52:06.136 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-22T19:52:06.163 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-22T19:52:06.186 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-22T19:52:06.203 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-22T19:52:06.453 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-22T19:52:06.473 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-04-22T19:52:06.488 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-22T19:52:06.523 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-22T19:52:06.688 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-22T19:52:06.890 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-04-22T19:52:06.918 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-22T19:52:06.922 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:07.044 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-22T19:52:07.173 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-22T19:52:07.389 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-22T19:52:07.416 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-22T19:52:07.416 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-22T19:52:07.456 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-22T19:52:07.550 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-22T19:52:07.676 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-22T19:52:07.768 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-04-22T19:52:07.795 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-22T19:52:07.834 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-22T19:52:07.927 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-22T19:52:08.180 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-22T19:52:08.207 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-22T19:52:08.246 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-22T19:52:08.304 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-22T19:52:08.334 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-22T19:52:08.397 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-22T19:52:08.523 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-22T19:52:08.953 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-22T19:52:08.969 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:52:09.003 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:09.199 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-22T19:52:09.306 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-22T19:52:09.333 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-22T19:52:09.350 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-22T19:52:09.373 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-22T19:52:09.618 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-22T19:52:09.718 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-22T19:52:09.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-22T19:52:09.785 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-22T19:52:09.886 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-22T19:52:10.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-04-22T19:52:10.046 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-22T19:52:10.079 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-22T19:52:10.187 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-04-22T19:52:10.288 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-22T19:52:10.316 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-04-22T19:52:10.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-22T19:52:10.374 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-22T19:52:10.695 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-04-22T19:52:10.722 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-22T19:52:10.761 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-22T19:52:10.957 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-22T19:52:11.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-04-22T19:52:11.135 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:11.174 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:11.208 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-22T19:52:11.334 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-22T19:52:11.460 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-22T19:52:11.744 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-22T19:52:12.113 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-22T19:52:12.355 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-22T19:52:12.765 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-22T19:52:13.058 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-22T19:52:13.410 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-22T19:52:13.480 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-04-22T19:52:13.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3152-g9ed8263e-1jammy_all.deb ... 2024-04-22T19:52:13.546 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:13.644 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-22T19:52:13.753 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:13.851 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-22T19:52:13.867 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:13.909 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:14.038 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1) ... 2024-04-22T19:52:14.212 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-22T19:52:14.240 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-22T19:52:14.279 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-22T19:52:14.356 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-22T19:52:14.593 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-22T19:52:14.620 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-22T19:52:14.651 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-22T19:52:15.031 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-04-22T19:52:15.058 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-22T19:52:15.097 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-22T19:52:15.476 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-22T19:52:15.528 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-04-22T19:52:15.556 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-22T19:52:15.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-22T19:52:15.739 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:15.848 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-22T19:52:15.873 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-22T19:52:15.876 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-22T19:52:15.915 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-22T19:52:16.132 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-22T19:52:16.258 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-22T19:52:16.385 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-22T19:52:16.386 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-22T19:52:16.413 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-22T19:52:16.452 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-22T19:52:16.674 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-22T19:52:16.705 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-04-22T19:52:16.729 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-22T19:52:16.771 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-22T19:52:16.905 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-22T19:52:17.084 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-04-22T19:52:17.111 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-22T19:52:17.150 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-22T19:52:17.156 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:17.282 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-22T19:52:17.462 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-04-22T19:52:17.489 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-22T19:52:17.529 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-22T19:52:17.584 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-22T19:52:17.835 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-22T19:52:17.857 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-04-22T19:52:17.884 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-22T19:52:17.923 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-22T19:52:18.070 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-22T19:52:18.244 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-04-22T19:52:18.272 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-22T19:52:18.304 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-22T19:52:18.310 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-22T19:52:18.572 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-22T19:52:18.765 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-22T19:52:18.793 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-22T19:52:18.831 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-22T19:52:18.832 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-22T19:52:18.957 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-22T19:52:19.152 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-04-22T19:52:19.179 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-22T19:52:19.218 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-22T19:52:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-22T19:52:19.468 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-22T19:52:19.488 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-04-22T19:52:19.504 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-22T19:52:19.538 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-22T19:52:19.752 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-22T19:52:19.892 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-04-22T19:52:19.920 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-22T19:52:19.959 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-22T19:52:20.029 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-22T19:52:20.228 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-22T19:52:20.244 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-22T19:52:20.263 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-22T19:52:20.286 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-22T19:52:20.389 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-22T19:52:20.515 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-22T19:52:20.604 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-22T19:52:20.833 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-22T19:52:20.959 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-22T19:52:21.041 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-04-22T19:52:21.069 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-radosgw_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:21.108 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:21.344 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-22T19:52:21.579 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-22T19:52:21.730 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-22T19:52:21.903 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-04-22T19:52:21.919 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3152-g9ed8263e-1jammy_amd64.deb ... 2024-04-22T19:52:21.953 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:21.989 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:22.115 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-22T19:52:22.266 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-22T19:52:22.433 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-22T19:52:22.567 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-22T19:52:22.685 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-22T19:52:22.742 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-22T19:52:22.913 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-22T19:52:23.018 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-22T19:52:23.136 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-22T19:52:23.252 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-22T19:52:23.396 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-22T19:52:23.663 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-22T19:52:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-22T19:52:23.739 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-22T19:52:24.369 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-22T19:52:24.392 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-04-22T19:52:24.629 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-22T19:52:24.645 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-22T19:52:24.989 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-22T19:52:25.038 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-22T19:52:25.115 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:25.242 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:25.368 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-22T19:52:25.393 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-22T19:52:25.621 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-22T19:52:25.671 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:25.797 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-22T19:52:25.923 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-22T19:52:26.158 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-22T19:52:26.200 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:26.284 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-22T19:52:26.326 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:26.452 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:26.619 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-22T19:52:26.651 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-22T19:52:26.651 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-22T19:52:26.989 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-22T19:52:27.111 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:27.212 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:27.248 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-22T19:52:27.322 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:27.448 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-22T19:52:27.517 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-22T19:52:27.760 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-22T19:52:27.995 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-22T19:52:28.254 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-22T19:52:28.506 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:28.660 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:28.765 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-22T19:52:28.786 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:28.887 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:28.891 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-22T19:52:29.013 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:29.018 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-22T19:52:29.131 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:29.144 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-22T19:52:29.396 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-22T19:52:29.674 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-04-22T19:52:29.783 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-22T19:52:29.818 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-22T19:52:29.883 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-22T19:52:30.009 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-22T19:52:30.042 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-04-22T19:52:30.202 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-04-22T19:52:30.212 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-22T19:52:30.348 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-22T19:52:30.377 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-22T19:52:30.503 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-22T19:52:30.637 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-22T19:52:30.780 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-22T19:52:31.039 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-22T19:52:31.081 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:31.208 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:31.332 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-04-22T19:52:31.458 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-22T19:52:31.670 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-22T19:52:31.670 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-22T19:52:32.109 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:32.178 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-22T19:52:32.438 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-22T19:52:32.446 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-22T19:52:32.597 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-22T19:52:32.723 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-22T19:52:32.886 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:33.016 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-22T19:52:33.095 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-22T19:52:33.096 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-22T19:52:33.426 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-22T19:52:33.547 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:33.669 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-22T19:52:33.761 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-22T19:52:33.761 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-22T19:52:34.038 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-22T19:52:34.206 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:34.323 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-22T19:52:34.486 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-22T19:52:34.486 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-22T19:52:34.666 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-22T19:52:34.909 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-22T19:52:34.950 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:35.027 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:35.076 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:35.227 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:35.336 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2024-04-22T19:52:35.422 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-22T19:52:35.422 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-22T19:52:35.664 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-22T19:52:35.870 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:36.021 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:36.147 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:36.298 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:36.651 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-22T19:52:36.752 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-22T19:52:36.770 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-22T19:52:36.896 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-22T19:52:37.013 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:37.148 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-22T19:52:37.426 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-22T19:52:37.551 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-22T19:52:37.956 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-22T19:52:38.102 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-22T19:52:38.412 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-22T19:52:38.590 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-22T19:52:38.595 DEBUG:teuthology.parallel:result is None 2024-04-22T19:52:38.672 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-22T19:52:38.923 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:39.049 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-22T19:52:39.343 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-22T19:52:39.594 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-22T19:52:39.862 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-22T19:52:40.122 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-22T19:52:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-22T19:52:40.641 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-22T19:52:40.784 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-22T19:52:41.069 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-22T19:52:41.203 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-22T19:52:41.505 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-22T19:52:41.806 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-22T19:52:42.057 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-22T19:52:42.159 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-22T19:52:42.260 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-22T19:52:42.349 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-22T19:52:42.587 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-22T19:52:42.721 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-22T19:52:43.107 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-22T19:52:43.366 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-22T19:52:43.467 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-22T19:52:43.719 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-22T19:52:43.845 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-22T19:52:44.180 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-22T19:52:44.472 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-22T19:52:44.774 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-22T19:52:44.883 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-22T19:52:45.134 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-22T19:52:45.428 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-22T19:52:45.774 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-22T19:52:46.151 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-22T19:52:46.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-22T19:52:46.756 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-22T19:52:46.882 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:46.992 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:47.093 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-22T19:52:47.430 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:47.556 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:47.682 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-22T19:52:47.951 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:48.094 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:48.220 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:48.430 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-22T19:52:48.430 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-22T19:52:48.888 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:49.014 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:49.140 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:49.267 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-22T19:52:50.488 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:50.614 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:50.740 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:50.858 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:50.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:51.452 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-04-22T19:52:51.813 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-04-22T19:52:51.982 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-04-22T19:52:51.994 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-22T19:52:52.132 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-22T19:52:52.463 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-22T19:52:52.921 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:53.064 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:53.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-22T19:52:53.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-22T19:52:53.991 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:54.322 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-22T19:52:54.826 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:55.057 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-22T19:52:55.057 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-22T19:52:55.528 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:55.755 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-22T19:52:55.755 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-22T19:52:56.238 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:56.521 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-22T19:52:56.521 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-22T19:52:56.982 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:57.125 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:57.260 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:57.471 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-22T19:52:57.471 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-22T19:52:57.928 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:58.079 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:58.357 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.0.0-3152-g9ed8263e-1jammy) ... 2024-04-22T19:52:59.088 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-22T19:52:59.214 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-22T19:52:59.367 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-22T19:53:00.385 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-22T19:53:01.035 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-22T19:53:01.040 DEBUG:teuthology.parallel:result is None 2024-04-22T19:53:01.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:53:01.272 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-04-22T19:53:01.292 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:53:01.293 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:53:01.293 INFO:teuthology.task.install:The correct ceph version 19.0.0-3152-g9ed8263e-1jammy is installed. 2024-04-22T19:53:01.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:53:01.519 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-04-22T19:53:01.538 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:53:01.539 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3152-g9ed8263e-1jammy 2024-04-22T19:53:01.539 INFO:teuthology.task.install:The correct ceph version 19.0.0-3152-g9ed8263e-1jammy is installed. 2024-04-22T19:53:01.541 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-22T19:53:01.541 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:01.541 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T19:53:01.556 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:01.556 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T19:53:01.592 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-22T19:53:01.592 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:01.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T19:53:01.610 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T19:53:01.665 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:01.666 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T19:53:01.679 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T19:53:01.735 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-22T19:53:01.736 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:01.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T19:53:01.750 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T19:53:01.807 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:01.807 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T19:53:01.820 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T19:53:01.875 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-22T19:53:01.875 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:01.875 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T19:53:01.888 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T19:53:01.942 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:01.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T19:53:01.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T19:53:02.011 INFO:teuthology.run_tasks:Running task ceph... 2024-04-22T19:53:02.090 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-22T19:53:02.090 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-04-22T19:53:02.093 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-04-22T19:53:02.106 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-22T19:53:02.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T19:53:02.148 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T19:53:02.161 INFO:tasks.ceph:Creating extra log directories... 2024-04-22T19:53:02.161 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T19:53:02.200 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T19:53:02.225 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-22T19:53:02.225 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-22T19:53:02.225 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489', 'branch': 'wip-65551', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7668489', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-65551'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-65551', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 7738, 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-65551', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9ed8263edff7e87907bf24b054e5c7144c194dbe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe', 'targets': {'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZG3YWCy9d9mPtnYW76KKYvmukaQJMgjVM6txz5wu/LQzWvUZSkaO4QHGF7xSkpcF9CVo7mbEjPGTwXLnKft1o=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdqhCxIWped4KVmbudmcZObHEAM3rTHIx6OWwuZ2NmixZF7fC8IqPDo1wVU4swsvKF7OJDVyLftvb0ZxNfvb3o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-22_19:31:26', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-22T19:53:02.226 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T19:53:02.252 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T19:53:02.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T19:53:02.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T19:53:02.320 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:02.320 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T19:53:02.359 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T19:53:02.359 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-22 19:47:17.143708475 +0000 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-22 19:47:16.823711334 +0000 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-22 19:47:16.823711334 +0000 2024-04-22T19:53:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-22T19:53:02.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T19:53:02.461 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-22T19:53:02.461 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-22T19:53:02.461 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000384843 s, 1.3 MB/s 2024-04-22T19:53:02.462 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T19:53:02.512 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-22 19:47:17.711703402 +0000 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-22 19:47:17.387706296 +0000 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-22 19:47:17.387706296 +0000 2024-04-22T19:53:02.559 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-22T19:53:02.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T19:53:02.613 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-22T19:53:02.613 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-22T19:53:02.613 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000405656 s, 1.3 MB/s 2024-04-22T19:53:02.614 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T19:53:02.664 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-22 19:47:18.199699042 +0000 2024-04-22T19:53:02.711 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-22 19:47:17.943701330 +0000 2024-04-22T19:53:02.712 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-22 19:47:17.943701330 +0000 2024-04-22T19:53:02.712 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-22T19:53:02.712 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T19:53:02.765 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-22T19:53:02.766 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-22T19:53:02.766 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000412218 s, 1.2 MB/s 2024-04-22T19:53:02.767 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T19:53:02.816 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-22 19:47:18.471696613 +0000 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-22 19:47:18.467696649 +0000 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-22 19:47:18.467696649 +0000 2024-04-22T19:53:02.863 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-22T19:53:02.864 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T19:53:02.917 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-22T19:53:02.917 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-22T19:53:02.917 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000311382 s, 1.6 MB/s 2024-04-22T19:53:02.918 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T19:53:02.969 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:02.969 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:02.969 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T19:53:02.975 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T19:53:02.975 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-04-22T19:53:03.024 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T19:53:03.024 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-22T19:53:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-22 19:47:17.105769292 +0000 2024-04-22T19:53:03.025 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-22 19:47:16.829771757 +0000 2024-04-22T19:53:03.025 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-22 19:47:16.829771757 +0000 2024-04-22T19:53:03.025 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-22T19:53:03.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T19:53:03.078 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-22T19:53:03.078 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-22T19:53:03.078 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000461127 s, 1.1 MB/s 2024-04-22T19:53:03.079 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T19:53:03.129 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-22 19:47:17.581765041 +0000 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-22 19:47:17.337767220 +0000 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-22 19:47:17.337767220 +0000 2024-04-22T19:53:03.176 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-22T19:53:03.176 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T19:53:03.230 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-22T19:53:03.231 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-22T19:53:03.231 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000384103 s, 1.3 MB/s 2024-04-22T19:53:03.231 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T19:53:03.281 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-22 19:47:18.077760610 +0000 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-22 19:47:17.789763183 +0000 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-22 19:47:17.789763183 +0000 2024-04-22T19:53:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-22T19:53:03.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T19:53:03.383 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-22T19:53:03.383 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-22T19:53:03.383 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000417937 s, 1.2 MB/s 2024-04-22T19:53:03.385 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T19:53:03.433 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-22 19:47:18.581756108 +0000 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-22 19:47:18.305758573 +0000 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-22 19:47:18.305758573 +0000 2024-04-22T19:53:03.480 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-22T19:53:03.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T19:53:03.534 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-22T19:53:03.534 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-22T19:53:03.534 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000408001 s, 1.3 MB/s 2024-04-22T19:53:03.535 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T19:53:03.586 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:03.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T19:53:03.586 INFO:tasks.ceph:Generating config... 2024-04-22T19:53:03.587 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-22T19:53:03.587 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-22T19:53:03.588 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-22T19:53:03.588 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-22T19:53:03.588 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-22T19:53:03.589 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-22T19:53:03.589 INFO:tasks.ceph:Setting up mon.a... 2024-04-22T19:53:03.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-22T19:53:03.623 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.keyring 2024-04-22T19:53:03.637 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-22T19:53:03.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T19:53:03.766 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.111'), ('mon.c', '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]'), ('mon.b', '172.21.15.138')] 2024-04-22T19:53:03.766 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.138'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-22T19:53:03.767 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:03.767 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T19:53:03.815 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.111 --addv c '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]' --add b 172.21.15.138 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:03.903 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: generated fsid ac92bbc9-e567-4064-a7f4-2e610e35d3cc 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:setting min_mon_release = quincy 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 0 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:fsid ac92bbc9-e567-4064-a7f4-2e610e35d3cc 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:last_changed 2024-04-22T19:53:03.905729+0000 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-04-22T19:53:03.905729+0000 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:min_mon_release 17 (quincy) 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:election_strategy: 1 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-04-22T19:53:03.904 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-22T19:53:03.905 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T19:53:03.951 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac92bbc9-e567-4064-a7f4-2e610e35d3cc... 2024-04-22T19:53:03.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T19:53:03.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T19:53:04.024 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-04-22T19:53:04.025 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-04-22T19:53:04.026 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.027 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.138" 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = ac92bbc9-e567-4064-a7f4-2e610e35d3cc 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-04-22T19:53:04.028 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.029 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-04-22T19:53:04.030 INFO:teuthology.orchestra.run.smithi111.stdout: bdev async discard = True 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: bdev enable discard = True 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore allocator = bitmap 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 1/20 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 1/20 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 4/10 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T19:53:04.031 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: osd blocked scrub grace period = 3600 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: osd max markdown count = 1000 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: osd shutdown pgref assert = True 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-22T19:53:04.032 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-04-22T19:53:04.033 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T19:53:04.034 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:04.035 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout: rgw relaxed s3 bucket names = True 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-04-22T19:53:04.036 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-22T19:53:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T19:53:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-22T19:53:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.138" 2024-04-22T19:53:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = ac92bbc9-e567-4064-a7f4-2e610e35d3cc 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-22T19:53:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: osd blocked scrub grace period = 3600 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: osd max markdown count = 1000 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-04-22T19:53:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-22T19:53:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-22T19:53:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T19:53:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-22T19:53:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: rgw relaxed s3 bucket names = True 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-22T19:53:04.049 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-22T19:53:04.051 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-22T19:53:04.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-22T19:53:04.146 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-22T19:53:04.146 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:04.146 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-22T19:53:04.152 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:04.152 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-22T19:53:04.199 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:53:04.199 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:04.199 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T19:53:04.199 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T19:53:04.263 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:04.263 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:04.310 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:53:04.310 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:04.310 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T19:53:04.311 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T19:53:04.335 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:04.335 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:04.384 INFO:tasks.ceph:Setting up mon nodes... 2024-04-22T19:53:04.384 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-22T19:53:04.384 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T19:53:04.426 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T19:53:04.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T19:53:04.473 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T19:53:04.490 INFO:tasks.ceph:Setting up mds nodes... 2024-04-22T19:53:04.490 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-22T19:53:04.490 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-22T19:53:04.526 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-22T19:53:04.536 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-22T19:53:04.572 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-22T19:53:04.583 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-22T19:53:04.583 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T19:53:04.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-22T19:53:04.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:04.595 INFO:tasks.ceph:role: osd.0 2024-04-22T19:53:04.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:53:04.595 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:04.659 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:05.132 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-22T19:53:05.134 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-22T19:53:05.134 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-22T19:53:05.283 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-22T19:53:05.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:05.295 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:05.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-22T19:53:05.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:05.350 INFO:tasks.ceph:role: osd.1 2024-04-22T19:53:05.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:53:05.350 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T19:53:05.414 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:05.414 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:05.414 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:05.414 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:05.415 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:05.853 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-22T19:53:05.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-22T19:53:05.855 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-22T19:53:05.945 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-22T19:53:05.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:05.956 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:05.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-22T19:53:06.010 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:06.011 INFO:tasks.ceph:role: osd.2 2024-04-22T19:53:06.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:53:06.011 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T19:53:06.078 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:06.078 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:06.078 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:06.079 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:06.535 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-22T19:53:06.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-22T19:53:06.537 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-22T19:53:06.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-22T19:53:06.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:06.656 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:06.657 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-22T19:53:06.714 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:06.714 INFO:tasks.ceph:role: osd.3 2024-04-22T19:53:06.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T19:53:06.714 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T19:53:06.778 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:06.779 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:07.279 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-22T19:53:07.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-22T19:53:07.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-22T19:53:07.421 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-22T19:53:07.431 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:07.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:07.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:07.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.538+0000 7f986e86b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-22T19:53:07.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.542+0000 7f986e86b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-22T19:53:07.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.542+0000 7f986e86b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T19:53:07.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.542+0000 7f986e86b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T19:53:07.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.542+0000 7f986e86b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T19:53:07.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:07.546+0000 7f986e86b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-22T19:53:10.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-22T19:53:10.567 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:10.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-22T19:53:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-22T19:53:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T19:53:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T19:53:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T19:53:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:10.646+0000 7f48c47037c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-22T19:53:13.618 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-22T19:53:13.672 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:13.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.750+0000 7fcc1950e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-22T19:53:13.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.750+0000 7fcc1950e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-22T19:53:13.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.750+0000 7fcc1950e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T19:53:13.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.750+0000 7fcc1950e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T19:53:13.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.750+0000 7fcc1950e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T19:53:13.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:13.754+0000 7fcc1950e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-22T19:53:16.747 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-22T19:53:16.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:16.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-22T19:53:16.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-22T19:53:16.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T19:53:16.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T19:53:16.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T19:53:16.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-22T19:53:16.886+0000 7fc28b7ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-22T19:53:19.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-22T19:53:19.920 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-22T19:53:19.934 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:19.935 INFO:tasks.ceph:role: osd.4 2024-04-22T19:53:19.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:53:19.935 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T19:53:19.999 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:20.000 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:20.462 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-22T19:53:20.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-22T19:53:20.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-22T19:53:20.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-22T19:53:20.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:20.573 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:20.573 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-22T19:53:20.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:20.625 INFO:tasks.ceph:role: osd.5 2024-04-22T19:53:20.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:53:20.625 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T19:53:20.686 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:20.687 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:21.155 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-22T19:53:21.157 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-22T19:53:21.157 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-22T19:53:21.272 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-22T19:53:21.283 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:21.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:21.284 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-22T19:53:21.339 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:21.339 INFO:tasks.ceph:role: osd.6 2024-04-22T19:53:21.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:53:21.339 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T19:53:21.407 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:21.407 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:21.407 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:21.407 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:21.408 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:21.873 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-22T19:53:21.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-22T19:53:21.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-22T19:53:22.003 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-22T19:53:22.014 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:22.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:22.015 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-22T19:53:22.071 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T19:53:22.071 INFO:tasks.ceph:role: osd.7 2024-04-22T19:53:22.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T19:53:22.071 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T19:53:22.135 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T19:53:22.563 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-22T19:53:22.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-22T19:53:22.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-22T19:53:22.642 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-22T19:53:22.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:53:22.696 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-22T19:53:22.696 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:22.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-22T19:53:22.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-22T19:53:22.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T19:53:22.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T19:53:22.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T19:53:22.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:22.796+0000 7f8a2d70c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-22T19:53:25.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-22T19:53:25.793 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:25.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-22T19:53:25.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-22T19:53:25.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T19:53:25.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T19:53:25.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T19:53:25.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:25.872+0000 7fa1b73027c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-22T19:53:28.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-22T19:53:28.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:29.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-22T19:53:29.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-22T19:53:29.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T19:53:29.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T19:53:29.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T19:53:29.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:29.007+0000 7f7998db17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-22T19:53:31.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-22T19:53:32.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.127+0000 7f962e7857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-22T19:53:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.131+0000 7f962e7857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-22T19:53:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.131+0000 7f962e7857c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T19:53:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.131+0000 7f962e7857c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T19:53:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.131+0000 7f962e7857c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T19:53:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-22T19:53:32.131+0000 7f962e7857c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-22T19:53:35.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-22T19:53:35.159 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-22T19:53:35.160 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.160 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-22T19:53:35.174 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-22T19:53:35.230 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.230 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-22T19:53:35.285 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-22T19:53:35.337 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-22T19:53:35.390 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-22T19:53:35.404 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-22T19:53:35.459 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.459 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-22T19:53:35.518 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.518 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-22T19:53:35.570 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-22T19:53:35.627 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:35.627 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-22T19:53:35.633 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:35.633 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-22T19:53:35.675 INFO:tasks.ceph:Adding keys to all mons... 2024-04-22T19:53:35.675 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T19:53:35.677 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T19:53:35.721 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-04-22T19:53:35.721 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAgwCZmjueHGRAAnQhvR7aYSogaelRQGVW0sQ== 2024-04-22T19:53:35.721 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAjwCZmGupJIBAAcAwepGPjjKVmFG14OVxLnw== 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAmwCZm4CfHJhAAIsHoEdOfgYN/Og4IFqO/qA== 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQApwCZmlEEFLRAAiILNY7aTsrdqkJER2FgcHw== 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAswCZm1KEYNRAAwqm9UVpdixFRXYotuq5ErA== 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAgwCZm3jN1HBAAx+GlNl92n+4R3XrlviBHmg== 2024-04-22T19:53:35.722 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.4] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAywCZmffyyLxAAPp3kNHyLVACQAKET/llnSQ== 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.5] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA1wCZmPDxFNBAAls1E+PGxV995kr8p47EtaQ== 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.6] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA5wCZmfNfAABAA3bvUclLlYngs3NU8s/5xMw== 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.7] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA8wCZmUR8BCBAADGZgJHlOHKhWRCZWioWRmA== 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAgwCZm2pF7HxAANfZeDOc4R5ht1kH7MGVH6w== 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2024-04-22T19:53:35.723 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAgwCZmei1VIhAAUpCBLrGNyUTO+RYn7IlTXg== 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAgwCZmjueHGRAAnQhvR7aYSogaelRQGVW0sQ== 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAjwCZmGupJIBAAcAwepGPjjKVmFG14OVxLnw== 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAmwCZm4CfHJhAAIsHoEdOfgYN/Og4IFqO/qA== 2024-04-22T19:53:35.729 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQApwCZmlEEFLRAAiILNY7aTsrdqkJER2FgcHw== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAswCZm1KEYNRAAwqm9UVpdixFRXYotuq5ErA== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAgwCZm3jN1HBAAx+GlNl92n+4R3XrlviBHmg== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAywCZmffyyLxAAPp3kNHyLVACQAKET/llnSQ== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA1wCZmPDxFNBAAls1E+PGxV995kr8p47EtaQ== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA5wCZmfNfAABAA3bvUclLlYngs3NU8s/5xMw== 2024-04-22T19:53:35.730 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-04-22T19:53:35.731 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA8wCZmUR8BCBAADGZgJHlOHKhWRCZWioWRmA== 2024-04-22T19:53:35.731 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-04-22T19:53:35.731 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAgwCZm2pF7HxAANfZeDOc4R5ht1kH7MGVH6w== 2024-04-22T19:53:35.731 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-04-22T19:53:35.731 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAgwCZmei1VIhAAUpCBLrGNyUTO+RYn7IlTXg== 2024-04-22T19:53:35.732 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T19:53:35.768 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T19:53:35.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:35.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:35.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:35.909 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:35.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.164 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T19:53:36.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T19:53:36.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.328 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.331 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.408 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.488 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T19:53:36.571 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T19:53:36.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T19:53:36.660 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T19:53:36.662 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T19:53:36.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-22T19:53:36.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-22T19:53:36.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T19:53:36.852 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-22T19:53:36.863 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-22T19:53:36.916 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T19:53:37.007 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-22T19:53:37.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-22T19:53:37.031 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T19:53:37.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-22T19:53:37.136 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:37.138 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T19:53:37.185 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-22T19:53:37.186 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-22T19:53:37.186 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-22T19:53:37.188 INFO:tasks.ceph.mon.a:Started 2024-04-22T19:53:37.188 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-22T19:53:37.189 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-22T19:53:37.191 INFO:tasks.ceph.mon.c:Started 2024-04-22T19:53:37.191 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-22T19:53:37.191 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-22T19:53:37.228 INFO:tasks.ceph.mon.b:Started 2024-04-22T19:53:37.228 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-22T19:53:37.229 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-22T19:53:37.229 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-22T19:53:37.231 INFO:tasks.ceph.mgr.y:Started 2024-04-22T19:53:37.231 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-22T19:53:37.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-22T19:53:37.233 INFO:tasks.ceph.mgr.x:Started 2024-04-22T19:53:37.233 INFO:tasks.ceph:Setting crush tunables to default 2024-04-22T19:53:37.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd crush tunables default 2024-04-22T19:53:42.806 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:42.803+0000 7f7925ff1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T19:53:43.308 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:43.307+0000 7f7925ff1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T19:53:43.444 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2024-04-22T19:53:43.469 INFO:tasks.ceph:check_enable_crimson: False 2024-04-22T19:53:43.469 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-22T19:53:43.470 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:43.470 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-22T19:53:43.482 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:43.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-22T19:53:43.504 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:43.503+0000 7f7925ff1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T19:53:43.539 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:43.537+0000 7fe742f0d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T19:53:43.540 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:43.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-22T19:53:43.599 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:53:43.599 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-22T19:53:43.653 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:43.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-22T19:53:43.667 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:43.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-22T19:53:43.723 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:43.723 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-22T19:53:43.777 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-22T19:53:43.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-22T19:53:43.829 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 996ea3c2-f75d-41f0-9267-69befdc4ab4d 0 2024-04-22T19:53:44.015 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.013+0000 7fe742f0d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T19:53:44.058 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.055+0000 7f7925ff1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T19:53:44.080 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-04-22T19:53:44.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 277fd7fa-608c-48e4-800d-c26294428dd8 1 2024-04-22T19:53:44.114 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.111+0000 7f7925ff1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T19:53:44.169 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.167+0000 7f7925ff1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T19:53:44.208 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.205+0000 7fe742f0d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T19:53:44.251 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.251+0000 7f7925ff1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T19:53:44.303 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-22T19:53:44.307 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.307+0000 7f7925ff1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T19:53:44.320 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new bac442e5-3a55-4562-8665-70da37ab5ff7 2 2024-04-22T19:53:44.387 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.383+0000 7f7925ff1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T19:53:44.441 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.439+0000 7f7925ff1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T19:53:44.560 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-04-22T19:53:44.576 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 3195716c-c2fb-4f8d-916a-dc0525a8c456 3 2024-04-22T19:53:44.596 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.595+0000 7f7925ff1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T19:53:44.659 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:44.659+0000 7f7925ff1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T19:53:44.750 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.749+0000 7fe742f0d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T19:53:44.797 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-04-22T19:53:44.805 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.801+0000 7fe742f0d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T19:53:44.813 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new cbf466e6-386f-4838-ad24-52702ac92370 4 2024-04-22T19:53:44.857 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.853+0000 7fe742f0d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T19:53:44.933 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.929+0000 7fe742f0d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T19:53:44.985 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:44.981+0000 7fe742f0d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T19:53:45.034 INFO:teuthology.orchestra.run.smithi138.stdout:4 2024-04-22T19:53:45.062 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:45.057+0000 7fe742f0d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T19:53:45.064 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 5813db8d-fb71-4489-af1f-2e8223206f66 5 2024-04-22T19:53:45.114 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:45.109+0000 7fe742f0d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T19:53:45.246 INFO:teuthology.orchestra.run.smithi138.stdout:5 2024-04-22T19:53:45.262 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 4117bfb9-ad8e-4b51-a9e0-f858a7402a5b 6 2024-04-22T19:53:45.263 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:45.261+0000 7fe742f0d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T19:53:45.289 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-22T19:53:45.289 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-22T19:53:45.289 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-04-22T19:53:45.324 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:45.321+0000 7fe742f0d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T19:53:45.357 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:45.355+0000 7f7925ff1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T19:53:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:6 2024-04-22T19:53:45.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new a91542a5-1ccd-4fb1-95be-7d51aa24f193 7 2024-04-22T19:53:45.537 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:45.535+0000 7f7925ff1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T19:53:45.733 INFO:teuthology.orchestra.run.smithi138.stdout:7 2024-04-22T19:53:45.735 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:45.735+0000 7f7925ff1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T19:53:45.750 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-22T19:53:45.751 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-22T19:53:45.753 INFO:tasks.ceph.osd.0:Started 2024-04-22T19:53:45.753 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-22T19:53:45.753 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-22T19:53:45.755 INFO:tasks.ceph.osd.1:Started 2024-04-22T19:53:45.755 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-22T19:53:45.755 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-22T19:53:45.757 INFO:tasks.ceph.osd.2:Started 2024-04-22T19:53:45.757 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-22T19:53:45.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-22T19:53:45.759 INFO:tasks.ceph.osd.3:Started 2024-04-22T19:53:45.759 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-22T19:53:45.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-22T19:53:45.797 INFO:tasks.ceph.osd.4:Started 2024-04-22T19:53:45.797 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-22T19:53:45.797 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-22T19:53:45.799 INFO:tasks.ceph.osd.5:Started 2024-04-22T19:53:45.799 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-22T19:53:45.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-22T19:53:45.801 INFO:tasks.ceph.osd.6:Started 2024-04-22T19:53:45.801 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-22T19:53:45.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-22T19:53:45.803 INFO:tasks.ceph.osd.7:Started 2024-04-22T19:53:45.804 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:53:45.808 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:45.807+0000 7f7925ff1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T19:53:45.964 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:45.963+0000 7f7925ff1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T19:53:45.982 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:53:45.982 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":10,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:53:45.731500+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:53:45.999 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-22T19:53:45.999 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-22T19:53:46.008 INFO:tasks.ceph.mgr.y.smithi111.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-22T19:53:46.008 INFO:tasks.ceph.mgr.y.smithi111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-22T19:53:46.008 INFO:tasks.ceph.mgr.y.smithi111.stderr: from numpy import show_config as show_numpy_config 2024-04-22T19:53:46.061 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:46.057+0000 7fe742f0d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T19:53:46.202 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:46.197+0000 7fe742f0d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T19:53:46.345 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:46.341+0000 7fe742f0d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T19:53:46.371 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:53:46.369+0000 7fbd306057c0 -1 Falling back to public interface 2024-04-22T19:53:46.375 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:53:46.373+0000 7fcb5cf2f7c0 -1 Falling back to public interface 2024-04-22T19:53:46.375 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:53:46.373+0000 7f0b7c69e7c0 -1 Falling back to public interface 2024-04-22T19:53:46.391 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:53:46.389+0000 7f0fd4c607c0 -1 Falling back to public interface 2024-04-22T19:53:46.408 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:53:46.407+0000 7f1b1ef567c0 -1 Falling back to public interface 2024-04-22T19:53:46.409 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:46.405+0000 7fe742f0d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T19:53:46.411 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:53:46.411+0000 7ff2253207c0 -1 Falling back to public interface 2024-04-22T19:53:46.447 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:53:46.447+0000 7f4a834267c0 -1 Falling back to public interface 2024-04-22T19:53:46.451 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:53:46.451+0000 7fc58785a7c0 -1 Falling back to public interface 2024-04-22T19:53:46.543 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:46.541+0000 7fe742f0d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T19:53:46.603 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:46.603+0000 7f7925ff1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T19:53:46.678 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:46.675+0000 7f7925ff1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T19:53:46.804 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T19:53:46.860 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:46.859+0000 7f7925ff1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T19:53:46.934 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:46.931+0000 7f7925ff1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T19:53:46.985 INFO:teuthology.misc.health.smithi111.stdout: 2024-04-22T19:53:46.985 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":10,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:53:45.731500+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:53:47.000 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T19:53:47.169 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.165+0000 7fe742f0d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T19:53:47.222 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:47.219+0000 7f7925ff1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T19:53:47.243 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.241+0000 7fe742f0d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T19:53:47.284 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:47.283+0000 7f7925ff1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T19:53:47.431 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.429+0000 7fe742f0d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T19:53:47.504 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.501+0000 7fe742f0d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T19:53:47.791 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.789+0000 7fe742f0d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T19:53:47.852 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-22T19:53:47.849+0000 7fe742f0d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T19:53:48.332 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:48.331+0000 7f78cd439640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-22T19:53:48.332 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-22T19:53:48.331+0000 7f78cd439640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-22T19:53:49.740 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:53:49.737+0000 7f0fd4c607c0 -1 osd.0 0 log_to_monitors true 2024-04-22T19:53:49.829 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:53:49.827+0000 7fc58785a7c0 -1 osd.6 0 log_to_monitors true 2024-04-22T19:53:50.121 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:53:50.117+0000 7fcb5cf2f7c0 -1 osd.1 0 log_to_monitors true 2024-04-22T19:53:50.207 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:53:50.207+0000 7ff2253207c0 -1 osd.5 0 log_to_monitors true 2024-04-22T19:53:50.211 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:53:50.211+0000 7f1b1ef567c0 -1 osd.4 0 log_to_monitors true 2024-04-22T19:53:50.288 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:53:50.287+0000 7f4a834267c0 -1 osd.7 0 log_to_monitors true 2024-04-22T19:53:50.293 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:53:50.289+0000 7f0b7c69e7c0 -1 osd.3 0 log_to_monitors true 2024-04-22T19:53:50.312 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:53:50.309+0000 7fbd306057c0 -1 osd.2 0 log_to_monitors true 2024-04-22T19:53:53.649 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:53:53.645+0000 7fcb58ed8640 -1 osd.1 0 waiting for initial osdmap 2024-04-22T19:53:53.687 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:53:53.685+0000 7fcb50d0c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.727 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:53:53.725+0000 7fbd2c5ae640 -1 osd.2 0 waiting for initial osdmap 2024-04-22T19:53:53.729 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:53:53.725+0000 7f0b78647640 -1 osd.3 0 waiting for initial osdmap 2024-04-22T19:53:53.734 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:53:53.733+0000 7f0fd0c09640 -1 osd.0 0 waiting for initial osdmap 2024-04-22T19:53:53.739 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:53:53.739+0000 7f4a7fbe1640 -1 osd.7 0 waiting for initial osdmap 2024-04-22T19:53:53.746 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:53:53.747+0000 7fc584015640 -1 osd.6 0 waiting for initial osdmap 2024-04-22T19:53:53.748 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:53:53.747+0000 7f1b1aeff640 -1 osd.4 0 waiting for initial osdmap 2024-04-22T19:53:53.758 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:53:53.757+0000 7f0b7047b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.759 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:53:53.757+0000 7f0fc8a3d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.759 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:53:53.757+0000 7fbd243e2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.767 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:53:53.767+0000 7f4a77203640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.779 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:53:53.779+0000 7f1b12d33640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.779 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:53:53.779+0000 7fc57b637640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:53.785 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:53:53.783+0000 7ff221adb640 -1 osd.5 0 waiting for initial osdmap 2024-04-22T19:53:53.806 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T19:53:53.827 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:53:53.827+0000 7ff2190fd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T19:53:54.095 INFO:teuthology.misc.health.smithi111.stdout: 2024-04-22T19:53:54.095 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":12,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:53:51.623411+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:53:54.113 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T19:54:00.920 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T19:54:01.219 INFO:teuthology.misc.health.smithi111.stdout: 2024-04-22T19:54:01.219 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":16,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:53:57.665911+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:54:01.237 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-22T19:54:01.237 INFO:tasks.ceph:Creating RBD pool 2024-04-22T19:54:01.237 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-22T19:54:02.252 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'rbd' created 2024-04-22T19:54:02.276 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-22T19:54:03.263 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-22T19:54:03.292 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-22T19:54:03.293 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-22T19:54:03.293 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-22T19:54:03.293 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-22T19:54:03.293 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-22T19:54:03.651 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:03.668 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":590199177},{"type":"v1","addr":"172.21.15.138:6833","nonce":590199177}]},"active_addr":"172.21.15.138:6833/590199177","active_change":"2024-04-22T19:53:47.307184+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1154998101}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3620472375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1495617639}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3514361314}]}]} 2024-04-22T19:54:03.675 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-22T19:54:03.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-22T19:54:03.675 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:54:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:03.972 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:54:03.248737+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-22T19:54:01.541706+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:54:03.990 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-22T19:54:03.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:54:04.286 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:04.286 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:54:04.256898+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:53:45.731500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-22T19:54:01.541706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:54:04.304 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-22T19:54:04.305 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-22T19:54:04.305 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-22T19:54:04.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-22T19:54:04.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-22T19:54:04.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-22T19:54:04.307 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-22T19:54:04.307 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-22T19:54:04.558 INFO:teuthology.orchestra.run.smithi111.stdout:55834574854 2024-04-22T19:54:04.558 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T19:54:04.562 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:04.563 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T19:54:04.565 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:04.565 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T19:54:04.575 INFO:teuthology.orchestra.run.smithi111.stdout:55834574854 2024-04-22T19:54:04.576 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T19:54:04.579 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:04.579 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T19:54:04.581 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:04.582 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T19:54:04.585 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:04.585 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T19:54:04.586 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:04.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T19:54:05.089 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:05.091 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:05.107 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:05.107 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:05.108 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:05.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-04-22T19:54:05.109 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:05.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-04-22T19:54:05.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-22T19:54:05.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-22T19:54:05.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-22T19:54:05.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-04-22T19:54:05.144 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:05.146 INFO:teuthology.orchestra.run.smithi111.stdout:55834574851 2024-04-22T19:54:05.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-22T19:54:05.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-04-22T19:54:06.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T19:54:06.135 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T19:54:06.137 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T19:54:06.142 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T19:54:06.143 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T19:54:06.145 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T19:54:06.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T19:54:06.166 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T19:54:06.659 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:06.669 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:06.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-04-22T19:54:06.686 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.688 INFO:teuthology.orchestra.run.smithi111.stdout:55834574854 2024-04-22T19:54:06.688 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:06.693 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:06.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-22T19:54:06.700 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.705 INFO:teuthology.orchestra.run.smithi111.stdout:55834574852 2024-04-22T19:54:06.715 INFO:teuthology.orchestra.run.smithi111.stdout:55834574854 2024-04-22T19:54:06.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-04-22T19:54:06.720 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-22T19:54:06.721 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-04-22T19:54:06.727 INFO:teuthology.orchestra.run.smithi111.stdout:55834574853 2024-04-22T19:54:06.727 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-04-22T19:54:06.728 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-22T19:54:06.737 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-22T19:54:06.744 DEBUG:teuthology.parallel:result is None 2024-04-22T19:54:06.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T19:54:06.745 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:54:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:07.055 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:54:07.071 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-22T19:54:05.319378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218768,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755952,"statfs":{"total":773094113280,"available":772870094848,"internally_reserved":0,"allocated":2641920,"data_stored":1645012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001116"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.340244+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:54:04.340244+0000","last_peered":"2024-04-22T19:54:04.340244+0000","last_clean":"2024-04-22T19:54:04.340244+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:54:04.340244+0000","last_undegraded":"2024-04-22T19:54:04.340244+0000","last_fullsized":"2024-04-22T19:54:04.340244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.268881+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:54:04.268881+0000","last_peered":"2024-04-22T19:54:04.268881+0000","last_clean":"2024-04-22T19:54:04.268881+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:54:04.268881+0000","last_undegraded":"2024-04-22T19:54:04.268881+0000","last_fullsized":"2024-04-22T19:54:04.268881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.351179+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:54:04.351179+0000","last_peered":"2024-04-22T19:54:04.351179+0000","last_clean":"2024-04-22T19:54:04.351179+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:54:04.351179+0000","last_undegraded":"2024-04-22T19:54:04.351179+0000","last_fullsized":"2024-04-22T19:54:04.351179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.269025+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:54:04.269025+0000","last_peered":"2024-04-22T19:54:04.269025+0000","last_clean":"2024-04-22T19:54:04.269025+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:54:04.269025+0000","last_undegraded":"2024-04-22T19:54:04.269025+0000","last_fullsized":"2024-04-22T19:54:04.269025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350705+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:04.350705+0000","last_peered":"2024-04-22T19:54:04.350705+0000","last_clean":"2024-04-22T19:54:04.350705+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:54:04.350705+0000","last_undegraded":"2024-04-22T19:54:04.350705+0000","last_fullsized":"2024-04-22T19:54:04.350705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.347779+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:54:04.347779+0000","last_peered":"2024-04-22T19:54:04.347779+0000","last_clean":"2024-04-22T19:54:04.347779+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:54:04.347779+0000","last_undegraded":"2024-04-22T19:54:04.347779+0000","last_fullsized":"2024-04-22T19:54:04.347779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.351155+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:04.351155+0000","last_peered":"2024-04-22T19:54:04.351155+0000","last_clean":"2024-04-22T19:54:04.351155+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:54:04.351155+0000","last_undegraded":"2024-04-22T19:54:04.351155+0000","last_fullsized":"2024-04-22T19:54:04.351155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350775+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:54:04.350775+0000","last_peered":"2024-04-22T19:54:04.350775+0000","last_clean":"2024-04-22T19:54:04.350775+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:54:04.350775+0000","last_undegraded":"2024-04-22T19:54:04.350775+0000","last_fullsized":"2024-04-22T19:54:04.350775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350883+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:54:04.350883+0000","last_peered":"2024-04-22T19:54:04.350883+0000","last_clean":"2024-04-22T19:54:04.350883+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:54:04.350883+0000","last_undegraded":"2024-04-22T19:54:04.350883+0000","last_fullsized":"2024-04-22T19:54:04.350883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:54:07.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:54:07.348 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:07.348 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:54:07.364 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-22T19:54:07.319969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218848,"kb_used_data":2664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755872,"statfs":{"total":773094113280,"available":772870012928,"internally_reserved":0,"allocated":2727936,"data_stored":1685248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001707"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.340244+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:54:04.340244+0000","last_peered":"2024-04-22T19:54:04.340244+0000","last_clean":"2024-04-22T19:54:04.340244+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:54:04.340244+0000","last_undegraded":"2024-04-22T19:54:04.340244+0000","last_fullsized":"2024-04-22T19:54:04.340244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.268881+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:54:04.268881+0000","last_peered":"2024-04-22T19:54:04.268881+0000","last_clean":"2024-04-22T19:54:04.268881+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:54:04.268881+0000","last_undegraded":"2024-04-22T19:54:04.268881+0000","last_fullsized":"2024-04-22T19:54:04.268881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.351179+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:54:04.351179+0000","last_peered":"2024-04-22T19:54:04.351179+0000","last_clean":"2024-04-22T19:54:04.351179+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:54:04.351179+0000","last_undegraded":"2024-04-22T19:54:04.351179+0000","last_fullsized":"2024-04-22T19:54:04.351179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.269025+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:54:04.269025+0000","last_peered":"2024-04-22T19:54:04.269025+0000","last_clean":"2024-04-22T19:54:04.269025+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:54:04.269025+0000","last_undegraded":"2024-04-22T19:54:04.269025+0000","last_fullsized":"2024-04-22T19:54:04.269025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350705+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:04.350705+0000","last_peered":"2024-04-22T19:54:04.350705+0000","last_clean":"2024-04-22T19:54:04.350705+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:54:04.350705+0000","last_undegraded":"2024-04-22T19:54:04.350705+0000","last_fullsized":"2024-04-22T19:54:04.350705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.347779+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:54:04.347779+0000","last_peered":"2024-04-22T19:54:04.347779+0000","last_clean":"2024-04-22T19:54:04.347779+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:54:04.347779+0000","last_undegraded":"2024-04-22T19:54:04.347779+0000","last_fullsized":"2024-04-22T19:54:04.347779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.351155+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:04.351155+0000","last_peered":"2024-04-22T19:54:04.351155+0000","last_clean":"2024-04-22T19:54:04.351155+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:54:04.351155+0000","last_undegraded":"2024-04-22T19:54:04.351155+0000","last_fullsized":"2024-04-22T19:54:04.351155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350775+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:54:04.350775+0000","last_peered":"2024-04-22T19:54:04.350775+0000","last_clean":"2024-04-22T19:54:04.350775+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:54:04.350775+0000","last_undegraded":"2024-04-22T19:54:04.350775+0000","last_fullsized":"2024-04-22T19:54:04.350775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-22T19:54:04.350883+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:54:04.350883+0000","last_peered":"2024-04-22T19:54:04.350883+0000","last_clean":"2024-04-22T19:54:04.350883+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:54:04.350883+0000","last_undegraded":"2024-04-22T19:54:04.350883+0000","last_fullsized":"2024-04-22T19:54:04.350883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:54:07.365 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T19:54:07.365 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-22T19:54:07.365 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-22T19:54:07.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T19:54:07.664 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:07.665 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-22T19:54:07.682 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-22T19:54:07.683 INFO:teuthology.run_tasks:Running task rgw... 2024-04-22T19:54:07.699 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-22T19:54:07.699 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-22T19:54:07.699 INFO:tasks.rgw:Creating data pools 2024-04-22T19:54:07.699 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-22T19:54:07.699 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-22T19:54:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.data' created 2024-04-22T19:54:08.322 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-22T19:54:09.307 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-22T19:54:09.346 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-22T19:54:10.318 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.index' created 2024-04-22T19:54:10.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-22T19:54:11.338 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-22T19:54:11.384 DEBUG:tasks.rgw:Pools created 2024-04-22T19:54:11.384 INFO:tasks.rgw:Starting rgw... 2024-04-22T19:54:11.384 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-22T19:54:11.384 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-22T19:54:11.384 DEBUG:teuthology.orchestra.run.smithi111:> sudo echo -n http://smithi111.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-22T19:54:11.396 INFO:teuthology.orchestra.run.smithi111.stdout:http://smithi111.front.sepia.ceph.com:80 2024-04-22T19:54:11.396 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-22T19:54:11.447 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-22T19:54:11.447 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-22T19:54:11.491 INFO:tasks.rgw.client.0:Started 2024-04-22T19:54:11.491 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:11.491 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:11.511 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-22T19:54:11.511 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-04-22T19:54:11.511 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-22T19:54:11.511 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-22T19:54:11.511 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-22T19:54:12.513 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:12.525 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-22T19:54:12.525 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-04-22T19:54:12.525 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-22T19:54:12.525 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-22T19:54:12.526 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-22T19:54:14.527 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:14.539 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-22T19:54:14.539 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-22T19:54:14.539 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-04-22T19:54:14.539 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-22T19:54:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-22T19:54:18.540 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:18.551 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-22T19:54:18.552 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-04-22T19:54:18.552 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-22T19:54:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-22T19:54:18.552 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-22T19:54:20.510 INFO:tasks.rgw.client.0.smithi111.stdout:2024-04-22T19:54:20.509+0000 7f5eb79d2a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-22T19:54:26.553 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:80/ 2024-04-22T19:54:26.565 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-22T19:54:26.565 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-04-22T19:54:26.568 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53489 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-22T19:54:26.569 INFO:teuthology.orchestra.run.smithi111.stdout:anonymous 2024-04-22T19:54:26.569 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-22T19:54:26.580 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-22T19:54:26.580 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-65551'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-65551', 'sha1': '9ed8263edff7e87907bf24b054e5c7144c194dbe'}} 2024-04-22T19:54:26.580 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-22T19:54:26.581 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-22T19:54:26.946 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-22T19:54:26.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T19:54:26.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:54:27.294 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:27.301 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:54:27.314 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-22T19:54:25.327371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":430,"num_read_kb":287,"num_write":358,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":508,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220052,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754668,"statfs":{"total":773094113280,"available":772868780032,"internally_reserved":0,"allocated":3973120,"data_stored":2382518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":310,"num_read_kb":183,"num_write":189,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.979715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381763+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:54:20.381763+0000","last_peered":"2024-04-22T19:54:20.381763+0000","last_clean":"2024-04-22T19:54:20.381763+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:54:20.381763+0000","last_undegraded":"2024-04-22T19:54:20.381763+0000","last_fullsized":"2024-04-22T19:54:20.381763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.384994+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:54:20.384994+0000","last_peered":"2024-04-22T19:54:20.384994+0000","last_clean":"2024-04-22T19:54:20.384994+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:54:20.384994+0000","last_undegraded":"2024-04-22T19:54:20.384994+0000","last_fullsized":"2024-04-22T19:54:20.384994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377071+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:54:20.377071+0000","last_peered":"2024-04-22T19:54:20.377071+0000","last_clean":"2024-04-22T19:54:20.377071+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:54:20.377071+0000","last_undegraded":"2024-04-22T19:54:20.377071+0000","last_fullsized":"2024-04-22T19:54:20.377071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380660+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:54:20.380660+0000","last_peered":"2024-04-22T19:54:20.380660+0000","last_clean":"2024-04-22T19:54:20.380660+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:54:20.380660+0000","last_undegraded":"2024-04-22T19:54:20.380660+0000","last_fullsized":"2024-04-22T19:54:20.380660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363495+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:54:20.363495+0000","last_peered":"2024-04-22T19:54:20.363495+0000","last_clean":"2024-04-22T19:54:20.363495+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:54:20.363495+0000","last_undegraded":"2024-04-22T19:54:20.363495+0000","last_fullsized":"2024-04-22T19:54:20.363495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357001+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:54:20.357001+0000","last_peered":"2024-04-22T19:54:20.357001+0000","last_clean":"2024-04-22T19:54:20.357001+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:54:20.357001+0000","last_undegraded":"2024-04-22T19:54:20.357001+0000","last_fullsized":"2024-04-22T19:54:20.357001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386545+0000","last_change":"2024-04-22T19:54:09.335968+0000","last_active":"2024-04-22T19:54:20.386545+0000","last_peered":"2024-04-22T19:54:20.386545+0000","last_clean":"2024-04-22T19:54:20.386545+0000","last_became_active":"2024-04-22T19:54:09.335354+0000","last_became_peered":"2024-04-22T19:54:09.335354+0000","last_unstale":"2024-04-22T19:54:20.386545+0000","last_undegraded":"2024-04-22T19:54:20.386545+0000","last_fullsized":"2024-04-22T19:54:20.386545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360417+0000","last_change":"2024-04-22T19:54:11.352164+0000","last_active":"2024-04-22T19:54:20.360417+0000","last_peered":"2024-04-22T19:54:20.360417+0000","last_clean":"2024-04-22T19:54:20.360417+0000","last_became_active":"2024-04-22T19:54:11.351808+0000","last_became_peered":"2024-04-22T19:54:11.351808+0000","last_unstale":"2024-04-22T19:54:20.360417+0000","last_undegraded":"2024-04-22T19:54:20.360417+0000","last_fullsized":"2024-04-22T19:54:20.360417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382534+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:54:20.382534+0000","last_peered":"2024-04-22T19:54:20.382534+0000","last_clean":"2024-04-22T19:54:20.382534+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:54:20.382534+0000","last_undegraded":"2024-04-22T19:54:20.382534+0000","last_fullsized":"2024-04-22T19:54:20.382534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391657+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:54:20.391657+0000","last_peered":"2024-04-22T19:54:20.391657+0000","last_clean":"2024-04-22T19:54:20.391657+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:54:20.391657+0000","last_undegraded":"2024-04-22T19:54:20.391657+0000","last_fullsized":"2024-04-22T19:54:20.391657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386348+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:54:20.386348+0000","last_peered":"2024-04-22T19:54:20.386348+0000","last_clean":"2024-04-22T19:54:20.386348+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:54:20.386348+0000","last_undegraded":"2024-04-22T19:54:20.386348+0000","last_fullsized":"2024-04-22T19:54:20.386348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358154+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:54:20.358154+0000","last_peered":"2024-04-22T19:54:20.358154+0000","last_clean":"2024-04-22T19:54:20.358154+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:54:20.358154+0000","last_undegraded":"2024-04-22T19:54:20.358154+0000","last_fullsized":"2024-04-22T19:54:20.358154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380972+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:54:20.380972+0000","last_peered":"2024-04-22T19:54:20.380972+0000","last_clean":"2024-04-22T19:54:20.380972+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:54:20.380972+0000","last_undegraded":"2024-04-22T19:54:20.380972+0000","last_fullsized":"2024-04-22T19:54:20.380972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386098+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:54:20.386098+0000","last_peered":"2024-04-22T19:54:20.386098+0000","last_clean":"2024-04-22T19:54:20.386098+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:54:20.386098+0000","last_undegraded":"2024-04-22T19:54:20.386098+0000","last_fullsized":"2024-04-22T19:54:20.386098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362212+0000","last_change":"2024-04-22T19:54:09.342297+0000","last_active":"2024-04-22T19:54:20.362212+0000","last_peered":"2024-04-22T19:54:20.362212+0000","last_clean":"2024-04-22T19:54:20.362212+0000","last_became_active":"2024-04-22T19:54:09.341821+0000","last_became_peered":"2024-04-22T19:54:09.341821+0000","last_unstale":"2024-04-22T19:54:20.362212+0000","last_undegraded":"2024-04-22T19:54:20.362212+0000","last_fullsized":"2024-04-22T19:54:20.362212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407588+0000","last_change":"2024-04-22T19:54:11.366719+0000","last_active":"2024-04-22T19:54:20.407588+0000","last_peered":"2024-04-22T19:54:20.407588+0000","last_clean":"2024-04-22T19:54:20.407588+0000","last_became_active":"2024-04-22T19:54:11.366430+0000","last_became_peered":"2024-04-22T19:54:11.366430+0000","last_unstale":"2024-04-22T19:54:20.407588+0000","last_undegraded":"2024-04-22T19:54:20.407588+0000","last_fullsized":"2024-04-22T19:54:20.407588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:20.853206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356379+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:54:20.356379+0000","last_peered":"2024-04-22T19:54:20.356379+0000","last_clean":"2024-04-22T19:54:20.356379+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:54:20.356379+0000","last_undegraded":"2024-04-22T19:54:20.356379+0000","last_fullsized":"2024-04-22T19:54:20.356379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381997+0000","last_change":"2024-04-22T19:54:09.357494+0000","last_active":"2024-04-22T19:54:20.381997+0000","last_peered":"2024-04-22T19:54:20.381997+0000","last_clean":"2024-04-22T19:54:20.381997+0000","last_became_active":"2024-04-22T19:54:09.352801+0000","last_became_peered":"2024-04-22T19:54:09.352801+0000","last_unstale":"2024-04-22T19:54:20.381997+0000","last_undegraded":"2024-04-22T19:54:20.381997+0000","last_fullsized":"2024-04-22T19:54:20.381997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380743+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:54:20.380743+0000","last_peered":"2024-04-22T19:54:20.380743+0000","last_clean":"2024-04-22T19:54:20.380743+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:54:20.380743+0000","last_undegraded":"2024-04-22T19:54:20.380743+0000","last_fullsized":"2024-04-22T19:54:20.380743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392663+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:54:20.392663+0000","last_peered":"2024-04-22T19:54:20.392663+0000","last_clean":"2024-04-22T19:54:20.392663+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:54:20.392663+0000","last_undegraded":"2024-04-22T19:54:20.392663+0000","last_fullsized":"2024-04-22T19:54:20.392663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386518+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:54:20.386518+0000","last_peered":"2024-04-22T19:54:20.386518+0000","last_clean":"2024-04-22T19:54:20.386518+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:54:20.386518+0000","last_undegraded":"2024-04-22T19:54:20.386518+0000","last_fullsized":"2024-04-22T19:54:20.386518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392773+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:54:20.392773+0000","last_peered":"2024-04-22T19:54:20.392773+0000","last_clean":"2024-04-22T19:54:20.392773+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:54:20.392773+0000","last_undegraded":"2024-04-22T19:54:20.392773+0000","last_fullsized":"2024-04-22T19:54:20.392773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406681+0000","last_change":"2024-04-22T19:54:11.366667+0000","last_active":"2024-04-22T19:54:20.406681+0000","last_peered":"2024-04-22T19:54:20.406681+0000","last_clean":"2024-04-22T19:54:20.406681+0000","last_became_active":"2024-04-22T19:54:11.366362+0000","last_became_peered":"2024-04-22T19:54:11.366362+0000","last_unstale":"2024-04-22T19:54:20.406681+0000","last_undegraded":"2024-04-22T19:54:20.406681+0000","last_fullsized":"2024-04-22T19:54:20.406681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:55.770295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357637+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:54:20.357637+0000","last_peered":"2024-04-22T19:54:20.357637+0000","last_clean":"2024-04-22T19:54:20.357637+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:54:20.357637+0000","last_undegraded":"2024-04-22T19:54:20.357637+0000","last_fullsized":"2024-04-22T19:54:20.357637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407065+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:54:20.407065+0000","last_peered":"2024-04-22T19:54:20.407065+0000","last_clean":"2024-04-22T19:54:20.407065+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:54:20.407065+0000","last_undegraded":"2024-04-22T19:54:20.407065+0000","last_fullsized":"2024-04-22T19:54:20.407065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359396+0000","last_change":"2024-04-22T19:54:09.323744+0000","last_active":"2024-04-22T19:54:20.359396+0000","last_peered":"2024-04-22T19:54:20.359396+0000","last_clean":"2024-04-22T19:54:20.359396+0000","last_became_active":"2024-04-22T19:54:09.323397+0000","last_became_peered":"2024-04-22T19:54:09.323397+0000","last_unstale":"2024-04-22T19:54:20.359396+0000","last_undegraded":"2024-04-22T19:54:20.359396+0000","last_fullsized":"2024-04-22T19:54:20.359396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358240+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:54:20.358240+0000","last_peered":"2024-04-22T19:54:20.358240+0000","last_clean":"2024-04-22T19:54:20.358240+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:54:20.358240+0000","last_undegraded":"2024-04-22T19:54:20.358240+0000","last_fullsized":"2024-04-22T19:54:20.358240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361160+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:54:20.361160+0000","last_peered":"2024-04-22T19:54:20.361160+0000","last_clean":"2024-04-22T19:54:20.361160+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:54:20.361160+0000","last_undegraded":"2024-04-22T19:54:20.361160+0000","last_fullsized":"2024-04-22T19:54:20.361160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356068+0000","last_change":"2024-04-22T19:54:19.384172+0000","last_active":"2024-04-22T19:54:20.356068+0000","last_peered":"2024-04-22T19:54:20.356068+0000","last_clean":"2024-04-22T19:54:20.356068+0000","last_became_active":"2024-04-22T19:54:19.383327+0000","last_became_peered":"2024-04-22T19:54:19.383327+0000","last_unstale":"2024-04-22T19:54:20.356068+0000","last_undegraded":"2024-04-22T19:54:20.356068+0000","last_fullsized":"2024-04-22T19:54:20.356068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360489+0000","last_change":"2024-04-22T19:54:11.367608+0000","last_active":"2024-04-22T19:54:20.360489+0000","last_peered":"2024-04-22T19:54:20.360489+0000","last_clean":"2024-04-22T19:54:20.360489+0000","last_became_active":"2024-04-22T19:54:11.366912+0000","last_became_peered":"2024-04-22T19:54:11.366912+0000","last_unstale":"2024-04-22T19:54:20.360489+0000","last_undegraded":"2024-04-22T19:54:20.360489+0000","last_fullsized":"2024-04-22T19:54:20.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382763+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:54:20.382763+0000","last_peered":"2024-04-22T19:54:20.382763+0000","last_clean":"2024-04-22T19:54:20.382763+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:54:20.382763+0000","last_undegraded":"2024-04-22T19:54:20.382763+0000","last_fullsized":"2024-04-22T19:54:20.382763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387755+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:54:20.387755+0000","last_peered":"2024-04-22T19:54:20.387755+0000","last_clean":"2024-04-22T19:54:20.387755+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:54:20.387755+0000","last_undegraded":"2024-04-22T19:54:20.387755+0000","last_fullsized":"2024-04-22T19:54:20.387755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.539990+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:54:20.539990+0000","last_peered":"2024-04-22T19:54:20.539990+0000","last_clean":"2024-04-22T19:54:20.539990+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:54:20.539990+0000","last_undegraded":"2024-04-22T19:54:20.539990+0000","last_fullsized":"2024-04-22T19:54:20.539990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381366+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:54:20.381366+0000","last_peered":"2024-04-22T19:54:20.381366+0000","last_clean":"2024-04-22T19:54:20.381366+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:54:20.381366+0000","last_undegraded":"2024-04-22T19:54:20.381366+0000","last_fullsized":"2024-04-22T19:54:20.381366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385079+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:54:20.385079+0000","last_peered":"2024-04-22T19:54:20.385079+0000","last_clean":"2024-04-22T19:54:20.385079+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:54:20.385079+0000","last_undegraded":"2024-04-22T19:54:20.385079+0000","last_fullsized":"2024-04-22T19:54:20.385079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388594+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:54:20.388594+0000","last_peered":"2024-04-22T19:54:20.388594+0000","last_clean":"2024-04-22T19:54:20.388594+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:54:20.388594+0000","last_undegraded":"2024-04-22T19:54:20.388594+0000","last_fullsized":"2024-04-22T19:54:20.388594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361400+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:54:20.361400+0000","last_peered":"2024-04-22T19:54:20.361400+0000","last_clean":"2024-04-22T19:54:20.361400+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:54:20.361400+0000","last_undegraded":"2024-04-22T19:54:20.361400+0000","last_fullsized":"2024-04-22T19:54:20.361400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359972+0000","last_change":"2024-04-22T19:54:13.358928+0000","last_active":"2024-04-22T19:54:20.359972+0000","last_peered":"2024-04-22T19:54:20.359972+0000","last_clean":"2024-04-22T19:54:20.359972+0000","last_became_active":"2024-04-22T19:54:13.358215+0000","last_became_peered":"2024-04-22T19:54:13.358215+0000","last_unstale":"2024-04-22T19:54:20.359972+0000","last_undegraded":"2024-04-22T19:54:20.359972+0000","last_fullsized":"2024-04-22T19:54:20.359972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.496336+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:54:20.496336+0000","last_peered":"2024-04-22T19:54:20.496336+0000","last_clean":"2024-04-22T19:54:20.496336+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:54:20.496336+0000","last_undegraded":"2024-04-22T19:54:20.496336+0000","last_fullsized":"2024-04-22T19:54:20.496336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358182+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:54:20.358182+0000","last_peered":"2024-04-22T19:54:20.358182+0000","last_clean":"2024-04-22T19:54:20.358182+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:54:20.358182+0000","last_undegraded":"2024-04-22T19:54:20.358182+0000","last_fullsized":"2024-04-22T19:54:20.358182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360704+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:54:20.360704+0000","last_peered":"2024-04-22T19:54:20.360704+0000","last_clean":"2024-04-22T19:54:20.360704+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:54:20.360704+0000","last_undegraded":"2024-04-22T19:54:20.360704+0000","last_fullsized":"2024-04-22T19:54:20.360704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365825+0000","last_change":"2024-04-22T19:54:11.344326+0000","last_active":"2024-04-22T19:54:20.365825+0000","last_peered":"2024-04-22T19:54:20.365825+0000","last_clean":"2024-04-22T19:54:20.365825+0000","last_became_active":"2024-04-22T19:54:11.343967+0000","last_became_peered":"2024-04-22T19:54:11.343967+0000","last_unstale":"2024-04-22T19:54:20.365825+0000","last_undegraded":"2024-04-22T19:54:20.365825+0000","last_fullsized":"2024-04-22T19:54:20.365825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380980+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:54:20.380980+0000","last_peered":"2024-04-22T19:54:20.380980+0000","last_clean":"2024-04-22T19:54:20.380980+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:54:20.380980+0000","last_undegraded":"2024-04-22T19:54:20.380980+0000","last_fullsized":"2024-04-22T19:54:20.380980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.364208+0000","last_change":"2024-04-22T19:54:13.353567+0000","last_active":"2024-04-22T19:54:20.364208+0000","last_peered":"2024-04-22T19:54:20.364208+0000","last_clean":"2024-04-22T19:54:20.364208+0000","last_became_active":"2024-04-22T19:54:13.353104+0000","last_became_peered":"2024-04-22T19:54:13.353104+0000","last_unstale":"2024-04-22T19:54:20.364208+0000","last_undegraded":"2024-04-22T19:54:20.364208+0000","last_fullsized":"2024-04-22T19:54:20.364208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.500782+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:54:20.500782+0000","last_peered":"2024-04-22T19:54:20.500782+0000","last_clean":"2024-04-22T19:54:20.500782+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:54:20.500782+0000","last_undegraded":"2024-04-22T19:54:20.500782+0000","last_fullsized":"2024-04-22T19:54:20.500782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382114+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:54:20.382114+0000","last_peered":"2024-04-22T19:54:20.382114+0000","last_clean":"2024-04-22T19:54:20.382114+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:54:20.382114+0000","last_undegraded":"2024-04-22T19:54:20.382114+0000","last_fullsized":"2024-04-22T19:54:20.382114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356930+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:54:20.356930+0000","last_peered":"2024-04-22T19:54:20.356930+0000","last_clean":"2024-04-22T19:54:20.356930+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:54:20.356930+0000","last_undegraded":"2024-04-22T19:54:20.356930+0000","last_fullsized":"2024-04-22T19:54:20.356930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363513+0000","last_change":"2024-04-22T19:54:11.367430+0000","last_active":"2024-04-22T19:54:20.363513+0000","last_peered":"2024-04-22T19:54:20.363513+0000","last_clean":"2024-04-22T19:54:20.363513+0000","last_became_active":"2024-04-22T19:54:11.367019+0000","last_became_peered":"2024-04-22T19:54:11.367019+0000","last_unstale":"2024-04-22T19:54:20.363513+0000","last_undegraded":"2024-04-22T19:54:20.363513+0000","last_fullsized":"2024-04-22T19:54:20.363513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390981+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:54:20.390981+0000","last_peered":"2024-04-22T19:54:20.390981+0000","last_clean":"2024-04-22T19:54:20.390981+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:54:20.390981+0000","last_undegraded":"2024-04-22T19:54:20.390981+0000","last_fullsized":"2024-04-22T19:54:20.390981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385883+0000","last_change":"2024-04-22T19:54:13.373018+0000","last_active":"2024-04-22T19:54:20.385883+0000","last_peered":"2024-04-22T19:54:20.385883+0000","last_clean":"2024-04-22T19:54:20.385883+0000","last_became_active":"2024-04-22T19:54:13.372322+0000","last_became_peered":"2024-04-22T19:54:13.372322+0000","last_unstale":"2024-04-22T19:54:20.385883+0000","last_undegraded":"2024-04-22T19:54:20.385883+0000","last_fullsized":"2024-04-22T19:54:20.385883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.621489+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:54:20.621489+0000","last_peered":"2024-04-22T19:54:20.621489+0000","last_clean":"2024-04-22T19:54:20.621489+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:54:20.621489+0000","last_undegraded":"2024-04-22T19:54:20.621489+0000","last_fullsized":"2024-04-22T19:54:20.621489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358788+0000","last_change":"2024-04-22T19:54:17.386681+0000","last_active":"2024-04-22T19:54:20.358788+0000","last_peered":"2024-04-22T19:54:20.358788+0000","last_clean":"2024-04-22T19:54:20.358788+0000","last_became_active":"2024-04-22T19:54:17.385957+0000","last_became_peered":"2024-04-22T19:54:17.385957+0000","last_unstale":"2024-04-22T19:54:20.358788+0000","last_undegraded":"2024-04-22T19:54:20.358788+0000","last_fullsized":"2024-04-22T19:54:20.358788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:20.429084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387772+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:54:20.387772+0000","last_peered":"2024-04-22T19:54:20.387772+0000","last_clean":"2024-04-22T19:54:20.387772+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:54:20.387772+0000","last_undegraded":"2024-04-22T19:54:20.387772+0000","last_fullsized":"2024-04-22T19:54:20.387772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382059+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:54:20.382059+0000","last_peered":"2024-04-22T19:54:20.382059+0000","last_clean":"2024-04-22T19:54:20.382059+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:54:20.382059+0000","last_undegraded":"2024-04-22T19:54:20.382059+0000","last_fullsized":"2024-04-22T19:54:20.382059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380388+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:54:20.380388+0000","last_peered":"2024-04-22T19:54:20.380388+0000","last_clean":"2024-04-22T19:54:20.380388+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:54:20.380388+0000","last_undegraded":"2024-04-22T19:54:20.380388+0000","last_fullsized":"2024-04-22T19:54:20.380388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.560673+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:54:20.560673+0000","last_peered":"2024-04-22T19:54:20.560673+0000","last_clean":"2024-04-22T19:54:20.560673+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:54:20.560673+0000","last_undegraded":"2024-04-22T19:54:20.560673+0000","last_fullsized":"2024-04-22T19:54:20.560673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375608+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:54:20.375608+0000","last_peered":"2024-04-22T19:54:20.375608+0000","last_clean":"2024-04-22T19:54:20.375608+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:54:20.375608+0000","last_undegraded":"2024-04-22T19:54:20.375608+0000","last_fullsized":"2024-04-22T19:54:20.375608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386014+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:54:20.386014+0000","last_peered":"2024-04-22T19:54:20.386014+0000","last_clean":"2024-04-22T19:54:20.386014+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:54:20.386014+0000","last_undegraded":"2024-04-22T19:54:20.386014+0000","last_fullsized":"2024-04-22T19:54:20.386014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356536+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:54:20.356536+0000","last_peered":"2024-04-22T19:54:20.356536+0000","last_clean":"2024-04-22T19:54:20.356536+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:54:20.356536+0000","last_undegraded":"2024-04-22T19:54:20.356536+0000","last_fullsized":"2024-04-22T19:54:20.356536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382259+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:54:20.382259+0000","last_peered":"2024-04-22T19:54:20.382259+0000","last_clean":"2024-04-22T19:54:20.382259+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:54:20.382259+0000","last_undegraded":"2024-04-22T19:54:20.382259+0000","last_fullsized":"2024-04-22T19:54:20.382259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406132+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:54:20.406132+0000","last_peered":"2024-04-22T19:54:20.406132+0000","last_clean":"2024-04-22T19:54:20.406132+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:54:20.406132+0000","last_undegraded":"2024-04-22T19:54:20.406132+0000","last_fullsized":"2024-04-22T19:54:20.406132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.641722+0000","last_change":"2024-04-22T19:54:15.368608+0000","last_active":"2024-04-22T19:54:20.641722+0000","last_peered":"2024-04-22T19:54:20.641722+0000","last_clean":"2024-04-22T19:54:20.641722+0000","last_became_active":"2024-04-22T19:54:15.367821+0000","last_became_peered":"2024-04-22T19:54:15.367821+0000","last_unstale":"2024-04-22T19:54:20.641722+0000","last_undegraded":"2024-04-22T19:54:20.641722+0000","last_fullsized":"2024-04-22T19:54:20.641722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358799+0000","last_change":"2024-04-22T19:54:17.387097+0000","last_active":"2024-04-22T19:54:20.358799+0000","last_peered":"2024-04-22T19:54:20.358799+0000","last_clean":"2024-04-22T19:54:20.358799+0000","last_became_active":"2024-04-22T19:54:17.386193+0000","last_became_peered":"2024-04-22T19:54:17.386193+0000","last_unstale":"2024-04-22T19:54:20.358799+0000","last_undegraded":"2024-04-22T19:54:20.358799+0000","last_fullsized":"2024-04-22T19:54:20.358799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:39.707399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392080+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:54:20.392080+0000","last_peered":"2024-04-22T19:54:20.392080+0000","last_clean":"2024-04-22T19:54:20.392080+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:54:20.392080+0000","last_undegraded":"2024-04-22T19:54:20.392080+0000","last_fullsized":"2024-04-22T19:54:20.392080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392122+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:54:20.392122+0000","last_peered":"2024-04-22T19:54:20.392122+0000","last_clean":"2024-04-22T19:54:20.392122+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:54:20.392122+0000","last_undegraded":"2024-04-22T19:54:20.392122+0000","last_fullsized":"2024-04-22T19:54:20.392122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383147+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:54:20.383147+0000","last_peered":"2024-04-22T19:54:20.383147+0000","last_clean":"2024-04-22T19:54:20.383147+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:54:20.383147+0000","last_undegraded":"2024-04-22T19:54:20.383147+0000","last_fullsized":"2024-04-22T19:54:20.383147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406960+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:54:20.406960+0000","last_peered":"2024-04-22T19:54:20.406960+0000","last_clean":"2024-04-22T19:54:20.406960+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:54:20.406960+0000","last_undegraded":"2024-04-22T19:54:20.406960+0000","last_fullsized":"2024-04-22T19:54:20.406960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.574518+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:54:20.574518+0000","last_peered":"2024-04-22T19:54:20.574518+0000","last_clean":"2024-04-22T19:54:20.574518+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:54:20.574518+0000","last_undegraded":"2024-04-22T19:54:20.574518+0000","last_fullsized":"2024-04-22T19:54:20.574518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357826+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:54:20.357826+0000","last_peered":"2024-04-22T19:54:20.357826+0000","last_clean":"2024-04-22T19:54:20.357826+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:54:20.357826+0000","last_undegraded":"2024-04-22T19:54:20.357826+0000","last_fullsized":"2024-04-22T19:54:20.357826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365077+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:54:20.365077+0000","last_peered":"2024-04-22T19:54:20.365077+0000","last_clean":"2024-04-22T19:54:20.365077+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:54:20.365077+0000","last_undegraded":"2024-04-22T19:54:20.365077+0000","last_fullsized":"2024-04-22T19:54:20.365077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362648+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:54:20.362648+0000","last_peered":"2024-04-22T19:54:20.362648+0000","last_clean":"2024-04-22T19:54:20.362648+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:54:20.362648+0000","last_undegraded":"2024-04-22T19:54:20.362648+0000","last_fullsized":"2024-04-22T19:54:20.362648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387196+0000","last_change":"2024-04-22T19:54:09.334166+0000","last_active":"2024-04-22T19:54:20.387196+0000","last_peered":"2024-04-22T19:54:20.387196+0000","last_clean":"2024-04-22T19:54:20.387196+0000","last_became_active":"2024-04-22T19:54:09.333460+0000","last_became_peered":"2024-04-22T19:54:09.333460+0000","last_unstale":"2024-04-22T19:54:20.387196+0000","last_undegraded":"2024-04-22T19:54:20.387196+0000","last_fullsized":"2024-04-22T19:54:20.387196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406411+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:54:20.406411+0000","last_peered":"2024-04-22T19:54:20.406411+0000","last_clean":"2024-04-22T19:54:20.406411+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:54:20.406411+0000","last_undegraded":"2024-04-22T19:54:20.406411+0000","last_fullsized":"2024-04-22T19:54:20.406411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.612790+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:54:20.612790+0000","last_peered":"2024-04-22T19:54:20.612790+0000","last_clean":"2024-04-22T19:54:20.612790+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:54:20.612790+0000","last_undegraded":"2024-04-22T19:54:20.612790+0000","last_fullsized":"2024-04-22T19:54:20.612790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.405990+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:54:20.405990+0000","last_peered":"2024-04-22T19:54:20.405990+0000","last_clean":"2024-04-22T19:54:20.405990+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:54:20.405990+0000","last_undegraded":"2024-04-22T19:54:20.405990+0000","last_fullsized":"2024-04-22T19:54:20.405990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377062+0000","last_change":"2024-04-22T19:54:19.378028+0000","last_active":"2024-04-22T19:54:20.377062+0000","last_peered":"2024-04-22T19:54:20.377062+0000","last_clean":"2024-04-22T19:54:20.377062+0000","last_became_active":"2024-04-22T19:54:19.377273+0000","last_became_peered":"2024-04-22T19:54:19.377273+0000","last_unstale":"2024-04-22T19:54:20.377062+0000","last_undegraded":"2024-04-22T19:54:20.377062+0000","last_fullsized":"2024-04-22T19:54:20.377062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:00.036846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358393+0000","last_change":"2024-04-22T19:54:11.349479+0000","last_active":"2024-04-22T19:54:20.358393+0000","last_peered":"2024-04-22T19:54:20.358393+0000","last_clean":"2024-04-22T19:54:20.358393+0000","last_became_active":"2024-04-22T19:54:11.347357+0000","last_became_peered":"2024-04-22T19:54:11.347357+0000","last_unstale":"2024-04-22T19:54:20.358393+0000","last_undegraded":"2024-04-22T19:54:20.358393+0000","last_fullsized":"2024-04-22T19:54:20.358393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358774+0000","last_change":"2024-04-22T19:54:09.326454+0000","last_active":"2024-04-22T19:54:20.358774+0000","last_peered":"2024-04-22T19:54:20.358774+0000","last_clean":"2024-04-22T19:54:20.358774+0000","last_became_active":"2024-04-22T19:54:09.326120+0000","last_became_peered":"2024-04-22T19:54:09.326120+0000","last_unstale":"2024-04-22T19:54:20.358774+0000","last_undegraded":"2024-04-22T19:54:20.358774+0000","last_fullsized":"2024-04-22T19:54:20.358774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407115+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:54:20.407115+0000","last_peered":"2024-04-22T19:54:20.407115+0000","last_clean":"2024-04-22T19:54:20.407115+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:54:20.407115+0000","last_undegraded":"2024-04-22T19:54:20.407115+0000","last_fullsized":"2024-04-22T19:54:20.407115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.503095+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:54:20.503095+0000","last_peered":"2024-04-22T19:54:20.503095+0000","last_clean":"2024-04-22T19:54:20.503095+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:54:20.503095+0000","last_undegraded":"2024-04-22T19:54:20.503095+0000","last_fullsized":"2024-04-22T19:54:20.503095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365600+0000","last_change":"2024-04-22T19:54:17.393342+0000","last_active":"2024-04-22T19:54:20.365600+0000","last_peered":"2024-04-22T19:54:20.365600+0000","last_clean":"2024-04-22T19:54:20.365600+0000","last_became_active":"2024-04-22T19:54:17.392114+0000","last_became_peered":"2024-04-22T19:54:17.392114+0000","last_unstale":"2024-04-22T19:54:20.365600+0000","last_undegraded":"2024-04-22T19:54:20.365600+0000","last_fullsized":"2024-04-22T19:54:20.365600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358507+0000","last_change":"2024-04-22T19:54:19.387476+0000","last_active":"2024-04-22T19:54:20.358507+0000","last_peered":"2024-04-22T19:54:20.358507+0000","last_clean":"2024-04-22T19:54:20.358507+0000","last_became_active":"2024-04-22T19:54:19.386778+0000","last_became_peered":"2024-04-22T19:54:19.386778+0000","last_unstale":"2024-04-22T19:54:20.358507+0000","last_undegraded":"2024-04-22T19:54:20.358507+0000","last_fullsized":"2024-04-22T19:54:20.358507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:46.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358409+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:54:20.358409+0000","last_peered":"2024-04-22T19:54:20.358409+0000","last_clean":"2024-04-22T19:54:20.358409+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:54:20.358409+0000","last_undegraded":"2024-04-22T19:54:20.358409+0000","last_fullsized":"2024-04-22T19:54:20.358409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392365+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:54:20.392365+0000","last_peered":"2024-04-22T19:54:20.392365+0000","last_clean":"2024-04-22T19:54:20.392365+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:54:20.392365+0000","last_undegraded":"2024-04-22T19:54:20.392365+0000","last_fullsized":"2024-04-22T19:54:20.392365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375937+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:54:20.375937+0000","last_peered":"2024-04-22T19:54:20.375937+0000","last_clean":"2024-04-22T19:54:20.375937+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:54:20.375937+0000","last_undegraded":"2024-04-22T19:54:20.375937+0000","last_fullsized":"2024-04-22T19:54:20.375937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.622548+0000","last_change":"2024-04-22T19:54:15.358926+0000","last_active":"2024-04-22T19:54:20.622548+0000","last_peered":"2024-04-22T19:54:20.622548+0000","last_clean":"2024-04-22T19:54:20.622548+0000","last_became_active":"2024-04-22T19:54:15.358167+0000","last_became_peered":"2024-04-22T19:54:15.358167+0000","last_unstale":"2024-04-22T19:54:20.622548+0000","last_undegraded":"2024-04-22T19:54:20.622548+0000","last_fullsized":"2024-04-22T19:54:20.622548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:07.130557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407648+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:54:20.407648+0000","last_peered":"2024-04-22T19:54:20.407648+0000","last_clean":"2024-04-22T19:54:20.407648+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:54:20.407648+0000","last_undegraded":"2024-04-22T19:54:20.407648+0000","last_fullsized":"2024-04-22T19:54:20.407648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375407+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:54:20.375407+0000","last_peered":"2024-04-22T19:54:20.375407+0000","last_clean":"2024-04-22T19:54:20.375407+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:54:20.375407+0000","last_undegraded":"2024-04-22T19:54:20.375407+0000","last_fullsized":"2024-04-22T19:54:20.375407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358623+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:54:20.358623+0000","last_peered":"2024-04-22T19:54:20.358623+0000","last_clean":"2024-04-22T19:54:20.358623+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:54:20.358623+0000","last_undegraded":"2024-04-22T19:54:20.358623+0000","last_fullsized":"2024-04-22T19:54:20.358623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357210+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:54:20.357210+0000","last_peered":"2024-04-22T19:54:20.357210+0000","last_clean":"2024-04-22T19:54:20.357210+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:54:20.357210+0000","last_undegraded":"2024-04-22T19:54:20.357210+0000","last_fullsized":"2024-04-22T19:54:20.357210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386391+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:54:20.386391+0000","last_peered":"2024-04-22T19:54:20.386391+0000","last_clean":"2024-04-22T19:54:20.386391+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:54:20.386391+0000","last_undegraded":"2024-04-22T19:54:20.386391+0000","last_fullsized":"2024-04-22T19:54:20.386391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.540173+0000","last_change":"2024-04-22T19:54:15.374924+0000","last_active":"2024-04-22T19:54:20.540173+0000","last_peered":"2024-04-22T19:54:20.540173+0000","last_clean":"2024-04-22T19:54:20.540173+0000","last_became_active":"2024-04-22T19:54:15.374027+0000","last_became_peered":"2024-04-22T19:54:15.374027+0000","last_unstale":"2024-04-22T19:54:20.540173+0000","last_undegraded":"2024-04-22T19:54:20.540173+0000","last_fullsized":"2024-04-22T19:54:20.540173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:16.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392143+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:54:20.392143+0000","last_peered":"2024-04-22T19:54:20.392143+0000","last_clean":"2024-04-22T19:54:20.392143+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:54:20.392143+0000","last_undegraded":"2024-04-22T19:54:20.392143+0000","last_fullsized":"2024-04-22T19:54:20.392143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357266+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:54:20.357266+0000","last_peered":"2024-04-22T19:54:20.357266+0000","last_clean":"2024-04-22T19:54:20.357266+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:54:20.357266+0000","last_undegraded":"2024-04-22T19:54:20.357266+0000","last_fullsized":"2024-04-22T19:54:20.357266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377217+0000","last_change":"2024-04-22T19:54:11.381492+0000","last_active":"2024-04-22T19:54:20.377217+0000","last_peered":"2024-04-22T19:54:20.377217+0000","last_clean":"2024-04-22T19:54:20.377217+0000","last_became_active":"2024-04-22T19:54:11.381006+0000","last_became_peered":"2024-04-22T19:54:11.381006+0000","last_unstale":"2024-04-22T19:54:20.377217+0000","last_undegraded":"2024-04-22T19:54:20.377217+0000","last_fullsized":"2024-04-22T19:54:20.377217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362690+0000","last_change":"2024-04-22T19:54:09.324349+0000","last_active":"2024-04-22T19:54:20.362690+0000","last_peered":"2024-04-22T19:54:20.362690+0000","last_clean":"2024-04-22T19:54:20.362690+0000","last_became_active":"2024-04-22T19:54:09.324055+0000","last_became_peered":"2024-04-22T19:54:09.324055+0000","last_unstale":"2024-04-22T19:54:20.362690+0000","last_undegraded":"2024-04-22T19:54:20.362690+0000","last_fullsized":"2024-04-22T19:54:20.362690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358358+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:54:20.358358+0000","last_peered":"2024-04-22T19:54:20.358358+0000","last_clean":"2024-04-22T19:54:20.358358+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:54:20.358358+0000","last_undegraded":"2024-04-22T19:54:20.358358+0000","last_fullsized":"2024-04-22T19:54:20.358358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.582113+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:54:20.582113+0000","last_peered":"2024-04-22T19:54:20.582113+0000","last_clean":"2024-04-22T19:54:20.582113+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:54:20.582113+0000","last_undegraded":"2024-04-22T19:54:20.582113+0000","last_fullsized":"2024-04-22T19:54:20.582113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391491+0000","last_change":"2024-04-22T19:54:17.394078+0000","last_active":"2024-04-22T19:54:20.391491+0000","last_peered":"2024-04-22T19:54:20.391491+0000","last_clean":"2024-04-22T19:54:20.391491+0000","last_became_active":"2024-04-22T19:54:17.393405+0000","last_became_peered":"2024-04-22T19:54:17.393405+0000","last_unstale":"2024-04-22T19:54:20.391491+0000","last_undegraded":"2024-04-22T19:54:20.391491+0000","last_fullsized":"2024-04-22T19:54:20.391491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:18.989391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375364+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:54:20.375364+0000","last_peered":"2024-04-22T19:54:20.375364+0000","last_clean":"2024-04-22T19:54:20.375364+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:54:20.375364+0000","last_undegraded":"2024-04-22T19:54:20.375364+0000","last_fullsized":"2024-04-22T19:54:20.375364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392467+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:54:20.392467+0000","last_peered":"2024-04-22T19:54:20.392467+0000","last_clean":"2024-04-22T19:54:20.392467+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:54:20.392467+0000","last_undegraded":"2024-04-22T19:54:20.392467+0000","last_fullsized":"2024-04-22T19:54:20.392467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380878+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:54:20.380878+0000","last_peered":"2024-04-22T19:54:20.380878+0000","last_clean":"2024-04-22T19:54:20.380878+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:54:20.380878+0000","last_undegraded":"2024-04-22T19:54:20.380878+0000","last_fullsized":"2024-04-22T19:54:20.380878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386524+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:54:20.386524+0000","last_peered":"2024-04-22T19:54:20.386524+0000","last_clean":"2024-04-22T19:54:20.386524+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:54:20.386524+0000","last_undegraded":"2024-04-22T19:54:20.386524+0000","last_fullsized":"2024-04-22T19:54:20.386524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359381+0000","last_change":"2024-04-22T19:54:09.342243+0000","last_active":"2024-04-22T19:54:20.359381+0000","last_peered":"2024-04-22T19:54:20.359381+0000","last_clean":"2024-04-22T19:54:20.359381+0000","last_became_active":"2024-04-22T19:54:09.341757+0000","last_became_peered":"2024-04-22T19:54:09.341757+0000","last_unstale":"2024-04-22T19:54:20.359381+0000","last_undegraded":"2024-04-22T19:54:20.359381+0000","last_fullsized":"2024-04-22T19:54:20.359381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381792+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:54:20.381792+0000","last_peered":"2024-04-22T19:54:20.381792+0000","last_clean":"2024-04-22T19:54:20.381792+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:54:20.381792+0000","last_undegraded":"2024-04-22T19:54:20.381792+0000","last_fullsized":"2024-04-22T19:54:20.381792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.615252+0000","last_change":"2024-04-22T19:54:15.374361+0000","last_active":"2024-04-22T19:54:20.615252+0000","last_peered":"2024-04-22T19:54:20.615252+0000","last_clean":"2024-04-22T19:54:20.615252+0000","last_became_active":"2024-04-22T19:54:15.373665+0000","last_became_peered":"2024-04-22T19:54:15.373665+0000","last_unstale":"2024-04-22T19:54:20.615252+0000","last_undegraded":"2024-04-22T19:54:20.615252+0000","last_fullsized":"2024-04-22T19:54:20.615252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365189+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:54:20.365189+0000","last_peered":"2024-04-22T19:54:20.365189+0000","last_clean":"2024-04-22T19:54:20.365189+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:54:20.365189+0000","last_undegraded":"2024-04-22T19:54:20.365189+0000","last_fullsized":"2024-04-22T19:54:20.365189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391315+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:54:20.391315+0000","last_peered":"2024-04-22T19:54:20.391315+0000","last_clean":"2024-04-22T19:54:20.391315+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:54:20.391315+0000","last_undegraded":"2024-04-22T19:54:20.391315+0000","last_fullsized":"2024-04-22T19:54:20.391315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365519+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:54:20.365519+0000","last_peered":"2024-04-22T19:54:20.365519+0000","last_clean":"2024-04-22T19:54:20.365519+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:54:20.365519+0000","last_undegraded":"2024-04-22T19:54:20.365519+0000","last_fullsized":"2024-04-22T19:54:20.365519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380549+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:20.380549+0000","last_peered":"2024-04-22T19:54:20.380549+0000","last_clean":"2024-04-22T19:54:20.380549+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:54:20.380549+0000","last_undegraded":"2024-04-22T19:54:20.380549+0000","last_fullsized":"2024-04-22T19:54:20.380549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358334+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:54:20.358334+0000","last_peered":"2024-04-22T19:54:20.358334+0000","last_clean":"2024-04-22T19:54:20.358334+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:54:20.358334+0000","last_undegraded":"2024-04-22T19:54:20.358334+0000","last_fullsized":"2024-04-22T19:54:20.358334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387314+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:54:20.387314+0000","last_peered":"2024-04-22T19:54:20.387314+0000","last_clean":"2024-04-22T19:54:20.387314+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:54:20.387314+0000","last_undegraded":"2024-04-22T19:54:20.387314+0000","last_fullsized":"2024-04-22T19:54:20.387314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'11","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.562701+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:54:20.562701+0000","last_peered":"2024-04-22T19:54:20.562701+0000","last_clean":"2024-04-22T19:54:20.562701+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:54:20.562701+0000","last_undegraded":"2024-04-22T19:54:20.562701+0000","last_fullsized":"2024-04-22T19:54:20.562701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382375+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:54:20.382375+0000","last_peered":"2024-04-22T19:54:20.382375+0000","last_clean":"2024-04-22T19:54:20.382375+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:54:20.382375+0000","last_undegraded":"2024-04-22T19:54:20.382375+0000","last_fullsized":"2024-04-22T19:54:20.382375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375142+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:54:20.375142+0000","last_peered":"2024-04-22T19:54:20.375142+0000","last_clean":"2024-04-22T19:54:20.375142+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:54:20.375142+0000","last_undegraded":"2024-04-22T19:54:20.375142+0000","last_fullsized":"2024-04-22T19:54:20.375142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377443+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:54:20.377443+0000","last_peered":"2024-04-22T19:54:20.377443+0000","last_clean":"2024-04-22T19:54:20.377443+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:54:20.377443+0000","last_undegraded":"2024-04-22T19:54:20.377443+0000","last_fullsized":"2024-04-22T19:54:20.377443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406440+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:54:20.406440+0000","last_peered":"2024-04-22T19:54:20.406440+0000","last_clean":"2024-04-22T19:54:20.406440+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:54:20.406440+0000","last_undegraded":"2024-04-22T19:54:20.406440+0000","last_fullsized":"2024-04-22T19:54:20.406440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.374875+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:54:20.374875+0000","last_peered":"2024-04-22T19:54:20.374875+0000","last_clean":"2024-04-22T19:54:20.374875+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:54:20.374875+0000","last_undegraded":"2024-04-22T19:54:20.374875+0000","last_fullsized":"2024-04-22T19:54:20.374875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407797+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:54:20.407797+0000","last_peered":"2024-04-22T19:54:20.407797+0000","last_clean":"2024-04-22T19:54:20.407797+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:54:20.407797+0000","last_undegraded":"2024-04-22T19:54:20.407797+0000","last_fullsized":"2024-04-22T19:54:20.407797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.574794+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:54:20.574794+0000","last_peered":"2024-04-22T19:54:20.574794+0000","last_clean":"2024-04-22T19:54:20.574794+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:54:20.574794+0000","last_undegraded":"2024-04-22T19:54:20.574794+0000","last_fullsized":"2024-04-22T19:54:20.574794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362830+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:54:20.362830+0000","last_peered":"2024-04-22T19:54:20.362830+0000","last_clean":"2024-04-22T19:54:20.362830+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:54:20.362830+0000","last_undegraded":"2024-04-22T19:54:20.362830+0000","last_fullsized":"2024-04-22T19:54:20.362830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360291+0000","last_change":"2024-04-22T19:54:19.383707+0000","last_active":"2024-04-22T19:54:20.360291+0000","last_peered":"2024-04-22T19:54:20.360291+0000","last_clean":"2024-04-22T19:54:20.360291+0000","last_became_active":"2024-04-22T19:54:19.383071+0000","last_became_peered":"2024-04-22T19:54:19.383071+0000","last_unstale":"2024-04-22T19:54:20.360291+0000","last_undegraded":"2024-04-22T19:54:20.360291+0000","last_fullsized":"2024-04-22T19:54:20.360291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:25:04.464367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376173+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:54:20.376173+0000","last_peered":"2024-04-22T19:54:20.376173+0000","last_clean":"2024-04-22T19:54:20.376173+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:54:20.376173+0000","last_undegraded":"2024-04-22T19:54:20.376173+0000","last_fullsized":"2024-04-22T19:54:20.376173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386842+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:20.386842+0000","last_peered":"2024-04-22T19:54:20.386842+0000","last_clean":"2024-04-22T19:54:20.386842+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:54:20.386842+0000","last_undegraded":"2024-04-22T19:54:20.386842+0000","last_fullsized":"2024-04-22T19:54:20.386842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357301+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:54:20.357301+0000","last_peered":"2024-04-22T19:54:20.357301+0000","last_clean":"2024-04-22T19:54:20.357301+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:54:20.357301+0000","last_undegraded":"2024-04-22T19:54:20.357301+0000","last_fullsized":"2024-04-22T19:54:20.357301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363242+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:54:20.363242+0000","last_peered":"2024-04-22T19:54:20.363242+0000","last_clean":"2024-04-22T19:54:20.363242+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:54:20.363242+0000","last_undegraded":"2024-04-22T19:54:20.363242+0000","last_fullsized":"2024-04-22T19:54:20.363242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.557474+0000","last_change":"2024-04-22T19:54:15.366419+0000","last_active":"2024-04-22T19:54:20.557474+0000","last_peered":"2024-04-22T19:54:20.557474+0000","last_clean":"2024-04-22T19:54:20.557474+0000","last_became_active":"2024-04-22T19:54:15.365688+0000","last_became_peered":"2024-04-22T19:54:15.365688+0000","last_unstale":"2024-04-22T19:54:20.557474+0000","last_undegraded":"2024-04-22T19:54:20.557474+0000","last_fullsized":"2024-04-22T19:54:20.557474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392832+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:54:20.392832+0000","last_peered":"2024-04-22T19:54:20.392832+0000","last_clean":"2024-04-22T19:54:20.392832+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:54:20.392832+0000","last_undegraded":"2024-04-22T19:54:20.392832+0000","last_fullsized":"2024-04-22T19:54:20.392832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.384854+0000","last_change":"2024-04-22T19:54:19.386206+0000","last_active":"2024-04-22T19:54:20.384854+0000","last_peered":"2024-04-22T19:54:20.384854+0000","last_clean":"2024-04-22T19:54:20.384854+0000","last_became_active":"2024-04-22T19:54:19.383699+0000","last_became_peered":"2024-04-22T19:54:19.383699+0000","last_unstale":"2024-04-22T19:54:20.384854+0000","last_undegraded":"2024-04-22T19:54:20.384854+0000","last_fullsized":"2024-04-22T19:54:20.384854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.713155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375571+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:54:20.375571+0000","last_peered":"2024-04-22T19:54:20.375571+0000","last_clean":"2024-04-22T19:54:20.375571+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:54:20.375571+0000","last_undegraded":"2024-04-22T19:54:20.375571+0000","last_fullsized":"2024-04-22T19:54:20.375571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388949+0000","last_change":"2024-04-22T19:54:09.337813+0000","last_active":"2024-04-22T19:54:20.388949+0000","last_peered":"2024-04-22T19:54:20.388949+0000","last_clean":"2024-04-22T19:54:20.388949+0000","last_became_active":"2024-04-22T19:54:09.336677+0000","last_became_peered":"2024-04-22T19:54:09.336677+0000","last_unstale":"2024-04-22T19:54:20.388949+0000","last_undegraded":"2024-04-22T19:54:20.388949+0000","last_fullsized":"2024-04-22T19:54:20.388949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:51.697234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376555+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:54:20.376555+0000","last_peered":"2024-04-22T19:54:20.376555+0000","last_clean":"2024-04-22T19:54:20.376555+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:54:20.376555+0000","last_undegraded":"2024-04-22T19:54:20.376555+0000","last_fullsized":"2024-04-22T19:54:20.376555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362058+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:54:20.362058+0000","last_peered":"2024-04-22T19:54:20.362058+0000","last_clean":"2024-04-22T19:54:20.362058+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:54:20.362058+0000","last_undegraded":"2024-04-22T19:54:20.362058+0000","last_fullsized":"2024-04-22T19:54:20.362058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.618821+0000","last_change":"2024-04-22T19:54:15.373085+0000","last_active":"2024-04-22T19:54:20.618821+0000","last_peered":"2024-04-22T19:54:20.618821+0000","last_clean":"2024-04-22T19:54:20.618821+0000","last_became_active":"2024-04-22T19:54:15.372367+0000","last_became_peered":"2024-04-22T19:54:15.372367+0000","last_unstale":"2024-04-22T19:54:20.618821+0000","last_undegraded":"2024-04-22T19:54:20.618821+0000","last_fullsized":"2024-04-22T19:54:20.618821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356261+0000","last_change":"2024-04-22T19:54:17.388656+0000","last_active":"2024-04-22T19:54:20.356261+0000","last_peered":"2024-04-22T19:54:20.356261+0000","last_clean":"2024-04-22T19:54:20.356261+0000","last_became_active":"2024-04-22T19:54:17.387837+0000","last_became_peered":"2024-04-22T19:54:17.387837+0000","last_unstale":"2024-04-22T19:54:20.356261+0000","last_undegraded":"2024-04-22T19:54:20.356261+0000","last_fullsized":"2024-04-22T19:54:20.356261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362752+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:54:20.362752+0000","last_peered":"2024-04-22T19:54:20.362752+0000","last_clean":"2024-04-22T19:54:20.362752+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:54:20.362752+0000","last_undegraded":"2024-04-22T19:54:20.362752+0000","last_fullsized":"2024-04-22T19:54:20.362752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362602+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:54:20.362602+0000","last_peered":"2024-04-22T19:54:20.362602+0000","last_clean":"2024-04-22T19:54:20.362602+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:54:20.362602+0000","last_undegraded":"2024-04-22T19:54:20.362602+0000","last_fullsized":"2024-04-22T19:54:20.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376304+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:54:20.376304+0000","last_peered":"2024-04-22T19:54:20.376304+0000","last_clean":"2024-04-22T19:54:20.376304+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:54:20.376304+0000","last_undegraded":"2024-04-22T19:54:20.376304+0000","last_fullsized":"2024-04-22T19:54:20.376304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383431+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:54:20.383431+0000","last_peered":"2024-04-22T19:54:20.383431+0000","last_clean":"2024-04-22T19:54:20.383431+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:54:20.383431+0000","last_undegraded":"2024-04-22T19:54:20.383431+0000","last_fullsized":"2024-04-22T19:54:20.383431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391655+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:54:20.391655+0000","last_peered":"2024-04-22T19:54:20.391655+0000","last_clean":"2024-04-22T19:54:20.391655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:54:20.391655+0000","last_undegraded":"2024-04-22T19:54:20.391655+0000","last_fullsized":"2024-04-22T19:54:20.391655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.568243+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:54:20.568243+0000","last_peered":"2024-04-22T19:54:20.568243+0000","last_clean":"2024-04-22T19:54:20.568243+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:54:20.568243+0000","last_undegraded":"2024-04-22T19:54:20.568243+0000","last_fullsized":"2024-04-22T19:54:20.568243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385246+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:54:20.385246+0000","last_peered":"2024-04-22T19:54:20.385246+0000","last_clean":"2024-04-22T19:54:20.385246+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:54:20.385246+0000","last_undegraded":"2024-04-22T19:54:20.385246+0000","last_fullsized":"2024-04-22T19:54:20.385246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.364069+0000","last_change":"2024-04-22T19:54:19.959246+0000","last_active":"2024-04-22T19:54:20.364069+0000","last_peered":"2024-04-22T19:54:20.364069+0000","last_clean":"2024-04-22T19:54:20.364069+0000","last_became_active":"2024-04-22T19:54:19.958416+0000","last_became_peered":"2024-04-22T19:54:19.958416+0000","last_unstale":"2024-04-22T19:54:20.364069+0000","last_undegraded":"2024-04-22T19:54:20.364069+0000","last_fullsized":"2024-04-22T19:54:20.364069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:36.008379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360004+0000","last_change":"2024-04-22T19:54:11.361967+0000","last_active":"2024-04-22T19:54:20.360004+0000","last_peered":"2024-04-22T19:54:20.360004+0000","last_clean":"2024-04-22T19:54:20.360004+0000","last_became_active":"2024-04-22T19:54:11.361431+0000","last_became_peered":"2024-04-22T19:54:11.361431+0000","last_unstale":"2024-04-22T19:54:20.360004+0000","last_undegraded":"2024-04-22T19:54:20.360004+0000","last_fullsized":"2024-04-22T19:54:20.360004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363179+0000","last_change":"2024-04-22T19:54:09.338528+0000","last_active":"2024-04-22T19:54:20.363179+0000","last_peered":"2024-04-22T19:54:20.363179+0000","last_clean":"2024-04-22T19:54:20.363179+0000","last_became_active":"2024-04-22T19:54:09.338299+0000","last_became_peered":"2024-04-22T19:54:09.338299+0000","last_unstale":"2024-04-22T19:54:20.363179+0000","last_undegraded":"2024-04-22T19:54:20.363179+0000","last_fullsized":"2024-04-22T19:54:20.363179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377085+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:54:20.377085+0000","last_peered":"2024-04-22T19:54:20.377085+0000","last_clean":"2024-04-22T19:54:20.377085+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:54:20.377085+0000","last_undegraded":"2024-04-22T19:54:20.377085+0000","last_fullsized":"2024-04-22T19:54:20.377085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356404+0000","last_change":"2024-04-22T19:54:13.347158+0000","last_active":"2024-04-22T19:54:20.356404+0000","last_peered":"2024-04-22T19:54:20.356404+0000","last_clean":"2024-04-22T19:54:20.356404+0000","last_became_active":"2024-04-22T19:54:13.346353+0000","last_became_peered":"2024-04-22T19:54:13.346353+0000","last_unstale":"2024-04-22T19:54:20.356404+0000","last_undegraded":"2024-04-22T19:54:20.356404+0000","last_fullsized":"2024-04-22T19:54:20.356404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.627542+0000","last_change":"2024-04-22T19:54:15.361224+0000","last_active":"2024-04-22T19:54:20.627542+0000","last_peered":"2024-04-22T19:54:20.627542+0000","last_clean":"2024-04-22T19:54:20.627542+0000","last_became_active":"2024-04-22T19:54:15.359915+0000","last_became_peered":"2024-04-22T19:54:15.359915+0000","last_unstale":"2024-04-22T19:54:20.627542+0000","last_undegraded":"2024-04-22T19:54:20.627542+0000","last_fullsized":"2024-04-22T19:54:20.627542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361835+0000","last_change":"2024-04-22T19:54:17.386494+0000","last_active":"2024-04-22T19:54:20.361835+0000","last_peered":"2024-04-22T19:54:20.361835+0000","last_clean":"2024-04-22T19:54:20.361835+0000","last_became_active":"2024-04-22T19:54:17.385851+0000","last_became_peered":"2024-04-22T19:54:17.385851+0000","last_unstale":"2024-04-22T19:54:20.361835+0000","last_undegraded":"2024-04-22T19:54:20.361835+0000","last_fullsized":"2024-04-22T19:54:20.361835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:09.967672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363234+0000","last_change":"2024-04-22T19:54:19.376787+0000","last_active":"2024-04-22T19:54:20.363234+0000","last_peered":"2024-04-22T19:54:20.363234+0000","last_clean":"2024-04-22T19:54:20.363234+0000","last_became_active":"2024-04-22T19:54:19.375982+0000","last_became_peered":"2024-04-22T19:54:19.375982+0000","last_unstale":"2024-04-22T19:54:20.363234+0000","last_undegraded":"2024-04-22T19:54:20.363234+0000","last_fullsized":"2024-04-22T19:54:20.363234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:56:39.975385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356652+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:54:20.356652+0000","last_peered":"2024-04-22T19:54:20.356652+0000","last_clean":"2024-04-22T19:54:20.356652+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:54:20.356652+0000","last_undegraded":"2024-04-22T19:54:20.356652+0000","last_fullsized":"2024-04-22T19:54:20.356652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365928+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:54:20.365928+0000","last_peered":"2024-04-22T19:54:20.365928+0000","last_clean":"2024-04-22T19:54:20.365928+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:54:20.365928+0000","last_undegraded":"2024-04-22T19:54:20.365928+0000","last_fullsized":"2024-04-22T19:54:20.365928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.393232+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:54:20.393232+0000","last_peered":"2024-04-22T19:54:20.393232+0000","last_clean":"2024-04-22T19:54:20.393232+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:54:20.393232+0000","last_undegraded":"2024-04-22T19:54:20.393232+0000","last_fullsized":"2024-04-22T19:54:20.393232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359612+0000","last_change":"2024-04-22T19:54:13.351579+0000","last_active":"2024-04-22T19:54:20.359612+0000","last_peered":"2024-04-22T19:54:20.359612+0000","last_clean":"2024-04-22T19:54:20.359612+0000","last_became_active":"2024-04-22T19:54:13.350953+0000","last_became_peered":"2024-04-22T19:54:13.350953+0000","last_unstale":"2024-04-22T19:54:20.359612+0000","last_undegraded":"2024-04-22T19:54:20.359612+0000","last_fullsized":"2024-04-22T19:54:20.359612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:33.938710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.577239+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:54:20.577239+0000","last_peered":"2024-04-22T19:54:20.577239+0000","last_clean":"2024-04-22T19:54:20.577239+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:54:20.577239+0000","last_undegraded":"2024-04-22T19:54:20.577239+0000","last_fullsized":"2024-04-22T19:54:20.577239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358852+0000","last_change":"2024-04-22T19:54:17.374439+0000","last_active":"2024-04-22T19:54:20.358852+0000","last_peered":"2024-04-22T19:54:20.358852+0000","last_clean":"2024-04-22T19:54:20.358852+0000","last_became_active":"2024-04-22T19:54:17.373658+0000","last_became_peered":"2024-04-22T19:54:17.373658+0000","last_unstale":"2024-04-22T19:54:20.358852+0000","last_undegraded":"2024-04-22T19:54:20.358852+0000","last_fullsized":"2024-04-22T19:54:20.358852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:33.579486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387386+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:54:20.387386+0000","last_peered":"2024-04-22T19:54:20.387386+0000","last_clean":"2024-04-22T19:54:20.387386+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:54:20.387386+0000","last_undegraded":"2024-04-22T19:54:20.387386+0000","last_fullsized":"2024-04-22T19:54:20.387386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365418+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:54:20.365418+0000","last_peered":"2024-04-22T19:54:20.365418+0000","last_clean":"2024-04-22T19:54:20.365418+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:54:20.365418+0000","last_undegraded":"2024-04-22T19:54:20.365418+0000","last_fullsized":"2024-04-22T19:54:20.365418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356957+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:54:20.356957+0000","last_peered":"2024-04-22T19:54:20.356957+0000","last_clean":"2024-04-22T19:54:20.356957+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:54:20.356957+0000","last_undegraded":"2024-04-22T19:54:20.356957+0000","last_fullsized":"2024-04-22T19:54:20.356957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357636+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:54:20.357636+0000","last_peered":"2024-04-22T19:54:20.357636+0000","last_clean":"2024-04-22T19:54:20.357636+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:54:20.357636+0000","last_undegraded":"2024-04-22T19:54:20.357636+0000","last_fullsized":"2024-04-22T19:54:20.357636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375883+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:54:20.375883+0000","last_peered":"2024-04-22T19:54:20.375883+0000","last_clean":"2024-04-22T19:54:20.375883+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:54:20.375883+0000","last_undegraded":"2024-04-22T19:54:20.375883+0000","last_fullsized":"2024-04-22T19:54:20.375883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.566840+0000","last_change":"2024-04-22T19:54:15.364296+0000","last_active":"2024-04-22T19:54:20.566840+0000","last_peered":"2024-04-22T19:54:20.566840+0000","last_clean":"2024-04-22T19:54:20.566840+0000","last_became_active":"2024-04-22T19:54:15.363550+0000","last_became_peered":"2024-04-22T19:54:15.363550+0000","last_unstale":"2024-04-22T19:54:20.566840+0000","last_undegraded":"2024-04-22T19:54:20.566840+0000","last_fullsized":"2024-04-22T19:54:20.566840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358668+0000","last_change":"2024-04-22T19:54:17.387336+0000","last_active":"2024-04-22T19:54:20.358668+0000","last_peered":"2024-04-22T19:54:20.358668+0000","last_clean":"2024-04-22T19:54:20.358668+0000","last_became_active":"2024-04-22T19:54:17.386601+0000","last_became_peered":"2024-04-22T19:54:17.386601+0000","last_unstale":"2024-04-22T19:54:20.358668+0000","last_undegraded":"2024-04-22T19:54:20.358668+0000","last_fullsized":"2024-04-22T19:54:20.358668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:50.780788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359983+0000","last_change":"2024-04-22T19:54:19.389080+0000","last_active":"2024-04-22T19:54:20.359983+0000","last_peered":"2024-04-22T19:54:20.359983+0000","last_clean":"2024-04-22T19:54:20.359983+0000","last_became_active":"2024-04-22T19:54:19.388263+0000","last_became_peered":"2024-04-22T19:54:19.388263+0000","last_unstale":"2024-04-22T19:54:20.359983+0000","last_undegraded":"2024-04-22T19:54:20.359983+0000","last_fullsized":"2024-04-22T19:54:20.359983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:13:06.973763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375599+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:54:20.375599+0000","last_peered":"2024-04-22T19:54:20.375599+0000","last_clean":"2024-04-22T19:54:20.375599+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:54:20.375599+0000","last_undegraded":"2024-04-22T19:54:20.375599+0000","last_fullsized":"2024-04-22T19:54:20.375599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383083+0000","last_change":"2024-04-22T19:54:09.358724+0000","last_active":"2024-04-22T19:54:20.383083+0000","last_peered":"2024-04-22T19:54:20.383083+0000","last_clean":"2024-04-22T19:54:20.383083+0000","last_became_active":"2024-04-22T19:54:09.357161+0000","last_became_peered":"2024-04-22T19:54:09.357161+0000","last_unstale":"2024-04-22T19:54:20.383083+0000","last_undegraded":"2024-04-22T19:54:20.383083+0000","last_fullsized":"2024-04-22T19:54:20.383083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359668+0000","last_change":"2024-04-22T19:54:13.346921+0000","last_active":"2024-04-22T19:54:20.359668+0000","last_peered":"2024-04-22T19:54:20.359668+0000","last_clean":"2024-04-22T19:54:20.359668+0000","last_became_active":"2024-04-22T19:54:13.346460+0000","last_became_peered":"2024-04-22T19:54:13.346460+0000","last_unstale":"2024-04-22T19:54:20.359668+0000","last_undegraded":"2024-04-22T19:54:20.359668+0000","last_fullsized":"2024-04-22T19:54:20.359668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.587145+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:54:20.587145+0000","last_peered":"2024-04-22T19:54:20.587145+0000","last_clean":"2024-04-22T19:54:20.587145+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:54:20.587145+0000","last_undegraded":"2024-04-22T19:54:20.587145+0000","last_fullsized":"2024-04-22T19:54:20.587145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380611+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:54:20.380611+0000","last_peered":"2024-04-22T19:54:20.380611+0000","last_clean":"2024-04-22T19:54:20.380611+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:54:20.380611+0000","last_undegraded":"2024-04-22T19:54:20.380611+0000","last_fullsized":"2024-04-22T19:54:20.380611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363115+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:54:20.363115+0000","last_peered":"2024-04-22T19:54:20.363115+0000","last_clean":"2024-04-22T19:54:20.363115+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:54:20.363115+0000","last_undegraded":"2024-04-22T19:54:20.363115+0000","last_fullsized":"2024-04-22T19:54:20.363115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359406+0000","last_change":"2024-04-22T19:54:11.367199+0000","last_active":"2024-04-22T19:54:20.359406+0000","last_peered":"2024-04-22T19:54:20.359406+0000","last_clean":"2024-04-22T19:54:20.359406+0000","last_became_active":"2024-04-22T19:54:11.366927+0000","last_became_peered":"2024-04-22T19:54:11.366927+0000","last_unstale":"2024-04-22T19:54:20.359406+0000","last_undegraded":"2024-04-22T19:54:20.359406+0000","last_fullsized":"2024-04-22T19:54:20.359406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386841+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:54:20.386841+0000","last_peered":"2024-04-22T19:54:20.386841+0000","last_clean":"2024-04-22T19:54:20.386841+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:54:20.386841+0000","last_undegraded":"2024-04-22T19:54:20.386841+0000","last_fullsized":"2024-04-22T19:54:20.386841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.379892+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:54:20.379892+0000","last_peered":"2024-04-22T19:54:20.379892+0000","last_clean":"2024-04-22T19:54:20.379892+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:54:20.379892+0000","last_undegraded":"2024-04-22T19:54:20.379892+0000","last_fullsized":"2024-04-22T19:54:20.379892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.602888+0000","last_change":"2024-04-22T19:54:15.366428+0000","last_active":"2024-04-22T19:54:20.602888+0000","last_peered":"2024-04-22T19:54:20.602888+0000","last_clean":"2024-04-22T19:54:20.602888+0000","last_became_active":"2024-04-22T19:54:15.363037+0000","last_became_peered":"2024-04-22T19:54:15.363037+0000","last_unstale":"2024-04-22T19:54:20.602888+0000","last_undegraded":"2024-04-22T19:54:20.602888+0000","last_fullsized":"2024-04-22T19:54:20.602888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:57.305820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391508+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:54:20.391508+0000","last_peered":"2024-04-22T19:54:20.391508+0000","last_clean":"2024-04-22T19:54:20.391508+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:54:20.391508+0000","last_undegraded":"2024-04-22T19:54:20.391508+0000","last_fullsized":"2024-04-22T19:54:20.391508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385727+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:54:20.385727+0000","last_peered":"2024-04-22T19:54:20.385727+0000","last_clean":"2024-04-22T19:54:20.385727+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:54:20.385727+0000","last_undegraded":"2024-04-22T19:54:20.385727+0000","last_fullsized":"2024-04-22T19:54:20.385727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361936+0000","last_change":"2024-04-22T19:54:11.365937+0000","last_active":"2024-04-22T19:54:20.361936+0000","last_peered":"2024-04-22T19:54:20.361936+0000","last_clean":"2024-04-22T19:54:20.361936+0000","last_became_active":"2024-04-22T19:54:11.365569+0000","last_became_peered":"2024-04-22T19:54:11.365569+0000","last_unstale":"2024-04-22T19:54:20.361936+0000","last_undegraded":"2024-04-22T19:54:20.361936+0000","last_fullsized":"2024-04-22T19:54:20.361936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365857+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:54:20.365857+0000","last_peered":"2024-04-22T19:54:20.365857+0000","last_clean":"2024-04-22T19:54:20.365857+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:54:20.365857+0000","last_undegraded":"2024-04-22T19:54:20.365857+0000","last_fullsized":"2024-04-22T19:54:20.365857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391448+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:54:20.391448+0000","last_peered":"2024-04-22T19:54:20.391448+0000","last_clean":"2024-04-22T19:54:20.391448+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:54:20.391448+0000","last_undegraded":"2024-04-22T19:54:20.391448+0000","last_fullsized":"2024-04-22T19:54:20.391448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380555+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:54:20.380555+0000","last_peered":"2024-04-22T19:54:20.380555+0000","last_clean":"2024-04-22T19:54:20.380555+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:54:20.380555+0000","last_undegraded":"2024-04-22T19:54:20.380555+0000","last_fullsized":"2024-04-22T19:54:20.380555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360275+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:54:20.360275+0000","last_peered":"2024-04-22T19:54:20.360275+0000","last_clean":"2024-04-22T19:54:20.360275+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:54:20.360275+0000","last_undegraded":"2024-04-22T19:54:20.360275+0000","last_fullsized":"2024-04-22T19:54:20.360275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.393090+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:54:20.393090+0000","last_peered":"2024-04-22T19:54:20.393090+0000","last_clean":"2024-04-22T19:54:20.393090+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:54:20.393090+0000","last_undegraded":"2024-04-22T19:54:20.393090+0000","last_fullsized":"2024-04-22T19:54:20.393090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362452+0000","last_change":"2024-04-22T19:54:09.326439+0000","last_active":"2024-04-22T19:54:20.362452+0000","last_peered":"2024-04-22T19:54:20.362452+0000","last_clean":"2024-04-22T19:54:20.362452+0000","last_became_active":"2024-04-22T19:54:09.326162+0000","last_became_peered":"2024-04-22T19:54:09.326162+0000","last_unstale":"2024-04-22T19:54:20.362452+0000","last_undegraded":"2024-04-22T19:54:20.362452+0000","last_fullsized":"2024-04-22T19:54:20.362452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365221+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:54:20.365221+0000","last_peered":"2024-04-22T19:54:20.365221+0000","last_clean":"2024-04-22T19:54:20.365221+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:54:20.365221+0000","last_undegraded":"2024-04-22T19:54:20.365221+0000","last_fullsized":"2024-04-22T19:54:20.365221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.607268+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:54:20.607268+0000","last_peered":"2024-04-22T19:54:20.607268+0000","last_clean":"2024-04-22T19:54:20.607268+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:54:20.607268+0000","last_undegraded":"2024-04-22T19:54:20.607268+0000","last_fullsized":"2024-04-22T19:54:20.607268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386194+0000","last_change":"2024-04-22T19:54:17.398926+0000","last_active":"2024-04-22T19:54:20.386194+0000","last_peered":"2024-04-22T19:54:20.386194+0000","last_clean":"2024-04-22T19:54:20.386194+0000","last_became_active":"2024-04-22T19:54:17.398270+0000","last_became_peered":"2024-04-22T19:54:17.398270+0000","last_unstale":"2024-04-22T19:54:20.386194+0000","last_undegraded":"2024-04-22T19:54:20.386194+0000","last_fullsized":"2024-04-22T19:54:20.386194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358900+0000","last_change":"2024-04-22T19:54:19.958725+0000","last_active":"2024-04-22T19:54:20.358900+0000","last_peered":"2024-04-22T19:54:20.358900+0000","last_clean":"2024-04-22T19:54:20.358900+0000","last_became_active":"2024-04-22T19:54:19.957923+0000","last_became_peered":"2024-04-22T19:54:19.957923+0000","last_unstale":"2024-04-22T19:54:20.358900+0000","last_undegraded":"2024-04-22T19:54:20.358900+0000","last_fullsized":"2024-04-22T19:54:20.358900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:06:47.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365513+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:54:20.365513+0000","last_peered":"2024-04-22T19:54:20.365513+0000","last_clean":"2024-04-22T19:54:20.365513+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:54:20.365513+0000","last_undegraded":"2024-04-22T19:54:20.365513+0000","last_fullsized":"2024-04-22T19:54:20.365513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375716+0000","last_change":"2024-04-22T19:54:09.323111+0000","last_active":"2024-04-22T19:54:20.375716+0000","last_peered":"2024-04-22T19:54:20.375716+0000","last_clean":"2024-04-22T19:54:20.375716+0000","last_became_active":"2024-04-22T19:54:09.322781+0000","last_became_peered":"2024-04-22T19:54:09.322781+0000","last_unstale":"2024-04-22T19:54:20.375716+0000","last_undegraded":"2024-04-22T19:54:20.375716+0000","last_fullsized":"2024-04-22T19:54:20.375716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392779+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:54:20.392779+0000","last_peered":"2024-04-22T19:54:20.392779+0000","last_clean":"2024-04-22T19:54:20.392779+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:54:20.392779+0000","last_undegraded":"2024-04-22T19:54:20.392779+0000","last_fullsized":"2024-04-22T19:54:20.392779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.632844+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:54:20.632844+0000","last_peered":"2024-04-22T19:54:20.632844+0000","last_clean":"2024-04-22T19:54:20.632844+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:54:20.632844+0000","last_undegraded":"2024-04-22T19:54:20.632844+0000","last_fullsized":"2024-04-22T19:54:20.632844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377118+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:54:20.377118+0000","last_peered":"2024-04-22T19:54:20.377118+0000","last_clean":"2024-04-22T19:54:20.377118+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:54:20.377118+0000","last_undegraded":"2024-04-22T19:54:20.377118+0000","last_fullsized":"2024-04-22T19:54:20.377118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391898+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:54:20.391898+0000","last_peered":"2024-04-22T19:54:20.391898+0000","last_clean":"2024-04-22T19:54:20.391898+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:54:20.391898+0000","last_undegraded":"2024-04-22T19:54:20.391898+0000","last_fullsized":"2024-04-22T19:54:20.391898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360295+0000","last_change":"2024-04-22T19:54:11.366363+0000","last_active":"2024-04-22T19:54:20.360295+0000","last_peered":"2024-04-22T19:54:20.360295+0000","last_clean":"2024-04-22T19:54:20.360295+0000","last_became_active":"2024-04-22T19:54:11.365682+0000","last_became_peered":"2024-04-22T19:54:11.365682+0000","last_unstale":"2024-04-22T19:54:20.360295+0000","last_undegraded":"2024-04-22T19:54:20.360295+0000","last_fullsized":"2024-04-22T19:54:20.360295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357625+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:54:20.357625+0000","last_peered":"2024-04-22T19:54:20.357625+0000","last_clean":"2024-04-22T19:54:20.357625+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:54:20.357625+0000","last_undegraded":"2024-04-22T19:54:20.357625+0000","last_fullsized":"2024-04-22T19:54:20.357625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358850+0000","last_change":"2024-04-22T19:54:13.347115+0000","last_active":"2024-04-22T19:54:20.358850+0000","last_peered":"2024-04-22T19:54:20.358850+0000","last_clean":"2024-04-22T19:54:20.358850+0000","last_became_active":"2024-04-22T19:54:13.346214+0000","last_became_peered":"2024-04-22T19:54:13.346214+0000","last_unstale":"2024-04-22T19:54:20.358850+0000","last_undegraded":"2024-04-22T19:54:20.358850+0000","last_fullsized":"2024-04-22T19:54:20.358850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.592798+0000","last_change":"2024-04-22T19:54:15.375428+0000","last_active":"2024-04-22T19:54:20.592798+0000","last_peered":"2024-04-22T19:54:20.592798+0000","last_clean":"2024-04-22T19:54:20.592798+0000","last_became_active":"2024-04-22T19:54:15.374863+0000","last_became_peered":"2024-04-22T19:54:15.374863+0000","last_unstale":"2024-04-22T19:54:20.592798+0000","last_undegraded":"2024-04-22T19:54:20.592798+0000","last_fullsized":"2024-04-22T19:54:20.592798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:56.025191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376572+0000","last_change":"2024-04-22T19:54:17.392924+0000","last_active":"2024-04-22T19:54:20.376572+0000","last_peered":"2024-04-22T19:54:20.376572+0000","last_clean":"2024-04-22T19:54:20.376572+0000","last_became_active":"2024-04-22T19:54:17.391991+0000","last_became_peered":"2024-04-22T19:54:17.391991+0000","last_unstale":"2024-04-22T19:54:20.376572+0000","last_undegraded":"2024-04-22T19:54:20.376572+0000","last_fullsized":"2024-04-22T19:54:20.376572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:47.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385221+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:54:20.385221+0000","last_peered":"2024-04-22T19:54:20.385221+0000","last_clean":"2024-04-22T19:54:20.385221+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:54:20.385221+0000","last_undegraded":"2024-04-22T19:54:20.385221+0000","last_fullsized":"2024-04-22T19:54:20.385221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407134+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:54:20.407134+0000","last_peered":"2024-04-22T19:54:20.407134+0000","last_clean":"2024-04-22T19:54:20.407134+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:54:20.407134+0000","last_undegraded":"2024-04-22T19:54:20.407134+0000","last_fullsized":"2024-04-22T19:54:20.407134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360340+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:54:20.360340+0000","last_peered":"2024-04-22T19:54:20.360340+0000","last_clean":"2024-04-22T19:54:20.360340+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:54:20.360340+0000","last_undegraded":"2024-04-22T19:54:20.360340+0000","last_fullsized":"2024-04-22T19:54:20.360340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377323+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:54:20.377323+0000","last_peered":"2024-04-22T19:54:20.377323+0000","last_clean":"2024-04-22T19:54:20.377323+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:54:20.377323+0000","last_undegraded":"2024-04-22T19:54:20.377323+0000","last_fullsized":"2024-04-22T19:54:20.377323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358362+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:54:20.358362+0000","last_peered":"2024-04-22T19:54:20.358362+0000","last_clean":"2024-04-22T19:54:20.358362+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:54:20.358362+0000","last_undegraded":"2024-04-22T19:54:20.358362+0000","last_fullsized":"2024-04-22T19:54:20.358362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392406+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:54:20.392406+0000","last_peered":"2024-04-22T19:54:20.392406+0000","last_clean":"2024-04-22T19:54:20.392406+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:54:20.392406+0000","last_undegraded":"2024-04-22T19:54:20.392406+0000","last_fullsized":"2024-04-22T19:54:20.392406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380258+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:54:20.380258+0000","last_peered":"2024-04-22T19:54:20.380258+0000","last_clean":"2024-04-22T19:54:20.380258+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:54:20.380258+0000","last_undegraded":"2024-04-22T19:54:20.380258+0000","last_fullsized":"2024-04-22T19:54:20.380258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356788+0000","last_change":"2024-04-22T19:54:11.345501+0000","last_active":"2024-04-22T19:54:20.356788+0000","last_peered":"2024-04-22T19:54:20.356788+0000","last_clean":"2024-04-22T19:54:20.356788+0000","last_became_active":"2024-04-22T19:54:11.342684+0000","last_became_peered":"2024-04-22T19:54:11.342684+0000","last_unstale":"2024-04-22T19:54:20.356788+0000","last_undegraded":"2024-04-22T19:54:20.356788+0000","last_fullsized":"2024-04-22T19:54:20.356788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386804+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:54:20.386804+0000","last_peered":"2024-04-22T19:54:20.386804+0000","last_clean":"2024-04-22T19:54:20.386804+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:54:20.386804+0000","last_undegraded":"2024-04-22T19:54:20.386804+0000","last_fullsized":"2024-04-22T19:54:20.386804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380730+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:54:20.380730+0000","last_peered":"2024-04-22T19:54:20.380730+0000","last_clean":"2024-04-22T19:54:20.380730+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:54:20.380730+0000","last_undegraded":"2024-04-22T19:54:20.380730+0000","last_fullsized":"2024-04-22T19:54:20.380730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.630129+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:54:20.630129+0000","last_peered":"2024-04-22T19:54:20.630129+0000","last_clean":"2024-04-22T19:54:20.630129+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:54:20.630129+0000","last_undegraded":"2024-04-22T19:54:20.630129+0000","last_fullsized":"2024-04-22T19:54:20.630129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357327+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:54:20.357327+0000","last_peered":"2024-04-22T19:54:20.357327+0000","last_clean":"2024-04-22T19:54:20.357327+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:54:20.357327+0000","last_undegraded":"2024-04-22T19:54:20.357327+0000","last_fullsized":"2024-04-22T19:54:20.357327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382595+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:54:20.382595+0000","last_peered":"2024-04-22T19:54:20.382595+0000","last_clean":"2024-04-22T19:54:20.382595+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:54:20.382595+0000","last_undegraded":"2024-04-22T19:54:20.382595+0000","last_fullsized":"2024-04-22T19:54:20.382595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357392+0000","last_change":"2024-04-22T19:54:11.349313+0000","last_active":"2024-04-22T19:54:20.357392+0000","last_peered":"2024-04-22T19:54:20.357392+0000","last_clean":"2024-04-22T19:54:20.357392+0000","last_became_active":"2024-04-22T19:54:11.346733+0000","last_became_peered":"2024-04-22T19:54:11.346733+0000","last_unstale":"2024-04-22T19:54:20.357392+0000","last_undegraded":"2024-04-22T19:54:20.357392+0000","last_fullsized":"2024-04-22T19:54:20.357392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388816+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:54:20.388816+0000","last_peered":"2024-04-22T19:54:20.388816+0000","last_clean":"2024-04-22T19:54:20.388816+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:54:20.388816+0000","last_undegraded":"2024-04-22T19:54:20.388816+0000","last_fullsized":"2024-04-22T19:54:20.388816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386054+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:54:20.386054+0000","last_peered":"2024-04-22T19:54:20.386054+0000","last_clean":"2024-04-22T19:54:20.386054+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:54:20.386054+0000","last_undegraded":"2024-04-22T19:54:20.386054+0000","last_fullsized":"2024-04-22T19:54:20.386054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.643361+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:54:20.643361+0000","last_peered":"2024-04-22T19:54:20.643361+0000","last_clean":"2024-04-22T19:54:20.643361+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:54:20.643361+0000","last_undegraded":"2024-04-22T19:54:20.643361+0000","last_fullsized":"2024-04-22T19:54:20.643361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391072+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:54:20.391072+0000","last_peered":"2024-04-22T19:54:20.391072+0000","last_clean":"2024-04-22T19:54:20.391072+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:54:20.391072+0000","last_undegraded":"2024-04-22T19:54:20.391072+0000","last_fullsized":"2024-04-22T19:54:20.391072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362734+0000","last_change":"2024-04-22T19:54:19.962442+0000","last_active":"2024-04-22T19:54:20.362734+0000","last_peered":"2024-04-22T19:54:20.362734+0000","last_clean":"2024-04-22T19:54:20.362734+0000","last_became_active":"2024-04-22T19:54:19.960324+0000","last_became_peered":"2024-04-22T19:54:19.960324+0000","last_unstale":"2024-04-22T19:54:20.362734+0000","last_undegraded":"2024-04-22T19:54:20.362734+0000","last_fullsized":"2024-04-22T19:54:20.362734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:28:38.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360000+0000","last_change":"2024-04-22T19:54:11.349398+0000","last_active":"2024-04-22T19:54:20.360000+0000","last_peered":"2024-04-22T19:54:20.360000+0000","last_clean":"2024-04-22T19:54:20.360000+0000","last_became_active":"2024-04-22T19:54:11.348383+0000","last_became_peered":"2024-04-22T19:54:11.348383+0000","last_unstale":"2024-04-22T19:54:20.360000+0000","last_undegraded":"2024-04-22T19:54:20.360000+0000","last_fullsized":"2024-04-22T19:54:20.360000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363284+0000","last_change":"2024-04-22T19:54:09.327427+0000","last_active":"2024-04-22T19:54:20.363284+0000","last_peered":"2024-04-22T19:54:20.363284+0000","last_clean":"2024-04-22T19:54:20.363284+0000","last_became_active":"2024-04-22T19:54:09.327146+0000","last_became_peered":"2024-04-22T19:54:09.327146+0000","last_unstale":"2024-04-22T19:54:20.363284+0000","last_undegraded":"2024-04-22T19:54:20.363284+0000","last_fullsized":"2024-04-22T19:54:20.363284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.355947+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:54:20.355947+0000","last_peered":"2024-04-22T19:54:20.355947+0000","last_clean":"2024-04-22T19:54:20.355947+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:54:20.355947+0000","last_undegraded":"2024-04-22T19:54:20.355947+0000","last_fullsized":"2024-04-22T19:54:20.355947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.580406+0000","last_change":"2024-04-22T19:54:15.367002+0000","last_active":"2024-04-22T19:54:20.580406+0000","last_peered":"2024-04-22T19:54:20.580406+0000","last_clean":"2024-04-22T19:54:20.580406+0000","last_became_active":"2024-04-22T19:54:15.363979+0000","last_became_peered":"2024-04-22T19:54:15.363979+0000","last_unstale":"2024-04-22T19:54:20.580406+0000","last_undegraded":"2024-04-22T19:54:20.580406+0000","last_fullsized":"2024-04-22T19:54:20.580406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356457+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:54:20.356457+0000","last_peered":"2024-04-22T19:54:20.356457+0000","last_clean":"2024-04-22T19:54:20.356457+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:54:20.356457+0000","last_undegraded":"2024-04-22T19:54:20.356457+0000","last_fullsized":"2024-04-22T19:54:20.356457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382757+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:54:20.382757+0000","last_peered":"2024-04-22T19:54:20.382757+0000","last_clean":"2024-04-22T19:54:20.382757+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:54:20.382757+0000","last_undegraded":"2024-04-22T19:54:20.382757+0000","last_fullsized":"2024-04-22T19:54:20.382757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356384+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:54:20.356384+0000","last_peered":"2024-04-22T19:54:20.356384+0000","last_clean":"2024-04-22T19:54:20.356384+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:54:20.356384+0000","last_undegraded":"2024-04-22T19:54:20.356384+0000","last_fullsized":"2024-04-22T19:54:20.356384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365743+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:54:20.365743+0000","last_peered":"2024-04-22T19:54:20.365743+0000","last_clean":"2024-04-22T19:54:20.365743+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:54:20.365743+0000","last_undegraded":"2024-04-22T19:54:20.365743+0000","last_fullsized":"2024-04-22T19:54:20.365743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.374785+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:54:20.374785+0000","last_peered":"2024-04-22T19:54:20.374785+0000","last_clean":"2024-04-22T19:54:20.374785+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:54:20.374785+0000","last_undegraded":"2024-04-22T19:54:20.374785+0000","last_fullsized":"2024-04-22T19:54:20.374785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.601924+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:54:20.601924+0000","last_peered":"2024-04-22T19:54:20.601924+0000","last_clean":"2024-04-22T19:54:20.601924+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:54:20.601924+0000","last_undegraded":"2024-04-22T19:54:20.601924+0000","last_fullsized":"2024-04-22T19:54:20.601924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360060+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:54:20.360060+0000","last_peered":"2024-04-22T19:54:20.360060+0000","last_clean":"2024-04-22T19:54:20.360060+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:54:20.360060+0000","last_undegraded":"2024-04-22T19:54:20.360060+0000","last_fullsized":"2024-04-22T19:54:20.360060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359073+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:54:20.359073+0000","last_peered":"2024-04-22T19:54:20.359073+0000","last_clean":"2024-04-22T19:54:20.359073+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:54:20.359073+0000","last_undegraded":"2024-04-22T19:54:20.359073+0000","last_fullsized":"2024-04-22T19:54:20.359073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377326+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:54:20.377326+0000","last_peered":"2024-04-22T19:54:20.377326+0000","last_clean":"2024-04-22T19:54:20.377326+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:54:20.377326+0000","last_undegraded":"2024-04-22T19:54:20.377326+0000","last_fullsized":"2024-04-22T19:54:20.377326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390743+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:54:20.390743+0000","last_peered":"2024-04-22T19:54:20.390743+0000","last_clean":"2024-04-22T19:54:20.390743+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:54:20.390743+0000","last_undegraded":"2024-04-22T19:54:20.390743+0000","last_fullsized":"2024-04-22T19:54:20.390743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376850+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:54:20.376850+0000","last_peered":"2024-04-22T19:54:20.376850+0000","last_clean":"2024-04-22T19:54:20.376850+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:54:20.376850+0000","last_undegraded":"2024-04-22T19:54:20.376850+0000","last_fullsized":"2024-04-22T19:54:20.376850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406106+0000","last_change":"2024-04-22T19:54:09.306173+0000","last_active":"2024-04-22T19:54:20.406106+0000","last_peered":"2024-04-22T19:54:20.406106+0000","last_clean":"2024-04-22T19:54:20.406106+0000","last_became_active":"2024-04-22T19:54:09.305320+0000","last_became_peered":"2024-04-22T19:54:09.305320+0000","last_unstale":"2024-04-22T19:54:20.406106+0000","last_undegraded":"2024-04-22T19:54:20.406106+0000","last_fullsized":"2024-04-22T19:54:20.406106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:57:15.632939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387978+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:54:20.387978+0000","last_peered":"2024-04-22T19:54:20.387978+0000","last_clean":"2024-04-22T19:54:20.387978+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:54:20.387978+0000","last_undegraded":"2024-04-22T19:54:20.387978+0000","last_fullsized":"2024-04-22T19:54:20.387978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386778+0000","last_change":"2024-04-22T19:54:09.327430+0000","last_active":"2024-04-22T19:54:20.386778+0000","last_peered":"2024-04-22T19:54:20.386778+0000","last_clean":"2024-04-22T19:54:20.386778+0000","last_became_active":"2024-04-22T19:54:09.326527+0000","last_became_peered":"2024-04-22T19:54:09.326527+0000","last_unstale":"2024-04-22T19:54:20.386778+0000","last_undegraded":"2024-04-22T19:54:20.386778+0000","last_fullsized":"2024-04-22T19:54:20.386778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376427+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:54:20.376427+0000","last_peered":"2024-04-22T19:54:20.376427+0000","last_clean":"2024-04-22T19:54:20.376427+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:54:20.376427+0000","last_undegraded":"2024-04-22T19:54:20.376427+0000","last_fullsized":"2024-04-22T19:54:20.376427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360611+0000","last_change":"2024-04-22T19:54:09.326400+0000","last_active":"2024-04-22T19:54:20.360611+0000","last_peered":"2024-04-22T19:54:20.360611+0000","last_clean":"2024-04-22T19:54:20.360611+0000","last_became_active":"2024-04-22T19:54:09.326073+0000","last_became_peered":"2024-04-22T19:54:09.326073+0000","last_unstale":"2024-04-22T19:54:20.360611+0000","last_undegraded":"2024-04-22T19:54:20.360611+0000","last_fullsized":"2024-04-22T19:54:20.360611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360596+0000","last_change":"2024-04-22T19:54:11.376169+0000","last_active":"2024-04-22T19:54:20.360596+0000","last_peered":"2024-04-22T19:54:20.360596+0000","last_clean":"2024-04-22T19:54:20.360596+0000","last_became_active":"2024-04-22T19:54:11.367472+0000","last_became_peered":"2024-04-22T19:54:11.367472+0000","last_unstale":"2024-04-22T19:54:20.360596+0000","last_undegraded":"2024-04-22T19:54:20.360596+0000","last_fullsized":"2024-04-22T19:54:20.360596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361069+0000","last_change":"2024-04-22T19:54:09.348783+0000","last_active":"2024-04-22T19:54:20.361069+0000","last_peered":"2024-04-22T19:54:20.361069+0000","last_clean":"2024-04-22T19:54:20.361069+0000","last_became_active":"2024-04-22T19:54:09.348404+0000","last_became_peered":"2024-04-22T19:54:09.348404+0000","last_unstale":"2024-04-22T19:54:20.361069+0000","last_undegraded":"2024-04-22T19:54:20.361069+0000","last_fullsized":"2024-04-22T19:54:20.361069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357626+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:54:20.357626+0000","last_peered":"2024-04-22T19:54:20.357626+0000","last_clean":"2024-04-22T19:54:20.357626+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:54:20.357626+0000","last_undegraded":"2024-04-22T19:54:20.357626+0000","last_fullsized":"2024-04-22T19:54:20.357626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377678+0000","last_change":"2024-04-22T19:54:09.323462+0000","last_active":"2024-04-22T19:54:20.377678+0000","last_peered":"2024-04-22T19:54:20.377678+0000","last_clean":"2024-04-22T19:54:20.377678+0000","last_became_active":"2024-04-22T19:54:09.323039+0000","last_became_peered":"2024-04-22T19:54:09.323039+0000","last_unstale":"2024-04-22T19:54:20.377678+0000","last_undegraded":"2024-04-22T19:54:20.377678+0000","last_fullsized":"2024-04-22T19:54:20.377678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359356+0000","last_change":"2024-04-22T19:54:11.361345+0000","last_active":"2024-04-22T19:54:20.359356+0000","last_peered":"2024-04-22T19:54:20.359356+0000","last_clean":"2024-04-22T19:54:20.359356+0000","last_became_active":"2024-04-22T19:54:11.360452+0000","last_became_peered":"2024-04-22T19:54:11.360452+0000","last_unstale":"2024-04-22T19:54:20.359356+0000","last_undegraded":"2024-04-22T19:54:20.359356+0000","last_fullsized":"2024-04-22T19:54:20.359356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392888+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:54:20.392888+0000","last_peered":"2024-04-22T19:54:20.392888+0000","last_clean":"2024-04-22T19:54:20.392888+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:54:20.392888+0000","last_undegraded":"2024-04-22T19:54:20.392888+0000","last_fullsized":"2024-04-22T19:54:20.392888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390754+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:54:20.390754+0000","last_peered":"2024-04-22T19:54:20.390754+0000","last_clean":"2024-04-22T19:54:20.390754+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:54:20.390754+0000","last_undegraded":"2024-04-22T19:54:20.390754+0000","last_fullsized":"2024-04-22T19:54:20.390754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363796+0000","last_change":"2024-04-22T19:54:09.347666+0000","last_active":"2024-04-22T19:54:20.363796+0000","last_peered":"2024-04-22T19:54:20.363796+0000","last_clean":"2024-04-22T19:54:20.363796+0000","last_became_active":"2024-04-22T19:54:09.347242+0000","last_became_peered":"2024-04-22T19:54:09.347242+0000","last_unstale":"2024-04-22T19:54:20.363796+0000","last_undegraded":"2024-04-22T19:54:20.363796+0000","last_fullsized":"2024-04-22T19:54:20.363796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365715+0000","last_change":"2024-04-22T19:54:11.350903+0000","last_active":"2024-04-22T19:54:20.365715+0000","last_peered":"2024-04-22T19:54:20.365715+0000","last_clean":"2024-04-22T19:54:20.365715+0000","last_became_active":"2024-04-22T19:54:11.350560+0000","last_became_peered":"2024-04-22T19:54:11.350560+0000","last_unstale":"2024-04-22T19:54:20.365715+0000","last_undegraded":"2024-04-22T19:54:20.365715+0000","last_fullsized":"2024-04-22T19:54:20.365715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385683+0000","last_change":"2024-04-22T19:54:09.337457+0000","last_active":"2024-04-22T19:54:20.385683+0000","last_peered":"2024-04-22T19:54:20.385683+0000","last_clean":"2024-04-22T19:54:20.385683+0000","last_became_active":"2024-04-22T19:54:09.336663+0000","last_became_peered":"2024-04-22T19:54:09.336663+0000","last_unstale":"2024-04-22T19:54:20.385683+0000","last_undegraded":"2024-04-22T19:54:20.385683+0000","last_fullsized":"2024-04-22T19:54:20.385683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358619+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:54:20.358619+0000","last_peered":"2024-04-22T19:54:20.358619+0000","last_clean":"2024-04-22T19:54:20.358619+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:54:20.358619+0000","last_undegraded":"2024-04-22T19:54:20.358619+0000","last_fullsized":"2024-04-22T19:54:20.358619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360986+0000","last_change":"2024-04-22T19:54:09.347792+0000","last_active":"2024-04-22T19:54:20.360986+0000","last_peered":"2024-04-22T19:54:20.360986+0000","last_clean":"2024-04-22T19:54:20.360986+0000","last_became_active":"2024-04-22T19:54:09.347359+0000","last_became_peered":"2024-04-22T19:54:09.347359+0000","last_unstale":"2024-04-22T19:54:20.360986+0000","last_undegraded":"2024-04-22T19:54:20.360986+0000","last_fullsized":"2024-04-22T19:54:20.360986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407349+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:54:20.407349+0000","last_peered":"2024-04-22T19:54:20.407349+0000","last_clean":"2024-04-22T19:54:20.407349+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:54:20.407349+0000","last_undegraded":"2024-04-22T19:54:20.407349+0000","last_fullsized":"2024-04-22T19:54:20.407349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386614+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:54:20.386614+0000","last_peered":"2024-04-22T19:54:20.386614+0000","last_clean":"2024-04-22T19:54:20.386614+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:54:20.386614+0000","last_undegraded":"2024-04-22T19:54:20.386614+0000","last_fullsized":"2024-04-22T19:54:20.386614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358364+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:54:20.358364+0000","last_peered":"2024-04-22T19:54:20.358364+0000","last_clean":"2024-04-22T19:54:20.358364+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:54:20.358364+0000","last_undegraded":"2024-04-22T19:54:20.358364+0000","last_fullsized":"2024-04-22T19:54:20.358364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362116+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:54:20.362116+0000","last_peered":"2024-04-22T19:54:20.362116+0000","last_clean":"2024-04-22T19:54:20.362116+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:54:20.362116+0000","last_undegraded":"2024-04-22T19:54:20.362116+0000","last_fullsized":"2024-04-22T19:54:20.362116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382258+0000","last_change":"2024-04-22T19:54:11.386080+0000","last_active":"2024-04-22T19:54:20.382258+0000","last_peered":"2024-04-22T19:54:20.382258+0000","last_clean":"2024-04-22T19:54:20.382258+0000","last_became_active":"2024-04-22T19:54:11.385436+0000","last_became_peered":"2024-04-22T19:54:11.385436+0000","last_unstale":"2024-04-22T19:54:20.382258+0000","last_undegraded":"2024-04-22T19:54:20.382258+0000","last_fullsized":"2024-04-22T19:54:20.382258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392683+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:54:20.392683+0000","last_peered":"2024-04-22T19:54:20.392683+0000","last_clean":"2024-04-22T19:54:20.392683+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:54:20.392683+0000","last_undegraded":"2024-04-22T19:54:20.392683+0000","last_fullsized":"2024-04-22T19:54:20.392683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359872+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:54:20.359872+0000","last_peered":"2024-04-22T19:54:20.359872+0000","last_clean":"2024-04-22T19:54:20.359872+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:54:20.359872+0000","last_undegraded":"2024-04-22T19:54:20.359872+0000","last_fullsized":"2024-04-22T19:54:20.359872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383279+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:54:20.383279+0000","last_peered":"2024-04-22T19:54:20.383279+0000","last_clean":"2024-04-22T19:54:20.383279+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:54:20.383279+0000","last_undegraded":"2024-04-22T19:54:20.383279+0000","last_fullsized":"2024-04-22T19:54:20.383279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359183+0000","last_change":"2024-04-22T19:54:11.347140+0000","last_active":"2024-04-22T19:54:20.359183+0000","last_peered":"2024-04-22T19:54:20.359183+0000","last_clean":"2024-04-22T19:54:20.359183+0000","last_became_active":"2024-04-22T19:54:11.345540+0000","last_became_peered":"2024-04-22T19:54:11.345540+0000","last_unstale":"2024-04-22T19:54:20.359183+0000","last_undegraded":"2024-04-22T19:54:20.359183+0000","last_fullsized":"2024-04-22T19:54:20.359183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.408081+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:54:20.408081+0000","last_peered":"2024-04-22T19:54:20.408081+0000","last_clean":"2024-04-22T19:54:20.408081+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:54:20.408081+0000","last_undegraded":"2024-04-22T19:54:20.408081+0000","last_fullsized":"2024-04-22T19:54:20.408081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380282+0000","last_change":"2024-04-22T19:54:11.384243+0000","last_active":"2024-04-22T19:54:20.380282+0000","last_peered":"2024-04-22T19:54:20.380282+0000","last_clean":"2024-04-22T19:54:20.380282+0000","last_became_active":"2024-04-22T19:54:11.383676+0000","last_became_peered":"2024-04-22T19:54:11.383676+0000","last_unstale":"2024-04-22T19:54:20.380282+0000","last_undegraded":"2024-04-22T19:54:20.380282+0000","last_fullsized":"2024-04-22T19:54:20.380282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387519+0000","last_change":"2024-04-22T19:54:09.341673+0000","last_active":"2024-04-22T19:54:20.387519+0000","last_peered":"2024-04-22T19:54:20.387519+0000","last_clean":"2024-04-22T19:54:20.387519+0000","last_became_active":"2024-04-22T19:54:09.340976+0000","last_became_peered":"2024-04-22T19:54:09.340976+0000","last_unstale":"2024-04-22T19:54:20.387519+0000","last_undegraded":"2024-04-22T19:54:20.387519+0000","last_fullsized":"2024-04-22T19:54:20.387519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:20.899786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385432+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:54:20.385432+0000","last_peered":"2024-04-22T19:54:20.385432+0000","last_clean":"2024-04-22T19:54:20.385432+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:54:20.385432+0000","last_undegraded":"2024-04-22T19:54:20.385432+0000","last_fullsized":"2024-04-22T19:54:20.385432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365524+0000","last_change":"2024-04-22T19:54:11.341482+0000","last_active":"2024-04-22T19:54:20.365524+0000","last_peered":"2024-04-22T19:54:20.365524+0000","last_clean":"2024-04-22T19:54:20.365524+0000","last_became_active":"2024-04-22T19:54:11.341075+0000","last_became_peered":"2024-04-22T19:54:11.341075+0000","last_unstale":"2024-04-22T19:54:20.365524+0000","last_undegraded":"2024-04-22T19:54:20.365524+0000","last_fullsized":"2024-04-22T19:54:20.365524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375496+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:54:20.375496+0000","last_peered":"2024-04-22T19:54:20.375496+0000","last_clean":"2024-04-22T19:54:20.375496+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:54:20.375496+0000","last_undegraded":"2024-04-22T19:54:20.375496+0000","last_fullsized":"2024-04-22T19:54:20.375496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386532+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:54:20.386532+0000","last_peered":"2024-04-22T19:54:20.386532+0000","last_clean":"2024-04-22T19:54:20.386532+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:54:20.386532+0000","last_undegraded":"2024-04-22T19:54:20.386532+0000","last_fullsized":"2024-04-22T19:54:20.386532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":310,"num_read_kb":183,"num_write":189,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":740732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":149928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":150979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":149866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":150210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":150813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":149848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":740142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:54:27.325 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:54:27.708 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:54:27.716 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:54:27.729 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-22T19:54:27.328059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224572,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750148,"statfs":{"total":773094113280,"available":772864151552,"internally_reserved":0,"allocated":4333568,"data_stored":2453462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003697"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381763+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:54:20.381763+0000","last_peered":"2024-04-22T19:54:20.381763+0000","last_clean":"2024-04-22T19:54:20.381763+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:54:20.381763+0000","last_undegraded":"2024-04-22T19:54:20.381763+0000","last_fullsized":"2024-04-22T19:54:20.381763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.384994+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:54:20.384994+0000","last_peered":"2024-04-22T19:54:20.384994+0000","last_clean":"2024-04-22T19:54:20.384994+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:54:20.384994+0000","last_undegraded":"2024-04-22T19:54:20.384994+0000","last_fullsized":"2024-04-22T19:54:20.384994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377071+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:54:20.377071+0000","last_peered":"2024-04-22T19:54:20.377071+0000","last_clean":"2024-04-22T19:54:20.377071+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:54:20.377071+0000","last_undegraded":"2024-04-22T19:54:20.377071+0000","last_fullsized":"2024-04-22T19:54:20.377071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380660+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:54:20.380660+0000","last_peered":"2024-04-22T19:54:20.380660+0000","last_clean":"2024-04-22T19:54:20.380660+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:54:20.380660+0000","last_undegraded":"2024-04-22T19:54:20.380660+0000","last_fullsized":"2024-04-22T19:54:20.380660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363495+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:54:20.363495+0000","last_peered":"2024-04-22T19:54:20.363495+0000","last_clean":"2024-04-22T19:54:20.363495+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:54:20.363495+0000","last_undegraded":"2024-04-22T19:54:20.363495+0000","last_fullsized":"2024-04-22T19:54:20.363495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357001+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:54:20.357001+0000","last_peered":"2024-04-22T19:54:20.357001+0000","last_clean":"2024-04-22T19:54:20.357001+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:54:20.357001+0000","last_undegraded":"2024-04-22T19:54:20.357001+0000","last_fullsized":"2024-04-22T19:54:20.357001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386545+0000","last_change":"2024-04-22T19:54:09.335968+0000","last_active":"2024-04-22T19:54:20.386545+0000","last_peered":"2024-04-22T19:54:20.386545+0000","last_clean":"2024-04-22T19:54:20.386545+0000","last_became_active":"2024-04-22T19:54:09.335354+0000","last_became_peered":"2024-04-22T19:54:09.335354+0000","last_unstale":"2024-04-22T19:54:20.386545+0000","last_undegraded":"2024-04-22T19:54:20.386545+0000","last_fullsized":"2024-04-22T19:54:20.386545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360417+0000","last_change":"2024-04-22T19:54:11.352164+0000","last_active":"2024-04-22T19:54:20.360417+0000","last_peered":"2024-04-22T19:54:20.360417+0000","last_clean":"2024-04-22T19:54:20.360417+0000","last_became_active":"2024-04-22T19:54:11.351808+0000","last_became_peered":"2024-04-22T19:54:11.351808+0000","last_unstale":"2024-04-22T19:54:20.360417+0000","last_undegraded":"2024-04-22T19:54:20.360417+0000","last_fullsized":"2024-04-22T19:54:20.360417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382534+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:54:20.382534+0000","last_peered":"2024-04-22T19:54:20.382534+0000","last_clean":"2024-04-22T19:54:20.382534+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:54:20.382534+0000","last_undegraded":"2024-04-22T19:54:20.382534+0000","last_fullsized":"2024-04-22T19:54:20.382534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391657+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:54:20.391657+0000","last_peered":"2024-04-22T19:54:20.391657+0000","last_clean":"2024-04-22T19:54:20.391657+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:54:20.391657+0000","last_undegraded":"2024-04-22T19:54:20.391657+0000","last_fullsized":"2024-04-22T19:54:20.391657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386348+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:54:20.386348+0000","last_peered":"2024-04-22T19:54:20.386348+0000","last_clean":"2024-04-22T19:54:20.386348+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:54:20.386348+0000","last_undegraded":"2024-04-22T19:54:20.386348+0000","last_fullsized":"2024-04-22T19:54:20.386348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358154+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:54:20.358154+0000","last_peered":"2024-04-22T19:54:20.358154+0000","last_clean":"2024-04-22T19:54:20.358154+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:54:20.358154+0000","last_undegraded":"2024-04-22T19:54:20.358154+0000","last_fullsized":"2024-04-22T19:54:20.358154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380972+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:54:20.380972+0000","last_peered":"2024-04-22T19:54:20.380972+0000","last_clean":"2024-04-22T19:54:20.380972+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:54:20.380972+0000","last_undegraded":"2024-04-22T19:54:20.380972+0000","last_fullsized":"2024-04-22T19:54:20.380972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386098+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:54:20.386098+0000","last_peered":"2024-04-22T19:54:20.386098+0000","last_clean":"2024-04-22T19:54:20.386098+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:54:20.386098+0000","last_undegraded":"2024-04-22T19:54:20.386098+0000","last_fullsized":"2024-04-22T19:54:20.386098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362212+0000","last_change":"2024-04-22T19:54:09.342297+0000","last_active":"2024-04-22T19:54:20.362212+0000","last_peered":"2024-04-22T19:54:20.362212+0000","last_clean":"2024-04-22T19:54:20.362212+0000","last_became_active":"2024-04-22T19:54:09.341821+0000","last_became_peered":"2024-04-22T19:54:09.341821+0000","last_unstale":"2024-04-22T19:54:20.362212+0000","last_undegraded":"2024-04-22T19:54:20.362212+0000","last_fullsized":"2024-04-22T19:54:20.362212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407588+0000","last_change":"2024-04-22T19:54:11.366719+0000","last_active":"2024-04-22T19:54:20.407588+0000","last_peered":"2024-04-22T19:54:20.407588+0000","last_clean":"2024-04-22T19:54:20.407588+0000","last_became_active":"2024-04-22T19:54:11.366430+0000","last_became_peered":"2024-04-22T19:54:11.366430+0000","last_unstale":"2024-04-22T19:54:20.407588+0000","last_undegraded":"2024-04-22T19:54:20.407588+0000","last_fullsized":"2024-04-22T19:54:20.407588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:20.853206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356379+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:54:20.356379+0000","last_peered":"2024-04-22T19:54:20.356379+0000","last_clean":"2024-04-22T19:54:20.356379+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:54:20.356379+0000","last_undegraded":"2024-04-22T19:54:20.356379+0000","last_fullsized":"2024-04-22T19:54:20.356379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381997+0000","last_change":"2024-04-22T19:54:09.357494+0000","last_active":"2024-04-22T19:54:20.381997+0000","last_peered":"2024-04-22T19:54:20.381997+0000","last_clean":"2024-04-22T19:54:20.381997+0000","last_became_active":"2024-04-22T19:54:09.352801+0000","last_became_peered":"2024-04-22T19:54:09.352801+0000","last_unstale":"2024-04-22T19:54:20.381997+0000","last_undegraded":"2024-04-22T19:54:20.381997+0000","last_fullsized":"2024-04-22T19:54:20.381997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380743+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:54:20.380743+0000","last_peered":"2024-04-22T19:54:20.380743+0000","last_clean":"2024-04-22T19:54:20.380743+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:54:20.380743+0000","last_undegraded":"2024-04-22T19:54:20.380743+0000","last_fullsized":"2024-04-22T19:54:20.380743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392663+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:54:20.392663+0000","last_peered":"2024-04-22T19:54:20.392663+0000","last_clean":"2024-04-22T19:54:20.392663+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:54:20.392663+0000","last_undegraded":"2024-04-22T19:54:20.392663+0000","last_fullsized":"2024-04-22T19:54:20.392663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386518+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:54:20.386518+0000","last_peered":"2024-04-22T19:54:20.386518+0000","last_clean":"2024-04-22T19:54:20.386518+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:54:20.386518+0000","last_undegraded":"2024-04-22T19:54:20.386518+0000","last_fullsized":"2024-04-22T19:54:20.386518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392773+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:54:20.392773+0000","last_peered":"2024-04-22T19:54:20.392773+0000","last_clean":"2024-04-22T19:54:20.392773+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:54:20.392773+0000","last_undegraded":"2024-04-22T19:54:20.392773+0000","last_fullsized":"2024-04-22T19:54:20.392773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406681+0000","last_change":"2024-04-22T19:54:11.366667+0000","last_active":"2024-04-22T19:54:20.406681+0000","last_peered":"2024-04-22T19:54:20.406681+0000","last_clean":"2024-04-22T19:54:20.406681+0000","last_became_active":"2024-04-22T19:54:11.366362+0000","last_became_peered":"2024-04-22T19:54:11.366362+0000","last_unstale":"2024-04-22T19:54:20.406681+0000","last_undegraded":"2024-04-22T19:54:20.406681+0000","last_fullsized":"2024-04-22T19:54:20.406681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:55.770295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357637+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:54:20.357637+0000","last_peered":"2024-04-22T19:54:20.357637+0000","last_clean":"2024-04-22T19:54:20.357637+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:54:20.357637+0000","last_undegraded":"2024-04-22T19:54:20.357637+0000","last_fullsized":"2024-04-22T19:54:20.357637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407065+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:54:20.407065+0000","last_peered":"2024-04-22T19:54:20.407065+0000","last_clean":"2024-04-22T19:54:20.407065+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:54:20.407065+0000","last_undegraded":"2024-04-22T19:54:20.407065+0000","last_fullsized":"2024-04-22T19:54:20.407065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359396+0000","last_change":"2024-04-22T19:54:09.323744+0000","last_active":"2024-04-22T19:54:20.359396+0000","last_peered":"2024-04-22T19:54:20.359396+0000","last_clean":"2024-04-22T19:54:20.359396+0000","last_became_active":"2024-04-22T19:54:09.323397+0000","last_became_peered":"2024-04-22T19:54:09.323397+0000","last_unstale":"2024-04-22T19:54:20.359396+0000","last_undegraded":"2024-04-22T19:54:20.359396+0000","last_fullsized":"2024-04-22T19:54:20.359396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358240+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:54:20.358240+0000","last_peered":"2024-04-22T19:54:20.358240+0000","last_clean":"2024-04-22T19:54:20.358240+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:54:20.358240+0000","last_undegraded":"2024-04-22T19:54:20.358240+0000","last_fullsized":"2024-04-22T19:54:20.358240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361160+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:54:20.361160+0000","last_peered":"2024-04-22T19:54:20.361160+0000","last_clean":"2024-04-22T19:54:20.361160+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:54:20.361160+0000","last_undegraded":"2024-04-22T19:54:20.361160+0000","last_fullsized":"2024-04-22T19:54:20.361160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356068+0000","last_change":"2024-04-22T19:54:19.384172+0000","last_active":"2024-04-22T19:54:20.356068+0000","last_peered":"2024-04-22T19:54:20.356068+0000","last_clean":"2024-04-22T19:54:20.356068+0000","last_became_active":"2024-04-22T19:54:19.383327+0000","last_became_peered":"2024-04-22T19:54:19.383327+0000","last_unstale":"2024-04-22T19:54:20.356068+0000","last_undegraded":"2024-04-22T19:54:20.356068+0000","last_fullsized":"2024-04-22T19:54:20.356068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360489+0000","last_change":"2024-04-22T19:54:11.367608+0000","last_active":"2024-04-22T19:54:20.360489+0000","last_peered":"2024-04-22T19:54:20.360489+0000","last_clean":"2024-04-22T19:54:20.360489+0000","last_became_active":"2024-04-22T19:54:11.366912+0000","last_became_peered":"2024-04-22T19:54:11.366912+0000","last_unstale":"2024-04-22T19:54:20.360489+0000","last_undegraded":"2024-04-22T19:54:20.360489+0000","last_fullsized":"2024-04-22T19:54:20.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382763+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:54:20.382763+0000","last_peered":"2024-04-22T19:54:20.382763+0000","last_clean":"2024-04-22T19:54:20.382763+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:54:20.382763+0000","last_undegraded":"2024-04-22T19:54:20.382763+0000","last_fullsized":"2024-04-22T19:54:20.382763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387755+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:54:20.387755+0000","last_peered":"2024-04-22T19:54:20.387755+0000","last_clean":"2024-04-22T19:54:20.387755+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:54:20.387755+0000","last_undegraded":"2024-04-22T19:54:20.387755+0000","last_fullsized":"2024-04-22T19:54:20.387755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.747108+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:54:20.747108+0000","last_peered":"2024-04-22T19:54:20.747108+0000","last_clean":"2024-04-22T19:54:20.747108+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:54:20.747108+0000","last_undegraded":"2024-04-22T19:54:20.747108+0000","last_fullsized":"2024-04-22T19:54:20.747108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381366+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:54:20.381366+0000","last_peered":"2024-04-22T19:54:20.381366+0000","last_clean":"2024-04-22T19:54:20.381366+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:54:20.381366+0000","last_undegraded":"2024-04-22T19:54:20.381366+0000","last_fullsized":"2024-04-22T19:54:20.381366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385079+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:54:20.385079+0000","last_peered":"2024-04-22T19:54:20.385079+0000","last_clean":"2024-04-22T19:54:20.385079+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:54:20.385079+0000","last_undegraded":"2024-04-22T19:54:20.385079+0000","last_fullsized":"2024-04-22T19:54:20.385079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388594+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:54:20.388594+0000","last_peered":"2024-04-22T19:54:20.388594+0000","last_clean":"2024-04-22T19:54:20.388594+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:54:20.388594+0000","last_undegraded":"2024-04-22T19:54:20.388594+0000","last_fullsized":"2024-04-22T19:54:20.388594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361400+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:54:20.361400+0000","last_peered":"2024-04-22T19:54:20.361400+0000","last_clean":"2024-04-22T19:54:20.361400+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:54:20.361400+0000","last_undegraded":"2024-04-22T19:54:20.361400+0000","last_fullsized":"2024-04-22T19:54:20.361400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359972+0000","last_change":"2024-04-22T19:54:13.358928+0000","last_active":"2024-04-22T19:54:20.359972+0000","last_peered":"2024-04-22T19:54:20.359972+0000","last_clean":"2024-04-22T19:54:20.359972+0000","last_became_active":"2024-04-22T19:54:13.358215+0000","last_became_peered":"2024-04-22T19:54:13.358215+0000","last_unstale":"2024-04-22T19:54:20.359972+0000","last_undegraded":"2024-04-22T19:54:20.359972+0000","last_fullsized":"2024-04-22T19:54:20.359972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.120103+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:54:21.120103+0000","last_peered":"2024-04-22T19:54:21.120103+0000","last_clean":"2024-04-22T19:54:21.120103+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:54:21.120103+0000","last_undegraded":"2024-04-22T19:54:21.120103+0000","last_fullsized":"2024-04-22T19:54:21.120103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358182+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:54:20.358182+0000","last_peered":"2024-04-22T19:54:20.358182+0000","last_clean":"2024-04-22T19:54:20.358182+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:54:20.358182+0000","last_undegraded":"2024-04-22T19:54:20.358182+0000","last_fullsized":"2024-04-22T19:54:20.358182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360704+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:54:20.360704+0000","last_peered":"2024-04-22T19:54:20.360704+0000","last_clean":"2024-04-22T19:54:20.360704+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:54:20.360704+0000","last_undegraded":"2024-04-22T19:54:20.360704+0000","last_fullsized":"2024-04-22T19:54:20.360704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365825+0000","last_change":"2024-04-22T19:54:11.344326+0000","last_active":"2024-04-22T19:54:20.365825+0000","last_peered":"2024-04-22T19:54:20.365825+0000","last_clean":"2024-04-22T19:54:20.365825+0000","last_became_active":"2024-04-22T19:54:11.343967+0000","last_became_peered":"2024-04-22T19:54:11.343967+0000","last_unstale":"2024-04-22T19:54:20.365825+0000","last_undegraded":"2024-04-22T19:54:20.365825+0000","last_fullsized":"2024-04-22T19:54:20.365825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380980+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:54:20.380980+0000","last_peered":"2024-04-22T19:54:20.380980+0000","last_clean":"2024-04-22T19:54:20.380980+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:54:20.380980+0000","last_undegraded":"2024-04-22T19:54:20.380980+0000","last_fullsized":"2024-04-22T19:54:20.380980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.364208+0000","last_change":"2024-04-22T19:54:13.353567+0000","last_active":"2024-04-22T19:54:20.364208+0000","last_peered":"2024-04-22T19:54:20.364208+0000","last_clean":"2024-04-22T19:54:20.364208+0000","last_became_active":"2024-04-22T19:54:13.353104+0000","last_became_peered":"2024-04-22T19:54:13.353104+0000","last_unstale":"2024-04-22T19:54:20.364208+0000","last_undegraded":"2024-04-22T19:54:20.364208+0000","last_fullsized":"2024-04-22T19:54:20.364208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.171779+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:54:21.171779+0000","last_peered":"2024-04-22T19:54:21.171779+0000","last_clean":"2024-04-22T19:54:21.171779+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:54:21.171779+0000","last_undegraded":"2024-04-22T19:54:21.171779+0000","last_fullsized":"2024-04-22T19:54:21.171779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.651616+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:54:20.651616+0000","last_peered":"2024-04-22T19:54:20.651616+0000","last_clean":"2024-04-22T19:54:20.651616+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:54:20.651616+0000","last_undegraded":"2024-04-22T19:54:20.651616+0000","last_fullsized":"2024-04-22T19:54:20.651616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356930+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:54:20.356930+0000","last_peered":"2024-04-22T19:54:20.356930+0000","last_clean":"2024-04-22T19:54:20.356930+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:54:20.356930+0000","last_undegraded":"2024-04-22T19:54:20.356930+0000","last_fullsized":"2024-04-22T19:54:20.356930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363513+0000","last_change":"2024-04-22T19:54:11.367430+0000","last_active":"2024-04-22T19:54:20.363513+0000","last_peered":"2024-04-22T19:54:20.363513+0000","last_clean":"2024-04-22T19:54:20.363513+0000","last_became_active":"2024-04-22T19:54:11.367019+0000","last_became_peered":"2024-04-22T19:54:11.367019+0000","last_unstale":"2024-04-22T19:54:20.363513+0000","last_undegraded":"2024-04-22T19:54:20.363513+0000","last_fullsized":"2024-04-22T19:54:20.363513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390981+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:54:20.390981+0000","last_peered":"2024-04-22T19:54:20.390981+0000","last_clean":"2024-04-22T19:54:20.390981+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:54:20.390981+0000","last_undegraded":"2024-04-22T19:54:20.390981+0000","last_fullsized":"2024-04-22T19:54:20.390981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385883+0000","last_change":"2024-04-22T19:54:13.373018+0000","last_active":"2024-04-22T19:54:20.385883+0000","last_peered":"2024-04-22T19:54:20.385883+0000","last_clean":"2024-04-22T19:54:20.385883+0000","last_became_active":"2024-04-22T19:54:13.372322+0000","last_became_peered":"2024-04-22T19:54:13.372322+0000","last_unstale":"2024-04-22T19:54:20.385883+0000","last_undegraded":"2024-04-22T19:54:20.385883+0000","last_fullsized":"2024-04-22T19:54:20.385883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.178878+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:54:21.178878+0000","last_peered":"2024-04-22T19:54:21.178878+0000","last_clean":"2024-04-22T19:54:21.178878+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:54:21.178878+0000","last_undegraded":"2024-04-22T19:54:21.178878+0000","last_fullsized":"2024-04-22T19:54:21.178878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.645164+0000","last_change":"2024-04-22T19:54:17.386681+0000","last_active":"2024-04-22T19:54:20.645164+0000","last_peered":"2024-04-22T19:54:20.645164+0000","last_clean":"2024-04-22T19:54:20.645164+0000","last_became_active":"2024-04-22T19:54:17.385957+0000","last_became_peered":"2024-04-22T19:54:17.385957+0000","last_unstale":"2024-04-22T19:54:20.645164+0000","last_undegraded":"2024-04-22T19:54:20.645164+0000","last_fullsized":"2024-04-22T19:54:20.645164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:20.429084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387772+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:54:20.387772+0000","last_peered":"2024-04-22T19:54:20.387772+0000","last_clean":"2024-04-22T19:54:20.387772+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:54:20.387772+0000","last_undegraded":"2024-04-22T19:54:20.387772+0000","last_fullsized":"2024-04-22T19:54:20.387772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382059+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:54:20.382059+0000","last_peered":"2024-04-22T19:54:20.382059+0000","last_clean":"2024-04-22T19:54:20.382059+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:54:20.382059+0000","last_undegraded":"2024-04-22T19:54:20.382059+0000","last_fullsized":"2024-04-22T19:54:20.382059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380388+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:54:20.380388+0000","last_peered":"2024-04-22T19:54:20.380388+0000","last_clean":"2024-04-22T19:54:20.380388+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:54:20.380388+0000","last_undegraded":"2024-04-22T19:54:20.380388+0000","last_fullsized":"2024-04-22T19:54:20.380388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.272929+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:54:21.272929+0000","last_peered":"2024-04-22T19:54:21.272929+0000","last_clean":"2024-04-22T19:54:21.272929+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:54:21.272929+0000","last_undegraded":"2024-04-22T19:54:21.272929+0000","last_fullsized":"2024-04-22T19:54:21.272929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375608+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:54:20.375608+0000","last_peered":"2024-04-22T19:54:20.375608+0000","last_clean":"2024-04-22T19:54:20.375608+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:54:20.375608+0000","last_undegraded":"2024-04-22T19:54:20.375608+0000","last_fullsized":"2024-04-22T19:54:20.375608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386014+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:54:20.386014+0000","last_peered":"2024-04-22T19:54:20.386014+0000","last_clean":"2024-04-22T19:54:20.386014+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:54:20.386014+0000","last_undegraded":"2024-04-22T19:54:20.386014+0000","last_fullsized":"2024-04-22T19:54:20.386014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356536+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:54:20.356536+0000","last_peered":"2024-04-22T19:54:20.356536+0000","last_clean":"2024-04-22T19:54:20.356536+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:54:20.356536+0000","last_undegraded":"2024-04-22T19:54:20.356536+0000","last_fullsized":"2024-04-22T19:54:20.356536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382259+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:54:20.382259+0000","last_peered":"2024-04-22T19:54:20.382259+0000","last_clean":"2024-04-22T19:54:20.382259+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:54:20.382259+0000","last_undegraded":"2024-04-22T19:54:20.382259+0000","last_fullsized":"2024-04-22T19:54:20.382259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406132+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:54:20.406132+0000","last_peered":"2024-04-22T19:54:20.406132+0000","last_clean":"2024-04-22T19:54:20.406132+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:54:20.406132+0000","last_undegraded":"2024-04-22T19:54:20.406132+0000","last_fullsized":"2024-04-22T19:54:20.406132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.152438+0000","last_change":"2024-04-22T19:54:15.368608+0000","last_active":"2024-04-22T19:54:21.152438+0000","last_peered":"2024-04-22T19:54:21.152438+0000","last_clean":"2024-04-22T19:54:21.152438+0000","last_became_active":"2024-04-22T19:54:15.367821+0000","last_became_peered":"2024-04-22T19:54:15.367821+0000","last_unstale":"2024-04-22T19:54:21.152438+0000","last_undegraded":"2024-04-22T19:54:21.152438+0000","last_fullsized":"2024-04-22T19:54:21.152438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358799+0000","last_change":"2024-04-22T19:54:17.387097+0000","last_active":"2024-04-22T19:54:20.358799+0000","last_peered":"2024-04-22T19:54:20.358799+0000","last_clean":"2024-04-22T19:54:20.358799+0000","last_became_active":"2024-04-22T19:54:17.386193+0000","last_became_peered":"2024-04-22T19:54:17.386193+0000","last_unstale":"2024-04-22T19:54:20.358799+0000","last_undegraded":"2024-04-22T19:54:20.358799+0000","last_fullsized":"2024-04-22T19:54:20.358799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:39.707399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392080+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:54:20.392080+0000","last_peered":"2024-04-22T19:54:20.392080+0000","last_clean":"2024-04-22T19:54:20.392080+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:54:20.392080+0000","last_undegraded":"2024-04-22T19:54:20.392080+0000","last_fullsized":"2024-04-22T19:54:20.392080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392122+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:54:20.392122+0000","last_peered":"2024-04-22T19:54:20.392122+0000","last_clean":"2024-04-22T19:54:20.392122+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:54:20.392122+0000","last_undegraded":"2024-04-22T19:54:20.392122+0000","last_fullsized":"2024-04-22T19:54:20.392122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383147+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:54:20.383147+0000","last_peered":"2024-04-22T19:54:20.383147+0000","last_clean":"2024-04-22T19:54:20.383147+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:54:20.383147+0000","last_undegraded":"2024-04-22T19:54:20.383147+0000","last_fullsized":"2024-04-22T19:54:20.383147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406960+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:54:20.406960+0000","last_peered":"2024-04-22T19:54:20.406960+0000","last_clean":"2024-04-22T19:54:20.406960+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:54:20.406960+0000","last_undegraded":"2024-04-22T19:54:20.406960+0000","last_fullsized":"2024-04-22T19:54:20.406960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.072936+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:54:21.072936+0000","last_peered":"2024-04-22T19:54:21.072936+0000","last_clean":"2024-04-22T19:54:21.072936+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:54:21.072936+0000","last_undegraded":"2024-04-22T19:54:21.072936+0000","last_fullsized":"2024-04-22T19:54:21.072936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.650723+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:54:20.650723+0000","last_peered":"2024-04-22T19:54:20.650723+0000","last_clean":"2024-04-22T19:54:20.650723+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:54:20.650723+0000","last_undegraded":"2024-04-22T19:54:20.650723+0000","last_fullsized":"2024-04-22T19:54:20.650723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365077+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:54:20.365077+0000","last_peered":"2024-04-22T19:54:20.365077+0000","last_clean":"2024-04-22T19:54:20.365077+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:54:20.365077+0000","last_undegraded":"2024-04-22T19:54:20.365077+0000","last_fullsized":"2024-04-22T19:54:20.365077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362648+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:54:20.362648+0000","last_peered":"2024-04-22T19:54:20.362648+0000","last_clean":"2024-04-22T19:54:20.362648+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:54:20.362648+0000","last_undegraded":"2024-04-22T19:54:20.362648+0000","last_fullsized":"2024-04-22T19:54:20.362648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387196+0000","last_change":"2024-04-22T19:54:09.334166+0000","last_active":"2024-04-22T19:54:20.387196+0000","last_peered":"2024-04-22T19:54:20.387196+0000","last_clean":"2024-04-22T19:54:20.387196+0000","last_became_active":"2024-04-22T19:54:09.333460+0000","last_became_peered":"2024-04-22T19:54:09.333460+0000","last_unstale":"2024-04-22T19:54:20.387196+0000","last_undegraded":"2024-04-22T19:54:20.387196+0000","last_fullsized":"2024-04-22T19:54:20.387196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406411+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:54:20.406411+0000","last_peered":"2024-04-22T19:54:20.406411+0000","last_clean":"2024-04-22T19:54:20.406411+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:54:20.406411+0000","last_undegraded":"2024-04-22T19:54:20.406411+0000","last_fullsized":"2024-04-22T19:54:20.406411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.713721+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:54:20.713721+0000","last_peered":"2024-04-22T19:54:20.713721+0000","last_clean":"2024-04-22T19:54:20.713721+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:54:20.713721+0000","last_undegraded":"2024-04-22T19:54:20.713721+0000","last_fullsized":"2024-04-22T19:54:20.713721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.405990+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:54:20.405990+0000","last_peered":"2024-04-22T19:54:20.405990+0000","last_clean":"2024-04-22T19:54:20.405990+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:54:20.405990+0000","last_undegraded":"2024-04-22T19:54:20.405990+0000","last_fullsized":"2024-04-22T19:54:20.405990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377062+0000","last_change":"2024-04-22T19:54:19.378028+0000","last_active":"2024-04-22T19:54:20.377062+0000","last_peered":"2024-04-22T19:54:20.377062+0000","last_clean":"2024-04-22T19:54:20.377062+0000","last_became_active":"2024-04-22T19:54:19.377273+0000","last_became_peered":"2024-04-22T19:54:19.377273+0000","last_unstale":"2024-04-22T19:54:20.377062+0000","last_undegraded":"2024-04-22T19:54:20.377062+0000","last_fullsized":"2024-04-22T19:54:20.377062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:00.036846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358393+0000","last_change":"2024-04-22T19:54:11.349479+0000","last_active":"2024-04-22T19:54:20.358393+0000","last_peered":"2024-04-22T19:54:20.358393+0000","last_clean":"2024-04-22T19:54:20.358393+0000","last_became_active":"2024-04-22T19:54:11.347357+0000","last_became_peered":"2024-04-22T19:54:11.347357+0000","last_unstale":"2024-04-22T19:54:20.358393+0000","last_undegraded":"2024-04-22T19:54:20.358393+0000","last_fullsized":"2024-04-22T19:54:20.358393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358774+0000","last_change":"2024-04-22T19:54:09.326454+0000","last_active":"2024-04-22T19:54:20.358774+0000","last_peered":"2024-04-22T19:54:20.358774+0000","last_clean":"2024-04-22T19:54:20.358774+0000","last_became_active":"2024-04-22T19:54:09.326120+0000","last_became_peered":"2024-04-22T19:54:09.326120+0000","last_unstale":"2024-04-22T19:54:20.358774+0000","last_undegraded":"2024-04-22T19:54:20.358774+0000","last_fullsized":"2024-04-22T19:54:20.358774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407115+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:54:20.407115+0000","last_peered":"2024-04-22T19:54:20.407115+0000","last_clean":"2024-04-22T19:54:20.407115+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:54:20.407115+0000","last_undegraded":"2024-04-22T19:54:20.407115+0000","last_fullsized":"2024-04-22T19:54:20.407115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.213362+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:54:21.213362+0000","last_peered":"2024-04-22T19:54:21.213362+0000","last_clean":"2024-04-22T19:54:21.213362+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:54:21.213362+0000","last_undegraded":"2024-04-22T19:54:21.213362+0000","last_fullsized":"2024-04-22T19:54:21.213362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365600+0000","last_change":"2024-04-22T19:54:17.393342+0000","last_active":"2024-04-22T19:54:20.365600+0000","last_peered":"2024-04-22T19:54:20.365600+0000","last_clean":"2024-04-22T19:54:20.365600+0000","last_became_active":"2024-04-22T19:54:17.392114+0000","last_became_peered":"2024-04-22T19:54:17.392114+0000","last_unstale":"2024-04-22T19:54:20.365600+0000","last_undegraded":"2024-04-22T19:54:20.365600+0000","last_fullsized":"2024-04-22T19:54:20.365600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358507+0000","last_change":"2024-04-22T19:54:19.387476+0000","last_active":"2024-04-22T19:54:20.358507+0000","last_peered":"2024-04-22T19:54:20.358507+0000","last_clean":"2024-04-22T19:54:20.358507+0000","last_became_active":"2024-04-22T19:54:19.386778+0000","last_became_peered":"2024-04-22T19:54:19.386778+0000","last_unstale":"2024-04-22T19:54:20.358507+0000","last_undegraded":"2024-04-22T19:54:20.358507+0000","last_fullsized":"2024-04-22T19:54:20.358507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:46.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358409+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:54:20.358409+0000","last_peered":"2024-04-22T19:54:20.358409+0000","last_clean":"2024-04-22T19:54:20.358409+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:54:20.358409+0000","last_undegraded":"2024-04-22T19:54:20.358409+0000","last_fullsized":"2024-04-22T19:54:20.358409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392365+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:54:20.392365+0000","last_peered":"2024-04-22T19:54:20.392365+0000","last_clean":"2024-04-22T19:54:20.392365+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:54:20.392365+0000","last_undegraded":"2024-04-22T19:54:20.392365+0000","last_fullsized":"2024-04-22T19:54:20.392365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375937+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:54:20.375937+0000","last_peered":"2024-04-22T19:54:20.375937+0000","last_clean":"2024-04-22T19:54:20.375937+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:54:20.375937+0000","last_undegraded":"2024-04-22T19:54:20.375937+0000","last_fullsized":"2024-04-22T19:54:20.375937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.278456+0000","last_change":"2024-04-22T19:54:15.358926+0000","last_active":"2024-04-22T19:54:21.278456+0000","last_peered":"2024-04-22T19:54:21.278456+0000","last_clean":"2024-04-22T19:54:21.278456+0000","last_became_active":"2024-04-22T19:54:15.358167+0000","last_became_peered":"2024-04-22T19:54:15.358167+0000","last_unstale":"2024-04-22T19:54:21.278456+0000","last_undegraded":"2024-04-22T19:54:21.278456+0000","last_fullsized":"2024-04-22T19:54:21.278456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:07.130557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.646738+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:54:20.646738+0000","last_peered":"2024-04-22T19:54:20.646738+0000","last_clean":"2024-04-22T19:54:20.646738+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:54:20.646738+0000","last_undegraded":"2024-04-22T19:54:20.646738+0000","last_fullsized":"2024-04-22T19:54:20.646738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375407+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:54:20.375407+0000","last_peered":"2024-04-22T19:54:20.375407+0000","last_clean":"2024-04-22T19:54:20.375407+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:54:20.375407+0000","last_undegraded":"2024-04-22T19:54:20.375407+0000","last_fullsized":"2024-04-22T19:54:20.375407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358623+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:54:20.358623+0000","last_peered":"2024-04-22T19:54:20.358623+0000","last_clean":"2024-04-22T19:54:20.358623+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:54:20.358623+0000","last_undegraded":"2024-04-22T19:54:20.358623+0000","last_fullsized":"2024-04-22T19:54:20.358623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357210+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:54:20.357210+0000","last_peered":"2024-04-22T19:54:20.357210+0000","last_clean":"2024-04-22T19:54:20.357210+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:54:20.357210+0000","last_undegraded":"2024-04-22T19:54:20.357210+0000","last_fullsized":"2024-04-22T19:54:20.357210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386391+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:54:20.386391+0000","last_peered":"2024-04-22T19:54:20.386391+0000","last_clean":"2024-04-22T19:54:20.386391+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:54:20.386391+0000","last_undegraded":"2024-04-22T19:54:20.386391+0000","last_fullsized":"2024-04-22T19:54:20.386391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.078996+0000","last_change":"2024-04-22T19:54:15.374924+0000","last_active":"2024-04-22T19:54:21.078996+0000","last_peered":"2024-04-22T19:54:21.078996+0000","last_clean":"2024-04-22T19:54:21.078996+0000","last_became_active":"2024-04-22T19:54:15.374027+0000","last_became_peered":"2024-04-22T19:54:15.374027+0000","last_unstale":"2024-04-22T19:54:21.078996+0000","last_undegraded":"2024-04-22T19:54:21.078996+0000","last_fullsized":"2024-04-22T19:54:21.078996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:16.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.649662+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:54:20.649662+0000","last_peered":"2024-04-22T19:54:20.649662+0000","last_clean":"2024-04-22T19:54:20.649662+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:54:20.649662+0000","last_undegraded":"2024-04-22T19:54:20.649662+0000","last_fullsized":"2024-04-22T19:54:20.649662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357266+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:54:20.357266+0000","last_peered":"2024-04-22T19:54:20.357266+0000","last_clean":"2024-04-22T19:54:20.357266+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:54:20.357266+0000","last_undegraded":"2024-04-22T19:54:20.357266+0000","last_fullsized":"2024-04-22T19:54:20.357266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377217+0000","last_change":"2024-04-22T19:54:11.381492+0000","last_active":"2024-04-22T19:54:20.377217+0000","last_peered":"2024-04-22T19:54:20.377217+0000","last_clean":"2024-04-22T19:54:20.377217+0000","last_became_active":"2024-04-22T19:54:11.381006+0000","last_became_peered":"2024-04-22T19:54:11.381006+0000","last_unstale":"2024-04-22T19:54:20.377217+0000","last_undegraded":"2024-04-22T19:54:20.377217+0000","last_fullsized":"2024-04-22T19:54:20.377217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362690+0000","last_change":"2024-04-22T19:54:09.324349+0000","last_active":"2024-04-22T19:54:20.362690+0000","last_peered":"2024-04-22T19:54:20.362690+0000","last_clean":"2024-04-22T19:54:20.362690+0000","last_became_active":"2024-04-22T19:54:09.324055+0000","last_became_peered":"2024-04-22T19:54:09.324055+0000","last_unstale":"2024-04-22T19:54:20.362690+0000","last_undegraded":"2024-04-22T19:54:20.362690+0000","last_fullsized":"2024-04-22T19:54:20.362690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358358+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:54:20.358358+0000","last_peered":"2024-04-22T19:54:20.358358+0000","last_clean":"2024-04-22T19:54:20.358358+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:54:20.358358+0000","last_undegraded":"2024-04-22T19:54:20.358358+0000","last_fullsized":"2024-04-22T19:54:20.358358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.207031+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:54:21.207031+0000","last_peered":"2024-04-22T19:54:21.207031+0000","last_clean":"2024-04-22T19:54:21.207031+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:54:21.207031+0000","last_undegraded":"2024-04-22T19:54:21.207031+0000","last_fullsized":"2024-04-22T19:54:21.207031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391491+0000","last_change":"2024-04-22T19:54:17.394078+0000","last_active":"2024-04-22T19:54:20.391491+0000","last_peered":"2024-04-22T19:54:20.391491+0000","last_clean":"2024-04-22T19:54:20.391491+0000","last_became_active":"2024-04-22T19:54:17.393405+0000","last_became_peered":"2024-04-22T19:54:17.393405+0000","last_unstale":"2024-04-22T19:54:20.391491+0000","last_undegraded":"2024-04-22T19:54:20.391491+0000","last_fullsized":"2024-04-22T19:54:20.391491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:18.989391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375364+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:54:20.375364+0000","last_peered":"2024-04-22T19:54:20.375364+0000","last_clean":"2024-04-22T19:54:20.375364+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:54:20.375364+0000","last_undegraded":"2024-04-22T19:54:20.375364+0000","last_fullsized":"2024-04-22T19:54:20.375364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392467+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:54:20.392467+0000","last_peered":"2024-04-22T19:54:20.392467+0000","last_clean":"2024-04-22T19:54:20.392467+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:54:20.392467+0000","last_undegraded":"2024-04-22T19:54:20.392467+0000","last_fullsized":"2024-04-22T19:54:20.392467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380878+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:54:20.380878+0000","last_peered":"2024-04-22T19:54:20.380878+0000","last_clean":"2024-04-22T19:54:20.380878+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:54:20.380878+0000","last_undegraded":"2024-04-22T19:54:20.380878+0000","last_fullsized":"2024-04-22T19:54:20.380878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386524+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:54:20.386524+0000","last_peered":"2024-04-22T19:54:20.386524+0000","last_clean":"2024-04-22T19:54:20.386524+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:54:20.386524+0000","last_undegraded":"2024-04-22T19:54:20.386524+0000","last_fullsized":"2024-04-22T19:54:20.386524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359381+0000","last_change":"2024-04-22T19:54:09.342243+0000","last_active":"2024-04-22T19:54:20.359381+0000","last_peered":"2024-04-22T19:54:20.359381+0000","last_clean":"2024-04-22T19:54:20.359381+0000","last_became_active":"2024-04-22T19:54:09.341757+0000","last_became_peered":"2024-04-22T19:54:09.341757+0000","last_unstale":"2024-04-22T19:54:20.359381+0000","last_undegraded":"2024-04-22T19:54:20.359381+0000","last_fullsized":"2024-04-22T19:54:20.359381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.381792+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:54:20.381792+0000","last_peered":"2024-04-22T19:54:20.381792+0000","last_clean":"2024-04-22T19:54:20.381792+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:54:20.381792+0000","last_undegraded":"2024-04-22T19:54:20.381792+0000","last_fullsized":"2024-04-22T19:54:20.381792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.013406+0000","last_change":"2024-04-22T19:54:15.374361+0000","last_active":"2024-04-22T19:54:21.013406+0000","last_peered":"2024-04-22T19:54:21.013406+0000","last_clean":"2024-04-22T19:54:21.013406+0000","last_became_active":"2024-04-22T19:54:15.373665+0000","last_became_peered":"2024-04-22T19:54:15.373665+0000","last_unstale":"2024-04-22T19:54:21.013406+0000","last_undegraded":"2024-04-22T19:54:21.013406+0000","last_fullsized":"2024-04-22T19:54:21.013406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365189+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:54:20.365189+0000","last_peered":"2024-04-22T19:54:20.365189+0000","last_clean":"2024-04-22T19:54:20.365189+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:54:20.365189+0000","last_undegraded":"2024-04-22T19:54:20.365189+0000","last_fullsized":"2024-04-22T19:54:20.365189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391315+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:54:20.391315+0000","last_peered":"2024-04-22T19:54:20.391315+0000","last_clean":"2024-04-22T19:54:20.391315+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:54:20.391315+0000","last_undegraded":"2024-04-22T19:54:20.391315+0000","last_fullsized":"2024-04-22T19:54:20.391315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365519+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:54:20.365519+0000","last_peered":"2024-04-22T19:54:20.365519+0000","last_clean":"2024-04-22T19:54:20.365519+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:54:20.365519+0000","last_undegraded":"2024-04-22T19:54:20.365519+0000","last_fullsized":"2024-04-22T19:54:20.365519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380549+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:20.380549+0000","last_peered":"2024-04-22T19:54:20.380549+0000","last_clean":"2024-04-22T19:54:20.380549+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:54:20.380549+0000","last_undegraded":"2024-04-22T19:54:20.380549+0000","last_fullsized":"2024-04-22T19:54:20.380549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358334+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:54:20.358334+0000","last_peered":"2024-04-22T19:54:20.358334+0000","last_clean":"2024-04-22T19:54:20.358334+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:54:20.358334+0000","last_undegraded":"2024-04-22T19:54:20.358334+0000","last_fullsized":"2024-04-22T19:54:20.358334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387314+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:54:20.387314+0000","last_peered":"2024-04-22T19:54:20.387314+0000","last_clean":"2024-04-22T19:54:20.387314+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:54:20.387314+0000","last_undegraded":"2024-04-22T19:54:20.387314+0000","last_fullsized":"2024-04-22T19:54:20.387314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.194776+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:54:21.194776+0000","last_peered":"2024-04-22T19:54:21.194776+0000","last_clean":"2024-04-22T19:54:21.194776+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:54:21.194776+0000","last_undegraded":"2024-04-22T19:54:21.194776+0000","last_fullsized":"2024-04-22T19:54:21.194776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382375+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:54:20.382375+0000","last_peered":"2024-04-22T19:54:20.382375+0000","last_clean":"2024-04-22T19:54:20.382375+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:54:20.382375+0000","last_undegraded":"2024-04-22T19:54:20.382375+0000","last_fullsized":"2024-04-22T19:54:20.382375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375142+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:54:20.375142+0000","last_peered":"2024-04-22T19:54:20.375142+0000","last_clean":"2024-04-22T19:54:20.375142+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:54:20.375142+0000","last_undegraded":"2024-04-22T19:54:20.375142+0000","last_fullsized":"2024-04-22T19:54:20.375142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377443+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:54:20.377443+0000","last_peered":"2024-04-22T19:54:20.377443+0000","last_clean":"2024-04-22T19:54:20.377443+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:54:20.377443+0000","last_undegraded":"2024-04-22T19:54:20.377443+0000","last_fullsized":"2024-04-22T19:54:20.377443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406440+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:54:20.406440+0000","last_peered":"2024-04-22T19:54:20.406440+0000","last_clean":"2024-04-22T19:54:20.406440+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:54:20.406440+0000","last_undegraded":"2024-04-22T19:54:20.406440+0000","last_fullsized":"2024-04-22T19:54:20.406440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.374875+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:54:20.374875+0000","last_peered":"2024-04-22T19:54:20.374875+0000","last_clean":"2024-04-22T19:54:20.374875+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:54:20.374875+0000","last_undegraded":"2024-04-22T19:54:20.374875+0000","last_fullsized":"2024-04-22T19:54:20.374875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407797+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:54:20.407797+0000","last_peered":"2024-04-22T19:54:20.407797+0000","last_clean":"2024-04-22T19:54:20.407797+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:54:20.407797+0000","last_undegraded":"2024-04-22T19:54:20.407797+0000","last_fullsized":"2024-04-22T19:54:20.407797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.202796+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:54:21.202796+0000","last_peered":"2024-04-22T19:54:21.202796+0000","last_clean":"2024-04-22T19:54:21.202796+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:54:21.202796+0000","last_undegraded":"2024-04-22T19:54:21.202796+0000","last_fullsized":"2024-04-22T19:54:21.202796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362830+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:54:20.362830+0000","last_peered":"2024-04-22T19:54:20.362830+0000","last_clean":"2024-04-22T19:54:20.362830+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:54:20.362830+0000","last_undegraded":"2024-04-22T19:54:20.362830+0000","last_fullsized":"2024-04-22T19:54:20.362830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360291+0000","last_change":"2024-04-22T19:54:19.383707+0000","last_active":"2024-04-22T19:54:20.360291+0000","last_peered":"2024-04-22T19:54:20.360291+0000","last_clean":"2024-04-22T19:54:20.360291+0000","last_became_active":"2024-04-22T19:54:19.383071+0000","last_became_peered":"2024-04-22T19:54:19.383071+0000","last_unstale":"2024-04-22T19:54:20.360291+0000","last_undegraded":"2024-04-22T19:54:20.360291+0000","last_fullsized":"2024-04-22T19:54:20.360291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:25:04.464367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376173+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:54:20.376173+0000","last_peered":"2024-04-22T19:54:20.376173+0000","last_clean":"2024-04-22T19:54:20.376173+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:54:20.376173+0000","last_undegraded":"2024-04-22T19:54:20.376173+0000","last_fullsized":"2024-04-22T19:54:20.376173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386842+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:54:20.386842+0000","last_peered":"2024-04-22T19:54:20.386842+0000","last_clean":"2024-04-22T19:54:20.386842+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:54:20.386842+0000","last_undegraded":"2024-04-22T19:54:20.386842+0000","last_fullsized":"2024-04-22T19:54:20.386842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357301+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:54:20.357301+0000","last_peered":"2024-04-22T19:54:20.357301+0000","last_clean":"2024-04-22T19:54:20.357301+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:54:20.357301+0000","last_undegraded":"2024-04-22T19:54:20.357301+0000","last_fullsized":"2024-04-22T19:54:20.357301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363242+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:54:20.363242+0000","last_peered":"2024-04-22T19:54:20.363242+0000","last_clean":"2024-04-22T19:54:20.363242+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:54:20.363242+0000","last_undegraded":"2024-04-22T19:54:20.363242+0000","last_fullsized":"2024-04-22T19:54:20.363242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.045810+0000","last_change":"2024-04-22T19:54:15.366419+0000","last_active":"2024-04-22T19:54:21.045810+0000","last_peered":"2024-04-22T19:54:21.045810+0000","last_clean":"2024-04-22T19:54:21.045810+0000","last_became_active":"2024-04-22T19:54:15.365688+0000","last_became_peered":"2024-04-22T19:54:15.365688+0000","last_unstale":"2024-04-22T19:54:21.045810+0000","last_undegraded":"2024-04-22T19:54:21.045810+0000","last_fullsized":"2024-04-22T19:54:21.045810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392832+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:54:20.392832+0000","last_peered":"2024-04-22T19:54:20.392832+0000","last_clean":"2024-04-22T19:54:20.392832+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:54:20.392832+0000","last_undegraded":"2024-04-22T19:54:20.392832+0000","last_fullsized":"2024-04-22T19:54:20.392832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.384854+0000","last_change":"2024-04-22T19:54:19.386206+0000","last_active":"2024-04-22T19:54:20.384854+0000","last_peered":"2024-04-22T19:54:20.384854+0000","last_clean":"2024-04-22T19:54:20.384854+0000","last_became_active":"2024-04-22T19:54:19.383699+0000","last_became_peered":"2024-04-22T19:54:19.383699+0000","last_unstale":"2024-04-22T19:54:20.384854+0000","last_undegraded":"2024-04-22T19:54:20.384854+0000","last_fullsized":"2024-04-22T19:54:20.384854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.713155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375571+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:54:20.375571+0000","last_peered":"2024-04-22T19:54:20.375571+0000","last_clean":"2024-04-22T19:54:20.375571+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:54:20.375571+0000","last_undegraded":"2024-04-22T19:54:20.375571+0000","last_fullsized":"2024-04-22T19:54:20.375571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388949+0000","last_change":"2024-04-22T19:54:09.337813+0000","last_active":"2024-04-22T19:54:20.388949+0000","last_peered":"2024-04-22T19:54:20.388949+0000","last_clean":"2024-04-22T19:54:20.388949+0000","last_became_active":"2024-04-22T19:54:09.336677+0000","last_became_peered":"2024-04-22T19:54:09.336677+0000","last_unstale":"2024-04-22T19:54:20.388949+0000","last_undegraded":"2024-04-22T19:54:20.388949+0000","last_fullsized":"2024-04-22T19:54:20.388949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:51.697234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376555+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:54:20.376555+0000","last_peered":"2024-04-22T19:54:20.376555+0000","last_clean":"2024-04-22T19:54:20.376555+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:54:20.376555+0000","last_undegraded":"2024-04-22T19:54:20.376555+0000","last_fullsized":"2024-04-22T19:54:20.376555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362058+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:54:20.362058+0000","last_peered":"2024-04-22T19:54:20.362058+0000","last_clean":"2024-04-22T19:54:20.362058+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:54:20.362058+0000","last_undegraded":"2024-04-22T19:54:20.362058+0000","last_fullsized":"2024-04-22T19:54:20.362058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.131903+0000","last_change":"2024-04-22T19:54:15.373085+0000","last_active":"2024-04-22T19:54:21.131903+0000","last_peered":"2024-04-22T19:54:21.131903+0000","last_clean":"2024-04-22T19:54:21.131903+0000","last_became_active":"2024-04-22T19:54:15.372367+0000","last_became_peered":"2024-04-22T19:54:15.372367+0000","last_unstale":"2024-04-22T19:54:21.131903+0000","last_undegraded":"2024-04-22T19:54:21.131903+0000","last_fullsized":"2024-04-22T19:54:21.131903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356261+0000","last_change":"2024-04-22T19:54:17.388656+0000","last_active":"2024-04-22T19:54:20.356261+0000","last_peered":"2024-04-22T19:54:20.356261+0000","last_clean":"2024-04-22T19:54:20.356261+0000","last_became_active":"2024-04-22T19:54:17.387837+0000","last_became_peered":"2024-04-22T19:54:17.387837+0000","last_unstale":"2024-04-22T19:54:20.356261+0000","last_undegraded":"2024-04-22T19:54:20.356261+0000","last_fullsized":"2024-04-22T19:54:20.356261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362752+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:54:20.362752+0000","last_peered":"2024-04-22T19:54:20.362752+0000","last_clean":"2024-04-22T19:54:20.362752+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:54:20.362752+0000","last_undegraded":"2024-04-22T19:54:20.362752+0000","last_fullsized":"2024-04-22T19:54:20.362752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362602+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:54:20.362602+0000","last_peered":"2024-04-22T19:54:20.362602+0000","last_clean":"2024-04-22T19:54:20.362602+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:54:20.362602+0000","last_undegraded":"2024-04-22T19:54:20.362602+0000","last_fullsized":"2024-04-22T19:54:20.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376304+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:54:20.376304+0000","last_peered":"2024-04-22T19:54:20.376304+0000","last_clean":"2024-04-22T19:54:20.376304+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:54:20.376304+0000","last_undegraded":"2024-04-22T19:54:20.376304+0000","last_fullsized":"2024-04-22T19:54:20.376304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383431+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:54:20.383431+0000","last_peered":"2024-04-22T19:54:20.383431+0000","last_clean":"2024-04-22T19:54:20.383431+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:54:20.383431+0000","last_undegraded":"2024-04-22T19:54:20.383431+0000","last_fullsized":"2024-04-22T19:54:20.383431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391655+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:54:20.391655+0000","last_peered":"2024-04-22T19:54:20.391655+0000","last_clean":"2024-04-22T19:54:20.391655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:54:20.391655+0000","last_undegraded":"2024-04-22T19:54:20.391655+0000","last_fullsized":"2024-04-22T19:54:20.391655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.225364+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:54:21.225364+0000","last_peered":"2024-04-22T19:54:21.225364+0000","last_clean":"2024-04-22T19:54:21.225364+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:54:21.225364+0000","last_undegraded":"2024-04-22T19:54:21.225364+0000","last_fullsized":"2024-04-22T19:54:21.225364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.658312+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:54:20.658312+0000","last_peered":"2024-04-22T19:54:20.658312+0000","last_clean":"2024-04-22T19:54:20.658312+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:54:20.658312+0000","last_undegraded":"2024-04-22T19:54:20.658312+0000","last_fullsized":"2024-04-22T19:54:20.658312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.364069+0000","last_change":"2024-04-22T19:54:19.959246+0000","last_active":"2024-04-22T19:54:20.364069+0000","last_peered":"2024-04-22T19:54:20.364069+0000","last_clean":"2024-04-22T19:54:20.364069+0000","last_became_active":"2024-04-22T19:54:19.958416+0000","last_became_peered":"2024-04-22T19:54:19.958416+0000","last_unstale":"2024-04-22T19:54:20.364069+0000","last_undegraded":"2024-04-22T19:54:20.364069+0000","last_fullsized":"2024-04-22T19:54:20.364069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:36.008379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360004+0000","last_change":"2024-04-22T19:54:11.361967+0000","last_active":"2024-04-22T19:54:20.360004+0000","last_peered":"2024-04-22T19:54:20.360004+0000","last_clean":"2024-04-22T19:54:20.360004+0000","last_became_active":"2024-04-22T19:54:11.361431+0000","last_became_peered":"2024-04-22T19:54:11.361431+0000","last_unstale":"2024-04-22T19:54:20.360004+0000","last_undegraded":"2024-04-22T19:54:20.360004+0000","last_fullsized":"2024-04-22T19:54:20.360004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363179+0000","last_change":"2024-04-22T19:54:09.338528+0000","last_active":"2024-04-22T19:54:20.363179+0000","last_peered":"2024-04-22T19:54:20.363179+0000","last_clean":"2024-04-22T19:54:20.363179+0000","last_became_active":"2024-04-22T19:54:09.338299+0000","last_became_peered":"2024-04-22T19:54:09.338299+0000","last_unstale":"2024-04-22T19:54:20.363179+0000","last_undegraded":"2024-04-22T19:54:20.363179+0000","last_fullsized":"2024-04-22T19:54:20.363179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377085+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:54:20.377085+0000","last_peered":"2024-04-22T19:54:20.377085+0000","last_clean":"2024-04-22T19:54:20.377085+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:54:20.377085+0000","last_undegraded":"2024-04-22T19:54:20.377085+0000","last_fullsized":"2024-04-22T19:54:20.377085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356404+0000","last_change":"2024-04-22T19:54:13.347158+0000","last_active":"2024-04-22T19:54:20.356404+0000","last_peered":"2024-04-22T19:54:20.356404+0000","last_clean":"2024-04-22T19:54:20.356404+0000","last_became_active":"2024-04-22T19:54:13.346353+0000","last_became_peered":"2024-04-22T19:54:13.346353+0000","last_unstale":"2024-04-22T19:54:20.356404+0000","last_undegraded":"2024-04-22T19:54:20.356404+0000","last_fullsized":"2024-04-22T19:54:20.356404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.185747+0000","last_change":"2024-04-22T19:54:15.361224+0000","last_active":"2024-04-22T19:54:21.185747+0000","last_peered":"2024-04-22T19:54:21.185747+0000","last_clean":"2024-04-22T19:54:21.185747+0000","last_became_active":"2024-04-22T19:54:15.359915+0000","last_became_peered":"2024-04-22T19:54:15.359915+0000","last_unstale":"2024-04-22T19:54:21.185747+0000","last_undegraded":"2024-04-22T19:54:21.185747+0000","last_fullsized":"2024-04-22T19:54:21.185747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.645147+0000","last_change":"2024-04-22T19:54:17.386494+0000","last_active":"2024-04-22T19:54:20.645147+0000","last_peered":"2024-04-22T19:54:20.645147+0000","last_clean":"2024-04-22T19:54:20.645147+0000","last_became_active":"2024-04-22T19:54:17.385851+0000","last_became_peered":"2024-04-22T19:54:17.385851+0000","last_unstale":"2024-04-22T19:54:20.645147+0000","last_undegraded":"2024-04-22T19:54:20.645147+0000","last_fullsized":"2024-04-22T19:54:20.645147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:09.967672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363234+0000","last_change":"2024-04-22T19:54:19.376787+0000","last_active":"2024-04-22T19:54:20.363234+0000","last_peered":"2024-04-22T19:54:20.363234+0000","last_clean":"2024-04-22T19:54:20.363234+0000","last_became_active":"2024-04-22T19:54:19.375982+0000","last_became_peered":"2024-04-22T19:54:19.375982+0000","last_unstale":"2024-04-22T19:54:20.363234+0000","last_undegraded":"2024-04-22T19:54:20.363234+0000","last_fullsized":"2024-04-22T19:54:20.363234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:56:39.975385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356652+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:54:20.356652+0000","last_peered":"2024-04-22T19:54:20.356652+0000","last_clean":"2024-04-22T19:54:20.356652+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:54:20.356652+0000","last_undegraded":"2024-04-22T19:54:20.356652+0000","last_fullsized":"2024-04-22T19:54:20.356652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365928+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:54:20.365928+0000","last_peered":"2024-04-22T19:54:20.365928+0000","last_clean":"2024-04-22T19:54:20.365928+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:54:20.365928+0000","last_undegraded":"2024-04-22T19:54:20.365928+0000","last_fullsized":"2024-04-22T19:54:20.365928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.393232+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:54:20.393232+0000","last_peered":"2024-04-22T19:54:20.393232+0000","last_clean":"2024-04-22T19:54:20.393232+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:54:20.393232+0000","last_undegraded":"2024-04-22T19:54:20.393232+0000","last_fullsized":"2024-04-22T19:54:20.393232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359612+0000","last_change":"2024-04-22T19:54:13.351579+0000","last_active":"2024-04-22T19:54:20.359612+0000","last_peered":"2024-04-22T19:54:20.359612+0000","last_clean":"2024-04-22T19:54:20.359612+0000","last_became_active":"2024-04-22T19:54:13.350953+0000","last_became_peered":"2024-04-22T19:54:13.350953+0000","last_unstale":"2024-04-22T19:54:20.359612+0000","last_undegraded":"2024-04-22T19:54:20.359612+0000","last_fullsized":"2024-04-22T19:54:20.359612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:33.938710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.166600+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:54:21.166600+0000","last_peered":"2024-04-22T19:54:21.166600+0000","last_clean":"2024-04-22T19:54:21.166600+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:54:21.166600+0000","last_undegraded":"2024-04-22T19:54:21.166600+0000","last_fullsized":"2024-04-22T19:54:21.166600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358852+0000","last_change":"2024-04-22T19:54:17.374439+0000","last_active":"2024-04-22T19:54:20.358852+0000","last_peered":"2024-04-22T19:54:20.358852+0000","last_clean":"2024-04-22T19:54:20.358852+0000","last_became_active":"2024-04-22T19:54:17.373658+0000","last_became_peered":"2024-04-22T19:54:17.373658+0000","last_unstale":"2024-04-22T19:54:20.358852+0000","last_undegraded":"2024-04-22T19:54:20.358852+0000","last_fullsized":"2024-04-22T19:54:20.358852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:33.579486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387386+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:54:20.387386+0000","last_peered":"2024-04-22T19:54:20.387386+0000","last_clean":"2024-04-22T19:54:20.387386+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:54:20.387386+0000","last_undegraded":"2024-04-22T19:54:20.387386+0000","last_fullsized":"2024-04-22T19:54:20.387386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365418+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:54:20.365418+0000","last_peered":"2024-04-22T19:54:20.365418+0000","last_clean":"2024-04-22T19:54:20.365418+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:54:20.365418+0000","last_undegraded":"2024-04-22T19:54:20.365418+0000","last_fullsized":"2024-04-22T19:54:20.365418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356957+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:54:20.356957+0000","last_peered":"2024-04-22T19:54:20.356957+0000","last_clean":"2024-04-22T19:54:20.356957+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:54:20.356957+0000","last_undegraded":"2024-04-22T19:54:20.356957+0000","last_fullsized":"2024-04-22T19:54:20.356957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357636+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:54:20.357636+0000","last_peered":"2024-04-22T19:54:20.357636+0000","last_clean":"2024-04-22T19:54:20.357636+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:54:20.357636+0000","last_undegraded":"2024-04-22T19:54:20.357636+0000","last_fullsized":"2024-04-22T19:54:20.357636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375883+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:54:20.375883+0000","last_peered":"2024-04-22T19:54:20.375883+0000","last_clean":"2024-04-22T19:54:20.375883+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:54:20.375883+0000","last_undegraded":"2024-04-22T19:54:20.375883+0000","last_fullsized":"2024-04-22T19:54:20.375883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.231847+0000","last_change":"2024-04-22T19:54:15.364296+0000","last_active":"2024-04-22T19:54:21.231847+0000","last_peered":"2024-04-22T19:54:21.231847+0000","last_clean":"2024-04-22T19:54:21.231847+0000","last_became_active":"2024-04-22T19:54:15.363550+0000","last_became_peered":"2024-04-22T19:54:15.363550+0000","last_unstale":"2024-04-22T19:54:21.231847+0000","last_undegraded":"2024-04-22T19:54:21.231847+0000","last_fullsized":"2024-04-22T19:54:21.231847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358668+0000","last_change":"2024-04-22T19:54:17.387336+0000","last_active":"2024-04-22T19:54:20.358668+0000","last_peered":"2024-04-22T19:54:20.358668+0000","last_clean":"2024-04-22T19:54:20.358668+0000","last_became_active":"2024-04-22T19:54:17.386601+0000","last_became_peered":"2024-04-22T19:54:17.386601+0000","last_unstale":"2024-04-22T19:54:20.358668+0000","last_undegraded":"2024-04-22T19:54:20.358668+0000","last_fullsized":"2024-04-22T19:54:20.358668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:50.780788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359983+0000","last_change":"2024-04-22T19:54:19.389080+0000","last_active":"2024-04-22T19:54:20.359983+0000","last_peered":"2024-04-22T19:54:20.359983+0000","last_clean":"2024-04-22T19:54:20.359983+0000","last_became_active":"2024-04-22T19:54:19.388263+0000","last_became_peered":"2024-04-22T19:54:19.388263+0000","last_unstale":"2024-04-22T19:54:20.359983+0000","last_undegraded":"2024-04-22T19:54:20.359983+0000","last_fullsized":"2024-04-22T19:54:20.359983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:13:06.973763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375599+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:54:20.375599+0000","last_peered":"2024-04-22T19:54:20.375599+0000","last_clean":"2024-04-22T19:54:20.375599+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:54:20.375599+0000","last_undegraded":"2024-04-22T19:54:20.375599+0000","last_fullsized":"2024-04-22T19:54:20.375599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383083+0000","last_change":"2024-04-22T19:54:09.358724+0000","last_active":"2024-04-22T19:54:20.383083+0000","last_peered":"2024-04-22T19:54:20.383083+0000","last_clean":"2024-04-22T19:54:20.383083+0000","last_became_active":"2024-04-22T19:54:09.357161+0000","last_became_peered":"2024-04-22T19:54:09.357161+0000","last_unstale":"2024-04-22T19:54:20.383083+0000","last_undegraded":"2024-04-22T19:54:20.383083+0000","last_fullsized":"2024-04-22T19:54:20.383083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359668+0000","last_change":"2024-04-22T19:54:13.346921+0000","last_active":"2024-04-22T19:54:20.359668+0000","last_peered":"2024-04-22T19:54:20.359668+0000","last_clean":"2024-04-22T19:54:20.359668+0000","last_became_active":"2024-04-22T19:54:13.346460+0000","last_became_peered":"2024-04-22T19:54:13.346460+0000","last_unstale":"2024-04-22T19:54:20.359668+0000","last_undegraded":"2024-04-22T19:54:20.359668+0000","last_fullsized":"2024-04-22T19:54:20.359668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.718105+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:54:20.718105+0000","last_peered":"2024-04-22T19:54:20.718105+0000","last_clean":"2024-04-22T19:54:20.718105+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:54:20.718105+0000","last_undegraded":"2024-04-22T19:54:20.718105+0000","last_fullsized":"2024-04-22T19:54:20.718105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380611+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:54:20.380611+0000","last_peered":"2024-04-22T19:54:20.380611+0000","last_clean":"2024-04-22T19:54:20.380611+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:54:20.380611+0000","last_undegraded":"2024-04-22T19:54:20.380611+0000","last_fullsized":"2024-04-22T19:54:20.380611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363115+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:54:20.363115+0000","last_peered":"2024-04-22T19:54:20.363115+0000","last_clean":"2024-04-22T19:54:20.363115+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:54:20.363115+0000","last_undegraded":"2024-04-22T19:54:20.363115+0000","last_fullsized":"2024-04-22T19:54:20.363115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359406+0000","last_change":"2024-04-22T19:54:11.367199+0000","last_active":"2024-04-22T19:54:20.359406+0000","last_peered":"2024-04-22T19:54:20.359406+0000","last_clean":"2024-04-22T19:54:20.359406+0000","last_became_active":"2024-04-22T19:54:11.366927+0000","last_became_peered":"2024-04-22T19:54:11.366927+0000","last_unstale":"2024-04-22T19:54:20.359406+0000","last_undegraded":"2024-04-22T19:54:20.359406+0000","last_fullsized":"2024-04-22T19:54:20.359406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386841+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:54:20.386841+0000","last_peered":"2024-04-22T19:54:20.386841+0000","last_clean":"2024-04-22T19:54:20.386841+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:54:20.386841+0000","last_undegraded":"2024-04-22T19:54:20.386841+0000","last_fullsized":"2024-04-22T19:54:20.386841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.379892+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:54:20.379892+0000","last_peered":"2024-04-22T19:54:20.379892+0000","last_clean":"2024-04-22T19:54:20.379892+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:54:20.379892+0000","last_undegraded":"2024-04-22T19:54:20.379892+0000","last_fullsized":"2024-04-22T19:54:20.379892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.145944+0000","last_change":"2024-04-22T19:54:15.366428+0000","last_active":"2024-04-22T19:54:21.145944+0000","last_peered":"2024-04-22T19:54:21.145944+0000","last_clean":"2024-04-22T19:54:21.145944+0000","last_became_active":"2024-04-22T19:54:15.363037+0000","last_became_peered":"2024-04-22T19:54:15.363037+0000","last_unstale":"2024-04-22T19:54:21.145944+0000","last_undegraded":"2024-04-22T19:54:21.145944+0000","last_fullsized":"2024-04-22T19:54:21.145944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:57.305820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391508+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:54:20.391508+0000","last_peered":"2024-04-22T19:54:20.391508+0000","last_clean":"2024-04-22T19:54:20.391508+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:54:20.391508+0000","last_undegraded":"2024-04-22T19:54:20.391508+0000","last_fullsized":"2024-04-22T19:54:20.391508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385727+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:54:20.385727+0000","last_peered":"2024-04-22T19:54:20.385727+0000","last_clean":"2024-04-22T19:54:20.385727+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:54:20.385727+0000","last_undegraded":"2024-04-22T19:54:20.385727+0000","last_fullsized":"2024-04-22T19:54:20.385727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361936+0000","last_change":"2024-04-22T19:54:11.365937+0000","last_active":"2024-04-22T19:54:20.361936+0000","last_peered":"2024-04-22T19:54:20.361936+0000","last_clean":"2024-04-22T19:54:20.361936+0000","last_became_active":"2024-04-22T19:54:11.365569+0000","last_became_peered":"2024-04-22T19:54:11.365569+0000","last_unstale":"2024-04-22T19:54:20.361936+0000","last_undegraded":"2024-04-22T19:54:20.361936+0000","last_fullsized":"2024-04-22T19:54:20.361936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365857+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:54:20.365857+0000","last_peered":"2024-04-22T19:54:20.365857+0000","last_clean":"2024-04-22T19:54:20.365857+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:54:20.365857+0000","last_undegraded":"2024-04-22T19:54:20.365857+0000","last_fullsized":"2024-04-22T19:54:20.365857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391448+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:54:20.391448+0000","last_peered":"2024-04-22T19:54:20.391448+0000","last_clean":"2024-04-22T19:54:20.391448+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:54:20.391448+0000","last_undegraded":"2024-04-22T19:54:20.391448+0000","last_fullsized":"2024-04-22T19:54:20.391448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.931865+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:54:20.931865+0000","last_peered":"2024-04-22T19:54:20.931865+0000","last_clean":"2024-04-22T19:54:20.931865+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:54:20.931865+0000","last_undegraded":"2024-04-22T19:54:20.931865+0000","last_fullsized":"2024-04-22T19:54:20.931865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360275+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:54:20.360275+0000","last_peered":"2024-04-22T19:54:20.360275+0000","last_clean":"2024-04-22T19:54:20.360275+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:54:20.360275+0000","last_undegraded":"2024-04-22T19:54:20.360275+0000","last_fullsized":"2024-04-22T19:54:20.360275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.393090+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:54:20.393090+0000","last_peered":"2024-04-22T19:54:20.393090+0000","last_clean":"2024-04-22T19:54:20.393090+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:54:20.393090+0000","last_undegraded":"2024-04-22T19:54:20.393090+0000","last_fullsized":"2024-04-22T19:54:20.393090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362452+0000","last_change":"2024-04-22T19:54:09.326439+0000","last_active":"2024-04-22T19:54:20.362452+0000","last_peered":"2024-04-22T19:54:20.362452+0000","last_clean":"2024-04-22T19:54:20.362452+0000","last_became_active":"2024-04-22T19:54:09.326162+0000","last_became_peered":"2024-04-22T19:54:09.326162+0000","last_unstale":"2024-04-22T19:54:20.362452+0000","last_undegraded":"2024-04-22T19:54:20.362452+0000","last_fullsized":"2024-04-22T19:54:20.362452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365221+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:54:20.365221+0000","last_peered":"2024-04-22T19:54:20.365221+0000","last_clean":"2024-04-22T19:54:20.365221+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:54:20.365221+0000","last_undegraded":"2024-04-22T19:54:20.365221+0000","last_fullsized":"2024-04-22T19:54:20.365221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.258686+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:54:21.258686+0000","last_peered":"2024-04-22T19:54:21.258686+0000","last_clean":"2024-04-22T19:54:21.258686+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:54:21.258686+0000","last_undegraded":"2024-04-22T19:54:21.258686+0000","last_fullsized":"2024-04-22T19:54:21.258686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386194+0000","last_change":"2024-04-22T19:54:17.398926+0000","last_active":"2024-04-22T19:54:20.386194+0000","last_peered":"2024-04-22T19:54:20.386194+0000","last_clean":"2024-04-22T19:54:20.386194+0000","last_became_active":"2024-04-22T19:54:17.398270+0000","last_became_peered":"2024-04-22T19:54:17.398270+0000","last_unstale":"2024-04-22T19:54:20.386194+0000","last_undegraded":"2024-04-22T19:54:20.386194+0000","last_fullsized":"2024-04-22T19:54:20.386194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358900+0000","last_change":"2024-04-22T19:54:19.958725+0000","last_active":"2024-04-22T19:54:20.358900+0000","last_peered":"2024-04-22T19:54:20.358900+0000","last_clean":"2024-04-22T19:54:20.358900+0000","last_became_active":"2024-04-22T19:54:19.957923+0000","last_became_peered":"2024-04-22T19:54:19.957923+0000","last_unstale":"2024-04-22T19:54:20.358900+0000","last_undegraded":"2024-04-22T19:54:20.358900+0000","last_fullsized":"2024-04-22T19:54:20.358900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:06:47.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365513+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:54:20.365513+0000","last_peered":"2024-04-22T19:54:20.365513+0000","last_clean":"2024-04-22T19:54:20.365513+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:54:20.365513+0000","last_undegraded":"2024-04-22T19:54:20.365513+0000","last_fullsized":"2024-04-22T19:54:20.365513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375716+0000","last_change":"2024-04-22T19:54:09.323111+0000","last_active":"2024-04-22T19:54:20.375716+0000","last_peered":"2024-04-22T19:54:20.375716+0000","last_clean":"2024-04-22T19:54:20.375716+0000","last_became_active":"2024-04-22T19:54:09.322781+0000","last_became_peered":"2024-04-22T19:54:09.322781+0000","last_unstale":"2024-04-22T19:54:20.375716+0000","last_undegraded":"2024-04-22T19:54:20.375716+0000","last_fullsized":"2024-04-22T19:54:20.375716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392779+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:54:20.392779+0000","last_peered":"2024-04-22T19:54:20.392779+0000","last_clean":"2024-04-22T19:54:20.392779+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:54:20.392779+0000","last_undegraded":"2024-04-22T19:54:20.392779+0000","last_fullsized":"2024-04-22T19:54:20.392779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.053126+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:54:21.053126+0000","last_peered":"2024-04-22T19:54:21.053126+0000","last_clean":"2024-04-22T19:54:21.053126+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:54:21.053126+0000","last_undegraded":"2024-04-22T19:54:21.053126+0000","last_fullsized":"2024-04-22T19:54:21.053126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377118+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:54:20.377118+0000","last_peered":"2024-04-22T19:54:20.377118+0000","last_clean":"2024-04-22T19:54:20.377118+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:54:20.377118+0000","last_undegraded":"2024-04-22T19:54:20.377118+0000","last_fullsized":"2024-04-22T19:54:20.377118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391898+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:54:20.391898+0000","last_peered":"2024-04-22T19:54:20.391898+0000","last_clean":"2024-04-22T19:54:20.391898+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:54:20.391898+0000","last_undegraded":"2024-04-22T19:54:20.391898+0000","last_fullsized":"2024-04-22T19:54:20.391898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360295+0000","last_change":"2024-04-22T19:54:11.366363+0000","last_active":"2024-04-22T19:54:20.360295+0000","last_peered":"2024-04-22T19:54:20.360295+0000","last_clean":"2024-04-22T19:54:20.360295+0000","last_became_active":"2024-04-22T19:54:11.365682+0000","last_became_peered":"2024-04-22T19:54:11.365682+0000","last_unstale":"2024-04-22T19:54:20.360295+0000","last_undegraded":"2024-04-22T19:54:20.360295+0000","last_fullsized":"2024-04-22T19:54:20.360295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357625+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:54:20.357625+0000","last_peered":"2024-04-22T19:54:20.357625+0000","last_clean":"2024-04-22T19:54:20.357625+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:54:20.357625+0000","last_undegraded":"2024-04-22T19:54:20.357625+0000","last_fullsized":"2024-04-22T19:54:20.357625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358850+0000","last_change":"2024-04-22T19:54:13.347115+0000","last_active":"2024-04-22T19:54:20.358850+0000","last_peered":"2024-04-22T19:54:20.358850+0000","last_clean":"2024-04-22T19:54:20.358850+0000","last_became_active":"2024-04-22T19:54:13.346214+0000","last_became_peered":"2024-04-22T19:54:13.346214+0000","last_unstale":"2024-04-22T19:54:20.358850+0000","last_undegraded":"2024-04-22T19:54:20.358850+0000","last_fullsized":"2024-04-22T19:54:20.358850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.238171+0000","last_change":"2024-04-22T19:54:15.375428+0000","last_active":"2024-04-22T19:54:21.238171+0000","last_peered":"2024-04-22T19:54:21.238171+0000","last_clean":"2024-04-22T19:54:21.238171+0000","last_became_active":"2024-04-22T19:54:15.374863+0000","last_became_peered":"2024-04-22T19:54:15.374863+0000","last_unstale":"2024-04-22T19:54:21.238171+0000","last_undegraded":"2024-04-22T19:54:21.238171+0000","last_fullsized":"2024-04-22T19:54:21.238171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:56.025191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376572+0000","last_change":"2024-04-22T19:54:17.392924+0000","last_active":"2024-04-22T19:54:20.376572+0000","last_peered":"2024-04-22T19:54:20.376572+0000","last_clean":"2024-04-22T19:54:20.376572+0000","last_became_active":"2024-04-22T19:54:17.391991+0000","last_became_peered":"2024-04-22T19:54:17.391991+0000","last_unstale":"2024-04-22T19:54:20.376572+0000","last_undegraded":"2024-04-22T19:54:20.376572+0000","last_fullsized":"2024-04-22T19:54:20.376572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:47.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385221+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:54:20.385221+0000","last_peered":"2024-04-22T19:54:20.385221+0000","last_clean":"2024-04-22T19:54:20.385221+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:54:20.385221+0000","last_undegraded":"2024-04-22T19:54:20.385221+0000","last_fullsized":"2024-04-22T19:54:20.385221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407134+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:54:20.407134+0000","last_peered":"2024-04-22T19:54:20.407134+0000","last_clean":"2024-04-22T19:54:20.407134+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:54:20.407134+0000","last_undegraded":"2024-04-22T19:54:20.407134+0000","last_fullsized":"2024-04-22T19:54:20.407134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360340+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:54:20.360340+0000","last_peered":"2024-04-22T19:54:20.360340+0000","last_clean":"2024-04-22T19:54:20.360340+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:54:20.360340+0000","last_undegraded":"2024-04-22T19:54:20.360340+0000","last_fullsized":"2024-04-22T19:54:20.360340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377323+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:54:20.377323+0000","last_peered":"2024-04-22T19:54:20.377323+0000","last_clean":"2024-04-22T19:54:20.377323+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:54:20.377323+0000","last_undegraded":"2024-04-22T19:54:20.377323+0000","last_fullsized":"2024-04-22T19:54:20.377323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.219717+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:54:21.219717+0000","last_peered":"2024-04-22T19:54:21.219717+0000","last_clean":"2024-04-22T19:54:21.219717+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:54:21.219717+0000","last_undegraded":"2024-04-22T19:54:21.219717+0000","last_fullsized":"2024-04-22T19:54:21.219717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.649738+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:54:20.649738+0000","last_peered":"2024-04-22T19:54:20.649738+0000","last_clean":"2024-04-22T19:54:20.649738+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:54:20.649738+0000","last_undegraded":"2024-04-22T19:54:20.649738+0000","last_fullsized":"2024-04-22T19:54:20.649738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380258+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:54:20.380258+0000","last_peered":"2024-04-22T19:54:20.380258+0000","last_clean":"2024-04-22T19:54:20.380258+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:54:20.380258+0000","last_undegraded":"2024-04-22T19:54:20.380258+0000","last_fullsized":"2024-04-22T19:54:20.380258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356788+0000","last_change":"2024-04-22T19:54:11.345501+0000","last_active":"2024-04-22T19:54:20.356788+0000","last_peered":"2024-04-22T19:54:20.356788+0000","last_clean":"2024-04-22T19:54:20.356788+0000","last_became_active":"2024-04-22T19:54:11.342684+0000","last_became_peered":"2024-04-22T19:54:11.342684+0000","last_unstale":"2024-04-22T19:54:20.356788+0000","last_undegraded":"2024-04-22T19:54:20.356788+0000","last_fullsized":"2024-04-22T19:54:20.356788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386804+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:54:20.386804+0000","last_peered":"2024-04-22T19:54:20.386804+0000","last_clean":"2024-04-22T19:54:20.386804+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:54:20.386804+0000","last_undegraded":"2024-04-22T19:54:20.386804+0000","last_fullsized":"2024-04-22T19:54:20.386804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380730+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:54:20.380730+0000","last_peered":"2024-04-22T19:54:20.380730+0000","last_clean":"2024-04-22T19:54:20.380730+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:54:20.380730+0000","last_undegraded":"2024-04-22T19:54:20.380730+0000","last_fullsized":"2024-04-22T19:54:20.380730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:21.253048+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:54:21.253048+0000","last_peered":"2024-04-22T19:54:21.253048+0000","last_clean":"2024-04-22T19:54:21.253048+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:54:21.253048+0000","last_undegraded":"2024-04-22T19:54:21.253048+0000","last_fullsized":"2024-04-22T19:54:21.253048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357327+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:54:20.357327+0000","last_peered":"2024-04-22T19:54:20.357327+0000","last_clean":"2024-04-22T19:54:20.357327+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:54:20.357327+0000","last_undegraded":"2024-04-22T19:54:20.357327+0000","last_fullsized":"2024-04-22T19:54:20.357327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382595+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:54:20.382595+0000","last_peered":"2024-04-22T19:54:20.382595+0000","last_clean":"2024-04-22T19:54:20.382595+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:54:20.382595+0000","last_undegraded":"2024-04-22T19:54:20.382595+0000","last_fullsized":"2024-04-22T19:54:20.382595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357392+0000","last_change":"2024-04-22T19:54:11.349313+0000","last_active":"2024-04-22T19:54:20.357392+0000","last_peered":"2024-04-22T19:54:20.357392+0000","last_clean":"2024-04-22T19:54:20.357392+0000","last_became_active":"2024-04-22T19:54:11.346733+0000","last_became_peered":"2024-04-22T19:54:11.346733+0000","last_unstale":"2024-04-22T19:54:20.357392+0000","last_undegraded":"2024-04-22T19:54:20.357392+0000","last_fullsized":"2024-04-22T19:54:20.357392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.388816+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:54:20.388816+0000","last_peered":"2024-04-22T19:54:20.388816+0000","last_clean":"2024-04-22T19:54:20.388816+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:54:20.388816+0000","last_undegraded":"2024-04-22T19:54:20.388816+0000","last_fullsized":"2024-04-22T19:54:20.388816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386054+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:54:20.386054+0000","last_peered":"2024-04-22T19:54:20.386054+0000","last_clean":"2024-04-22T19:54:20.386054+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:54:20.386054+0000","last_undegraded":"2024-04-22T19:54:20.386054+0000","last_fullsized":"2024-04-22T19:54:20.386054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.671196+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:54:20.671196+0000","last_peered":"2024-04-22T19:54:20.671196+0000","last_clean":"2024-04-22T19:54:20.671196+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:54:20.671196+0000","last_undegraded":"2024-04-22T19:54:20.671196+0000","last_fullsized":"2024-04-22T19:54:20.671196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.391072+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:54:20.391072+0000","last_peered":"2024-04-22T19:54:20.391072+0000","last_clean":"2024-04-22T19:54:20.391072+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:54:20.391072+0000","last_undegraded":"2024-04-22T19:54:20.391072+0000","last_fullsized":"2024-04-22T19:54:20.391072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362734+0000","last_change":"2024-04-22T19:54:19.962442+0000","last_active":"2024-04-22T19:54:20.362734+0000","last_peered":"2024-04-22T19:54:20.362734+0000","last_clean":"2024-04-22T19:54:20.362734+0000","last_became_active":"2024-04-22T19:54:19.960324+0000","last_became_peered":"2024-04-22T19:54:19.960324+0000","last_unstale":"2024-04-22T19:54:20.362734+0000","last_undegraded":"2024-04-22T19:54:20.362734+0000","last_fullsized":"2024-04-22T19:54:20.362734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:28:38.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360000+0000","last_change":"2024-04-22T19:54:11.349398+0000","last_active":"2024-04-22T19:54:20.360000+0000","last_peered":"2024-04-22T19:54:20.360000+0000","last_clean":"2024-04-22T19:54:20.360000+0000","last_became_active":"2024-04-22T19:54:11.348383+0000","last_became_peered":"2024-04-22T19:54:11.348383+0000","last_unstale":"2024-04-22T19:54:20.360000+0000","last_undegraded":"2024-04-22T19:54:20.360000+0000","last_fullsized":"2024-04-22T19:54:20.360000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363284+0000","last_change":"2024-04-22T19:54:09.327427+0000","last_active":"2024-04-22T19:54:20.363284+0000","last_peered":"2024-04-22T19:54:20.363284+0000","last_clean":"2024-04-22T19:54:20.363284+0000","last_became_active":"2024-04-22T19:54:09.327146+0000","last_became_peered":"2024-04-22T19:54:09.327146+0000","last_unstale":"2024-04-22T19:54:20.363284+0000","last_undegraded":"2024-04-22T19:54:20.363284+0000","last_fullsized":"2024-04-22T19:54:20.363284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.355947+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:54:20.355947+0000","last_peered":"2024-04-22T19:54:20.355947+0000","last_clean":"2024-04-22T19:54:20.355947+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:54:20.355947+0000","last_undegraded":"2024-04-22T19:54:20.355947+0000","last_fullsized":"2024-04-22T19:54:20.355947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.887945+0000","last_change":"2024-04-22T19:54:15.367002+0000","last_active":"2024-04-22T19:54:20.887945+0000","last_peered":"2024-04-22T19:54:20.887945+0000","last_clean":"2024-04-22T19:54:20.887945+0000","last_became_active":"2024-04-22T19:54:15.363979+0000","last_became_peered":"2024-04-22T19:54:15.363979+0000","last_unstale":"2024-04-22T19:54:20.887945+0000","last_undegraded":"2024-04-22T19:54:20.887945+0000","last_fullsized":"2024-04-22T19:54:20.887945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356457+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:54:20.356457+0000","last_peered":"2024-04-22T19:54:20.356457+0000","last_clean":"2024-04-22T19:54:20.356457+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:54:20.356457+0000","last_undegraded":"2024-04-22T19:54:20.356457+0000","last_fullsized":"2024-04-22T19:54:20.356457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382757+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:54:20.382757+0000","last_peered":"2024-04-22T19:54:20.382757+0000","last_clean":"2024-04-22T19:54:20.382757+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:54:20.382757+0000","last_undegraded":"2024-04-22T19:54:20.382757+0000","last_fullsized":"2024-04-22T19:54:20.382757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.356384+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:54:20.356384+0000","last_peered":"2024-04-22T19:54:20.356384+0000","last_clean":"2024-04-22T19:54:20.356384+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:54:20.356384+0000","last_undegraded":"2024-04-22T19:54:20.356384+0000","last_fullsized":"2024-04-22T19:54:20.356384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365743+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:54:20.365743+0000","last_peered":"2024-04-22T19:54:20.365743+0000","last_clean":"2024-04-22T19:54:20.365743+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:54:20.365743+0000","last_undegraded":"2024-04-22T19:54:20.365743+0000","last_fullsized":"2024-04-22T19:54:20.365743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.374785+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:54:20.374785+0000","last_peered":"2024-04-22T19:54:20.374785+0000","last_clean":"2024-04-22T19:54:20.374785+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:54:20.374785+0000","last_undegraded":"2024-04-22T19:54:20.374785+0000","last_fullsized":"2024-04-22T19:54:20.374785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.952134+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:54:20.952134+0000","last_peered":"2024-04-22T19:54:20.952134+0000","last_clean":"2024-04-22T19:54:20.952134+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:54:20.952134+0000","last_undegraded":"2024-04-22T19:54:20.952134+0000","last_fullsized":"2024-04-22T19:54:20.952134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360060+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:54:20.360060+0000","last_peered":"2024-04-22T19:54:20.360060+0000","last_clean":"2024-04-22T19:54:20.360060+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:54:20.360060+0000","last_undegraded":"2024-04-22T19:54:20.360060+0000","last_fullsized":"2024-04-22T19:54:20.360060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359073+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:54:20.359073+0000","last_peered":"2024-04-22T19:54:20.359073+0000","last_clean":"2024-04-22T19:54:20.359073+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:54:20.359073+0000","last_undegraded":"2024-04-22T19:54:20.359073+0000","last_fullsized":"2024-04-22T19:54:20.359073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377326+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:54:20.377326+0000","last_peered":"2024-04-22T19:54:20.377326+0000","last_clean":"2024-04-22T19:54:20.377326+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:54:20.377326+0000","last_undegraded":"2024-04-22T19:54:20.377326+0000","last_fullsized":"2024-04-22T19:54:20.377326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390743+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:54:20.390743+0000","last_peered":"2024-04-22T19:54:20.390743+0000","last_clean":"2024-04-22T19:54:20.390743+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:54:20.390743+0000","last_undegraded":"2024-04-22T19:54:20.390743+0000","last_fullsized":"2024-04-22T19:54:20.390743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376850+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:54:20.376850+0000","last_peered":"2024-04-22T19:54:20.376850+0000","last_clean":"2024-04-22T19:54:20.376850+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:54:20.376850+0000","last_undegraded":"2024-04-22T19:54:20.376850+0000","last_fullsized":"2024-04-22T19:54:20.376850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.406106+0000","last_change":"2024-04-22T19:54:09.306173+0000","last_active":"2024-04-22T19:54:20.406106+0000","last_peered":"2024-04-22T19:54:20.406106+0000","last_clean":"2024-04-22T19:54:20.406106+0000","last_became_active":"2024-04-22T19:54:09.305320+0000","last_became_peered":"2024-04-22T19:54:09.305320+0000","last_unstale":"2024-04-22T19:54:20.406106+0000","last_undegraded":"2024-04-22T19:54:20.406106+0000","last_fullsized":"2024-04-22T19:54:20.406106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:57:15.632939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387978+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:54:20.387978+0000","last_peered":"2024-04-22T19:54:20.387978+0000","last_clean":"2024-04-22T19:54:20.387978+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:54:20.387978+0000","last_undegraded":"2024-04-22T19:54:20.387978+0000","last_fullsized":"2024-04-22T19:54:20.387978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386778+0000","last_change":"2024-04-22T19:54:09.327430+0000","last_active":"2024-04-22T19:54:20.386778+0000","last_peered":"2024-04-22T19:54:20.386778+0000","last_clean":"2024-04-22T19:54:20.386778+0000","last_became_active":"2024-04-22T19:54:09.326527+0000","last_became_peered":"2024-04-22T19:54:09.326527+0000","last_unstale":"2024-04-22T19:54:20.386778+0000","last_undegraded":"2024-04-22T19:54:20.386778+0000","last_fullsized":"2024-04-22T19:54:20.386778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.376427+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:54:20.376427+0000","last_peered":"2024-04-22T19:54:20.376427+0000","last_clean":"2024-04-22T19:54:20.376427+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:54:20.376427+0000","last_undegraded":"2024-04-22T19:54:20.376427+0000","last_fullsized":"2024-04-22T19:54:20.376427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360611+0000","last_change":"2024-04-22T19:54:09.326400+0000","last_active":"2024-04-22T19:54:20.360611+0000","last_peered":"2024-04-22T19:54:20.360611+0000","last_clean":"2024-04-22T19:54:20.360611+0000","last_became_active":"2024-04-22T19:54:09.326073+0000","last_became_peered":"2024-04-22T19:54:09.326073+0000","last_unstale":"2024-04-22T19:54:20.360611+0000","last_undegraded":"2024-04-22T19:54:20.360611+0000","last_fullsized":"2024-04-22T19:54:20.360611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360596+0000","last_change":"2024-04-22T19:54:11.376169+0000","last_active":"2024-04-22T19:54:20.360596+0000","last_peered":"2024-04-22T19:54:20.360596+0000","last_clean":"2024-04-22T19:54:20.360596+0000","last_became_active":"2024-04-22T19:54:11.367472+0000","last_became_peered":"2024-04-22T19:54:11.367472+0000","last_unstale":"2024-04-22T19:54:20.360596+0000","last_undegraded":"2024-04-22T19:54:20.360596+0000","last_fullsized":"2024-04-22T19:54:20.360596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.361069+0000","last_change":"2024-04-22T19:54:09.348783+0000","last_active":"2024-04-22T19:54:20.361069+0000","last_peered":"2024-04-22T19:54:20.361069+0000","last_clean":"2024-04-22T19:54:20.361069+0000","last_became_active":"2024-04-22T19:54:09.348404+0000","last_became_peered":"2024-04-22T19:54:09.348404+0000","last_unstale":"2024-04-22T19:54:20.361069+0000","last_undegraded":"2024-04-22T19:54:20.361069+0000","last_fullsized":"2024-04-22T19:54:20.361069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.357626+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:54:20.357626+0000","last_peered":"2024-04-22T19:54:20.357626+0000","last_clean":"2024-04-22T19:54:20.357626+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:54:20.357626+0000","last_undegraded":"2024-04-22T19:54:20.357626+0000","last_fullsized":"2024-04-22T19:54:20.357626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.377678+0000","last_change":"2024-04-22T19:54:09.323462+0000","last_active":"2024-04-22T19:54:20.377678+0000","last_peered":"2024-04-22T19:54:20.377678+0000","last_clean":"2024-04-22T19:54:20.377678+0000","last_became_active":"2024-04-22T19:54:09.323039+0000","last_became_peered":"2024-04-22T19:54:09.323039+0000","last_unstale":"2024-04-22T19:54:20.377678+0000","last_undegraded":"2024-04-22T19:54:20.377678+0000","last_fullsized":"2024-04-22T19:54:20.377678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359356+0000","last_change":"2024-04-22T19:54:11.361345+0000","last_active":"2024-04-22T19:54:20.359356+0000","last_peered":"2024-04-22T19:54:20.359356+0000","last_clean":"2024-04-22T19:54:20.359356+0000","last_became_active":"2024-04-22T19:54:11.360452+0000","last_became_peered":"2024-04-22T19:54:11.360452+0000","last_unstale":"2024-04-22T19:54:20.359356+0000","last_undegraded":"2024-04-22T19:54:20.359356+0000","last_fullsized":"2024-04-22T19:54:20.359356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392888+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:54:20.392888+0000","last_peered":"2024-04-22T19:54:20.392888+0000","last_clean":"2024-04-22T19:54:20.392888+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:54:20.392888+0000","last_undegraded":"2024-04-22T19:54:20.392888+0000","last_fullsized":"2024-04-22T19:54:20.392888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.390754+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:54:20.390754+0000","last_peered":"2024-04-22T19:54:20.390754+0000","last_clean":"2024-04-22T19:54:20.390754+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:54:20.390754+0000","last_undegraded":"2024-04-22T19:54:20.390754+0000","last_fullsized":"2024-04-22T19:54:20.390754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.363796+0000","last_change":"2024-04-22T19:54:09.347666+0000","last_active":"2024-04-22T19:54:20.363796+0000","last_peered":"2024-04-22T19:54:20.363796+0000","last_clean":"2024-04-22T19:54:20.363796+0000","last_became_active":"2024-04-22T19:54:09.347242+0000","last_became_peered":"2024-04-22T19:54:09.347242+0000","last_unstale":"2024-04-22T19:54:20.363796+0000","last_undegraded":"2024-04-22T19:54:20.363796+0000","last_fullsized":"2024-04-22T19:54:20.363796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365715+0000","last_change":"2024-04-22T19:54:11.350903+0000","last_active":"2024-04-22T19:54:20.365715+0000","last_peered":"2024-04-22T19:54:20.365715+0000","last_clean":"2024-04-22T19:54:20.365715+0000","last_became_active":"2024-04-22T19:54:11.350560+0000","last_became_peered":"2024-04-22T19:54:11.350560+0000","last_unstale":"2024-04-22T19:54:20.365715+0000","last_undegraded":"2024-04-22T19:54:20.365715+0000","last_fullsized":"2024-04-22T19:54:20.365715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385683+0000","last_change":"2024-04-22T19:54:09.337457+0000","last_active":"2024-04-22T19:54:20.385683+0000","last_peered":"2024-04-22T19:54:20.385683+0000","last_clean":"2024-04-22T19:54:20.385683+0000","last_became_active":"2024-04-22T19:54:09.336663+0000","last_became_peered":"2024-04-22T19:54:09.336663+0000","last_unstale":"2024-04-22T19:54:20.385683+0000","last_undegraded":"2024-04-22T19:54:20.385683+0000","last_fullsized":"2024-04-22T19:54:20.385683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358619+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:54:20.358619+0000","last_peered":"2024-04-22T19:54:20.358619+0000","last_clean":"2024-04-22T19:54:20.358619+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:54:20.358619+0000","last_undegraded":"2024-04-22T19:54:20.358619+0000","last_fullsized":"2024-04-22T19:54:20.358619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.360986+0000","last_change":"2024-04-22T19:54:09.347792+0000","last_active":"2024-04-22T19:54:20.360986+0000","last_peered":"2024-04-22T19:54:20.360986+0000","last_clean":"2024-04-22T19:54:20.360986+0000","last_became_active":"2024-04-22T19:54:09.347359+0000","last_became_peered":"2024-04-22T19:54:09.347359+0000","last_unstale":"2024-04-22T19:54:20.360986+0000","last_undegraded":"2024-04-22T19:54:20.360986+0000","last_fullsized":"2024-04-22T19:54:20.360986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.407349+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:54:20.407349+0000","last_peered":"2024-04-22T19:54:20.407349+0000","last_clean":"2024-04-22T19:54:20.407349+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:54:20.407349+0000","last_undegraded":"2024-04-22T19:54:20.407349+0000","last_fullsized":"2024-04-22T19:54:20.407349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386614+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:54:20.386614+0000","last_peered":"2024-04-22T19:54:20.386614+0000","last_clean":"2024-04-22T19:54:20.386614+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:54:20.386614+0000","last_undegraded":"2024-04-22T19:54:20.386614+0000","last_fullsized":"2024-04-22T19:54:20.386614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.358364+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:54:20.358364+0000","last_peered":"2024-04-22T19:54:20.358364+0000","last_clean":"2024-04-22T19:54:20.358364+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:54:20.358364+0000","last_undegraded":"2024-04-22T19:54:20.358364+0000","last_fullsized":"2024-04-22T19:54:20.358364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.362116+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:54:20.362116+0000","last_peered":"2024-04-22T19:54:20.362116+0000","last_clean":"2024-04-22T19:54:20.362116+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:54:20.362116+0000","last_undegraded":"2024-04-22T19:54:20.362116+0000","last_fullsized":"2024-04-22T19:54:20.362116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.382258+0000","last_change":"2024-04-22T19:54:11.386080+0000","last_active":"2024-04-22T19:54:20.382258+0000","last_peered":"2024-04-22T19:54:20.382258+0000","last_clean":"2024-04-22T19:54:20.382258+0000","last_became_active":"2024-04-22T19:54:11.385436+0000","last_became_peered":"2024-04-22T19:54:11.385436+0000","last_unstale":"2024-04-22T19:54:20.382258+0000","last_undegraded":"2024-04-22T19:54:20.382258+0000","last_fullsized":"2024-04-22T19:54:20.382258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.392683+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:54:20.392683+0000","last_peered":"2024-04-22T19:54:20.392683+0000","last_clean":"2024-04-22T19:54:20.392683+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:54:20.392683+0000","last_undegraded":"2024-04-22T19:54:20.392683+0000","last_fullsized":"2024-04-22T19:54:20.392683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359872+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:54:20.359872+0000","last_peered":"2024-04-22T19:54:20.359872+0000","last_clean":"2024-04-22T19:54:20.359872+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:54:20.359872+0000","last_undegraded":"2024-04-22T19:54:20.359872+0000","last_fullsized":"2024-04-22T19:54:20.359872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.383279+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:54:20.383279+0000","last_peered":"2024-04-22T19:54:20.383279+0000","last_clean":"2024-04-22T19:54:20.383279+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:54:20.383279+0000","last_undegraded":"2024-04-22T19:54:20.383279+0000","last_fullsized":"2024-04-22T19:54:20.383279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.359183+0000","last_change":"2024-04-22T19:54:11.347140+0000","last_active":"2024-04-22T19:54:20.359183+0000","last_peered":"2024-04-22T19:54:20.359183+0000","last_clean":"2024-04-22T19:54:20.359183+0000","last_became_active":"2024-04-22T19:54:11.345540+0000","last_became_peered":"2024-04-22T19:54:11.345540+0000","last_unstale":"2024-04-22T19:54:20.359183+0000","last_undegraded":"2024-04-22T19:54:20.359183+0000","last_fullsized":"2024-04-22T19:54:20.359183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.408081+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:54:20.408081+0000","last_peered":"2024-04-22T19:54:20.408081+0000","last_clean":"2024-04-22T19:54:20.408081+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:54:20.408081+0000","last_undegraded":"2024-04-22T19:54:20.408081+0000","last_fullsized":"2024-04-22T19:54:20.408081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.380282+0000","last_change":"2024-04-22T19:54:11.384243+0000","last_active":"2024-04-22T19:54:20.380282+0000","last_peered":"2024-04-22T19:54:20.380282+0000","last_clean":"2024-04-22T19:54:20.380282+0000","last_became_active":"2024-04-22T19:54:11.383676+0000","last_became_peered":"2024-04-22T19:54:11.383676+0000","last_unstale":"2024-04-22T19:54:20.380282+0000","last_undegraded":"2024-04-22T19:54:20.380282+0000","last_fullsized":"2024-04-22T19:54:20.380282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.387519+0000","last_change":"2024-04-22T19:54:09.341673+0000","last_active":"2024-04-22T19:54:20.387519+0000","last_peered":"2024-04-22T19:54:20.387519+0000","last_clean":"2024-04-22T19:54:20.387519+0000","last_became_active":"2024-04-22T19:54:09.340976+0000","last_became_peered":"2024-04-22T19:54:09.340976+0000","last_unstale":"2024-04-22T19:54:20.387519+0000","last_undegraded":"2024-04-22T19:54:20.387519+0000","last_fullsized":"2024-04-22T19:54:20.387519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:20.899786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.385432+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:54:20.385432+0000","last_peered":"2024-04-22T19:54:20.385432+0000","last_clean":"2024-04-22T19:54:20.385432+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:54:20.385432+0000","last_undegraded":"2024-04-22T19:54:20.385432+0000","last_fullsized":"2024-04-22T19:54:20.385432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.365524+0000","last_change":"2024-04-22T19:54:11.341482+0000","last_active":"2024-04-22T19:54:20.365524+0000","last_peered":"2024-04-22T19:54:20.365524+0000","last_clean":"2024-04-22T19:54:20.365524+0000","last_became_active":"2024-04-22T19:54:11.341075+0000","last_became_peered":"2024-04-22T19:54:11.341075+0000","last_unstale":"2024-04-22T19:54:20.365524+0000","last_undegraded":"2024-04-22T19:54:20.365524+0000","last_fullsized":"2024-04-22T19:54:20.365524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.375496+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:54:20.375496+0000","last_peered":"2024-04-22T19:54:20.375496+0000","last_clean":"2024-04-22T19:54:20.375496+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:54:20.375496+0000","last_undegraded":"2024-04-22T19:54:20.375496+0000","last_fullsized":"2024-04-22T19:54:20.375496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-22T19:54:20.386532+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:54:20.386532+0000","last_peered":"2024-04-22T19:54:20.386532+0000","last_clean":"2024-04-22T19:54:20.386532+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:54:20.386532+0000","last_undegraded":"2024-04-22T19:54:20.386532+0000","last_fullsized":"2024-04-22T19:54:20.386532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":750040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":158576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":160397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":158074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":159408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":159131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":158826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":749010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:54:27.738 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T19:54:27.739 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 32 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:fsid ac92bbc9-e567-4064-a7f4-2e610e35d3cc 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-04-22T19:53:42.573687+0000 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-04-22T19:54:20.347673+0000 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:crush_version 4 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:full_ratio 0.95 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:backfillfull_ratio 0.9 2024-04-22T19:54:28.078 INFO:teuthology.orchestra.run.smithi111.stdout:nearfull_ratio 0.85 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:require_min_compat_client luminous 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:min_compat_client jewel 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:require_osd_release squid 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:stretch_mode_enabled false 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-22T19:54:28.079 INFO:teuthology.orchestra.run.smithi111.stdout:max_osd 8 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6824/1848271487,v1:172.21.15.111:6825/1848271487] [v2:172.21.15.111:6826/1848271487,v1:172.21.15.111:6827/1848271487] exists,up 996ea3c2-f75d-41f0-9267-69befdc4ab4d 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6810/1193123721,v1:172.21.15.111:6813/1193123721] [v2:172.21.15.111:6816/1193123721,v1:172.21.15.111:6819/1193123721] exists,up 277fd7fa-608c-48e4-800d-c26294428dd8 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/2226119870,v1:172.21.15.111:6801/2226119870] [v2:172.21.15.111:6802/2226119870,v1:172.21.15.111:6803/2226119870] exists,up bac442e5-3a55-4562-8665-70da37ab5ff7 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6808/4032621477,v1:172.21.15.111:6809/4032621477] [v2:172.21.15.111:6811/4032621477,v1:172.21.15.111:6812/4032621477] exists,up 3195716c-c2fb-4f8d-916a-dc0525a8c456 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/1643232987,v1:172.21.15.138:6801/1643232987] [v2:172.21.15.138:6802/1643232987,v1:172.21.15.138:6803/1643232987] exists,up cbf466e6-386f-4838-ad24-52702ac92370 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/1294966407,v1:172.21.15.138:6809/1294966407] [v2:172.21.15.138:6810/1294966407,v1:172.21.15.138:6811/1294966407] exists,up 5813db8d-fb71-4489-af1f-2e8223206f66 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6824/2579086149,v1:172.21.15.138:6825/2579086149] [v2:172.21.15.138:6826/2579086149,v1:172.21.15.138:6827/2579086149] exists,up 4117bfb9-ad8e-4b51-a9e0-f858a7402a5b 2024-04-22T19:54:28.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6816/1077004569,v1:172.21.15.138:6817/1077004569] [v2:172.21.15.138:6818/1077004569,v1:172.21.15.138:6819/1077004569] exists,up a91542a5-1ccd-4fb1-95be-7d51aa24f193 2024-04-22T19:54:28.096 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6824/1848271487,v1:172.21.15.111:6825/1848271487] [v2:172.21.15.111:6826/1848271487,v1:172.21.15.111:6827/1848271487] exists,up 996ea3c2-f75d-41f0-9267-69befdc4ab4d', 'osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6810/1193123721,v1:172.21.15.111:6813/1193123721] [v2:172.21.15.111:6816/1193123721,v1:172.21.15.111:6819/1193123721] exists,up 277fd7fa-608c-48e4-800d-c26294428dd8', 'osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/2226119870,v1:172.21.15.111:6801/2226119870] [v2:172.21.15.111:6802/2226119870,v1:172.21.15.111:6803/2226119870] exists,up bac442e5-3a55-4562-8665-70da37ab5ff7', 'osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6808/4032621477,v1:172.21.15.111:6809/4032621477] [v2:172.21.15.111:6811/4032621477,v1:172.21.15.111:6812/4032621477] exists,up 3195716c-c2fb-4f8d-916a-dc0525a8c456', 'osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/1643232987,v1:172.21.15.138:6801/1643232987] [v2:172.21.15.138:6802/1643232987,v1:172.21.15.138:6803/1643232987] exists,up cbf466e6-386f-4838-ad24-52702ac92370', 'osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/1294966407,v1:172.21.15.138:6809/1294966407] [v2:172.21.15.138:6810/1294966407,v1:172.21.15.138:6811/1294966407] exists,up 5813db8d-fb71-4489-af1f-2e8223206f66', 'osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6824/2579086149,v1:172.21.15.138:6825/2579086149] [v2:172.21.15.138:6826/2579086149,v1:172.21.15.138:6827/2579086149] exists,up 4117bfb9-ad8e-4b51-a9e0-f858a7402a5b', 'osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6816/1077004569,v1:172.21.15.138:6817/1077004569] [v2:172.21.15.138:6818/1077004569,v1:172.21.15.138:6819/1077004569] exists,up a91542a5-1ccd-4fb1-95be-7d51aa24f193'] 2024-04-22T19:54:28.096 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-22T19:54:28.213 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:28.213 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "mon.a", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster": "ceph", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "admin_socket_mode": "", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_client_required": "cephx, none", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_cluster_required": "cephx", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_debug": "true", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_service_required": "cephx", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-22T19:54:28.214 INFO:teuthology.orchestra.run.smithi111.stdout: "auth_supported": "cephx", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_aio": "true", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_aio_poll_ms": "250", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_aio_reap_max": "16", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_async_discard_threads": "0", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_block_size": "4096", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_debug_aio": "false", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_debug_inflight_ios": "false", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_enable_discard": "false", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_flock_retry": "3", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-22T19:54:28.215 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_inject_crash": "0", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_ioring": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_ioring_hipri": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bdev_type": "", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_alloc_size": "1048576", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_allocator": "hybrid", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_buffered_io": "true", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_check_for_zeros": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-22T19:54:28.216 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_compact_log_sync": "false", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_max_log_runway": "4194304", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_max_prefetch": "1048576", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_min_flush_size": "524288", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_min_log_runway": "1048576", 2024-04-22T19:54:28.217 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_replay_recovery": "false", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_sync_write": "false", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_allocation_from_file": "true", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_allocator": "hybrid", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-22T19:54:28.218 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_create": "true", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_db_create": "false", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_db_path": "", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_db_size": "0", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_path": "", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_preallocate_file": "false", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_size": "107374182400", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_wal_create": "false", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_wal_path": "", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_block_wal_size": "100663296", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bluefs": "true", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-22T19:54:28.219 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_autotune": "true", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-22T19:54:28.220 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_size": "0", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_type": "2q", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_clone_cow": "true", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-22T19:54:28.221 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_mode": "none", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_csum_type": "crc32c", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_freelist": "false", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-22T19:54:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_small_allocations": "0", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_default_buffered_read": "true", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_default_buffered_write": "false", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-22T19:54:28.223 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fail_eio": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_mount": "false", 2024-04-22T19:54:28.224 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_umount": "false", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_ignore_data_csum": "false", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-22T19:54:28.225 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_log_op_age": "5.000000", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_alloc_size": "0", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_blob_size": "0", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_max_deferred_txc": "32", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_min_alloc_size": "0", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_nid_prealloc": "1024", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-22T19:54:28.226 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_retry_disk_reads": "3", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_rocksdb_cf": "true", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_spdk_mem": "512", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-22T19:54:28.227 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_tracing": "false", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-22T19:54:28.228 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_zero_block_detection": "false", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-22T19:54:28.229 INFO:teuthology.orchestra.run.smithi111.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_cluster_require_signatures": "false", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_cluster_require_version": "2", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_require_signatures": "false", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_require_version": "2", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_service_require_signatures": "false", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_service_require_version": "2", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cephx_sign_messages": "true", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "chdir": "", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_acl_type": "", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_asio_thread_count": "2", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_cache_mid": "0.750000", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_cache_size": "16384", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_caps_release_delay": "5", 2024-04-22T19:54:28.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_check_pool_perm": "true", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_debug_force_sync_read": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_debug_getattr_caps": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_debug_inject_tick_delay": "0", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_die_on_failed_remount": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_dirsize_rbytes": "true", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_force_lazyio": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_fs": "", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_inject_release_failure": "false", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_max_inline_size": "4096", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_mds_namespace": "", 2024-04-22T19:54:28.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_metadata": "", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_mount_gid": "-1", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_mount_timeout": "300", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_mount_uid": "-1", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_mountpoint": "/", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_notify_timeout": "10", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc": "true", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc_max_dirty": "104857600", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc_max_objects": "1000", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc_size": "209715200", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_oc_target_dirty": "8388608", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_permissions": "true", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_quota": "true", 2024-04-22T19:54:28.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_quota_df": "true", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_readahead_max_bytes": "0", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_readahead_max_periods": "4", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_readahead_min": "131072", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_reconnect_stale": "false", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_shutdown_timeout": "30", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_snapdir": ".snap", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_tick_interval": "1", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_trace": "", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_try_dentry_invalidate": "false", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_use_faked_inos": "false", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_use_random_mds": "false", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_graylog": "false", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_graylog_port": "12201", 2024-04-22T19:54:28.233 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_monitors": "default=true", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_syslog": "false", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "clog_to_syslog_level": "info", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "-", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_network": "", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_network_interface": "", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "compressor_zlib_isal": "false", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "compressor_zlib_level": "5", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "compressor_zlib_winsize": "-15", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "compressor_zstd_level": "1", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_alien_op_num_threads": "6", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-22T19:54:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_osd_stat_interval": "0", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crimson_seastar_cpu_cores": "", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_location": "", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_location_hook": "", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_location_hook_timeout": "10", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "daemonize": "false", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "daos_pool": "tank", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_alienstore": "0/5", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_allow_any_pool_priority": "false", 2024-04-22T19:54:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_asok": "1/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_asok_assert_abort": "false", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_asserts_on_shutdown": "true", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_auth": "20/20", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_bdev": "1/3", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_bluefs": "1/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_bluestore": "1/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_buffer": "0/1", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_ceph_exporter": "1/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_cephfs_mirror": "0/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_cephsqlite": "0/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_client": "0/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_compressor": "1/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_context": "0/1", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_crimson_interrupt": "0/5", 2024-04-22T19:54:28.236 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_crush": "1/1", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_crypto": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_cyanstore": "0/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_deliberately_leak_memory": "false", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_disable_randomized_ping": "false", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_dpdk": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_eventtrace": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_filer": "0/1", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_filestore": "1/3", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_finisher": "1/1", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_fuse": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_heartbeat_testing_span": "0", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_heartbeatmap": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_javaclient": "1/5", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_journal": "1/3", 2024-04-22T19:54:28.237 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_journaler": "0/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_kstore": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_lockdep": "0/1", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mclock": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_balancer": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_locker": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_log": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_log_expire": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_migrator": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mds_quiesce": "3/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_memstore": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mgr": "2/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mgrc": "1/5", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_mon": "20/20", 2024-04-22T19:54:28.238 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_monc": "0/10", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_ms": "1/1", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_none": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_objclass": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_objectcacher": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_objecter": "0/1", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_optracker": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_osd": "1/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_paxos": "20/20", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_perfcounter": "1/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_prioritycache": "1/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rados": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rbd": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rbd_mirror": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rbd_pwl": "0/5", 2024-04-22T19:54:28.239 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rbd_replay": "0/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_refs": "0/0", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_reserver": "1/1", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_access": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_datacache": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_dbstore": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_flight": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_notification": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rgw_sync": "1/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_rocksdb": "4/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore": "0/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_backref": "0/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_cache": "0/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_cleaner": "0/5", 2024-04-22T19:54:28.240 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_device": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_epm": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_journal": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_lba": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_odata": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_omap": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_onode": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_t": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_seastore_tm": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_striper": "0/1", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_test": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_throttle": "1/1", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_timer": "0/1", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_tp": "0/5", 2024-04-22T19:54:28.241 INFO:teuthology.orchestra.run.smithi111.stdout: "debug_trace": "1/5", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "device_failure_prediction_mode": "none", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "err_to_graylog": "false", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "err_to_journald": "false", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "err_to_stderr": "true", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "err_to_syslog": "false", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event_tracing": "false", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_addr": "0.0.0.0", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_http_port": "9926", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_prio_limit": "5", 2024-04-22T19:54:28.242 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_sort_metrics": "true", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "exporter_stats_period": "5", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "fake_statfs_for_testing": "0", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "fatal_signal_handlers": "true", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filer_max_purge_ops": "10", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filer_max_truncate_ops": "128", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_apply_finisher_threads": "1", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_blackhole": "false", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_btrfs_clone_range": "true", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_btrfs_snap": "true", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_caller_concurrency": "10", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_collect_device_partition_information": "true", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_commit_timeout": "600.000000", 2024-04-22T19:54:28.243 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_debug_inject_read_err": "false", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_debug_omap_check": "false", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_debug_verify_split": "false", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_dump_file": "", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fadvise": "true", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fail_eio": "true", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fd_cache_shards": "16", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fd_cache_size": "128", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fiemap": "false", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fiemap_threshold": "4096", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_inject_stall": "0", 2024-04-22T19:54:28.244 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_journal_parallel": "false", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_journal_trailing": "false", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_journal_writeahead": "false", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_kill_at": "0", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattrs": "0", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-22T19:54:28.245 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_xattr_value_size": "0", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_merge_threshold": "-10", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_odsync_write": "false", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_omap_backend": "rocksdb", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_omap_backend_path": "", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_op_thread_timeout": "60", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_op_threads": "2", 2024-04-22T19:54:28.246 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_punch_hole": "false", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_queue_max_ops": "50", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_seek_data_hole": "false", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_sloppy_crc": "false", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-22T19:54:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_splice": "false", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_split_multiple": "2", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_split_rand_factor": "20", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_update_to": "1000", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_enable": "true", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-22T19:54:28.248 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_xfs_extsize": "false", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "filestore_zfs_snap": "false", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fio_dir": "/tmp/fio", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fsid": "ac92bbc9-e567-4064-a7f4-2e610e35d3cc", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_allow_other": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_atomic_o_trunc": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_big_writes": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_debug": "false", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_default_permissions": "false", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_disable_pagecache": "false", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_max_write": "0", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_multithreaded": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_require_active_mds": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_set_user_groups": "true", 2024-04-22T19:54:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_splice_move": "true", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_splice_read": "true", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_splice_write": "true", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "fuse_use_invalidate_cb": "true", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "gss_target_name": "ceph", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_file": "", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_inject_failure": "0", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_interval": "5", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "host": "smithi111", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-22T19:54:28.250 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "inject_early_sigterm": "false", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "jaeger_agent_port": "6799", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "jaeger_tracing_enable": "false", 2024-04-22T19:54:28.251 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_aio": "true", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_align_min_size": "65536", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_block_align": "true", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_block_size": "4096", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_dio": "true", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_discard": "false", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_force_aio": "false", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_ignore_corruption": "false", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_max_write_bytes": "10485760", 2024-04-22T19:54:28.252 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_max_write_entries": "100", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_replay_from": "0", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_write_header_frequency": "0", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journal_zero_on_create": "false", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journaler_prefetch_periods": "10", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journaler_prezero_periods": "5", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "journaler_write_head_interval": "15", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "keyfile": "", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_backend": "rocksdb", 2024-04-22T19:54:28.253 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_default_stripe_size": "65536", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_fsck_on_mount": "false", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_max_bytes": "67108864", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_max_ops": "512", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_nid_prealloc": "1024", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_onode_map_size": "1024", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_sync_submit_transaction": "false", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "kstore_sync_transaction": "false", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "librados_thread_count": "2", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "lockdep": "false", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "lockdep_force_backtrace": "false", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "log_coarse_timestamps": "true", 2024-04-22T19:54:28.254 INFO:teuthology.orchestra.run.smithi111.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_flush_on_exit": "false", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_graylog_host": "127.0.0.1", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_graylog_port": "12201", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_max_new": "1000", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_max_recent": "10000", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_stderr_prefix": "", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_stop_at_utilization": "0.970000", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_to_file": "true", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_to_graylog": "false", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_to_journald": "false", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_to_stderr": "false", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "log_to_syslog": "false", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "max_rotating_auth_attempts": "10", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-22T19:54:28.255 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_action_on_write_error": "1", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_alternate_name_max": "8192", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_asio_thread_count": "2", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_export_pin": "true", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_fragment_dirs": "true", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_fragment_interval": "5", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_interval": "10", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_max": "-1", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_max_until": "-1", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_merge_size": "50", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_midchunk": "0.300000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_min_start": "0.200000", 2024-04-22T19:54:28.256 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_minchunk": "0.001000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_mode": "0", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_need_max": "1.200000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_need_min": "0.800000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_overload_epochs": "2", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_split_bits": "3", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_split_size": "10000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_target_decay": "10.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_beacon_grace": "15.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_beacon_interval": "4.000000", 2024-04-22T19:54:28.257 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_mid": "0.700000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_quiesce_delay": "0", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_release_free_interval": "10", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_reservation": "0.050000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_trim_interval": "1", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache_trim_threshold": "262144", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-22T19:54:28.258 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_client_prealloc_inos": "1000", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_connect_bootstrapping": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_damage_table_max_entries": "10000", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_debug_auth_pins": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_debug_frag": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_debug_scatterstat": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_debug_subtrees": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_decay_halflife": "5.000000", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_default_dir_hash": "2", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_defer_session_stale": "true", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_deny_all_reconnect": "false", 2024-04-22T19:54:28.259 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dir_keys_per_op": "16384", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dir_max_commit_size": "10", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dir_max_entries": "0", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dir_prefetch": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dump_cache_on_map": "false", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_early_reply": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_enable_op_tracker": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_enforce_unique_name": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_export_ephemeral_random": "true", 2024-04-22T19:54:28.260 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_health_summarize_threshold": "10", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_health_dummy": "false", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_migrator_session_race": "false", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-22T19:54:28.261 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_join_fs": "", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_journal_format": "1", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_create_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_export_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_import_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_journal_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_journal_expire_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_journal_replay_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_link_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_mdstable_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_openc_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_rename_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_shutdown_at": "0", 2024-04-22T19:54:28.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_event_large_threshold": "524288", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_events_per_segment": "1024", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_max_events": "-1", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_max_segments": "128", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_pause": "false", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_segment_size": "0", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_trim_threshold": "128", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log_warn_factor": "2.000000", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_caps_per_client": "1048576", 2024-04-22T19:54:28.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_completed_flushes": "100000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_completed_requests": "100000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_export_size": "20971520", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_file_recover": "32", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_purge_files": "64", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_purge_ops": "8192", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_max_snaps_per_dir": "100", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_metrics_update_interval": "2", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_min_caps_per_client": "100", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_min_caps_working_set": "10000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_numa_node": "-1", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_complaint_time": "30.000000", 2024-04-22T19:54:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_history_duration": "600", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_history_size": "20", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_history_slow_op_size": "20", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_op_log_threshold": "5", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_ping_grace": "15", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_ping_interval": "5", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_max_caps": "30000", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_recall_warning_threshold": "262144", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-22T19:54:28.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_replay_interval": "1.000000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_root_ino_gid": "0", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_root_ino_uid": "0", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-22T19:54:28.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_shutdown_check": "0", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_skip_ino": "0", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_snap_max_uid": "4294967294", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_snap_min_uid": "0", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_snap_rstat": "false", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_standby_replay_damaged": "false", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_symlink_recovery": "true", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_thrash_exports": "0", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_thrash_fragments": "0", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_tick_interval": "5.000000", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_valgrind_exit": "false", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_verify_backtrace": "1", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_verify_scatter": "false", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-22T19:54:28.267 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_wipe_sessions": "false", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mempool_debug": "false", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "memstore_device_bytes": "1073741824", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "memstore_page_set": "false", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "memstore_page_size": "65536", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_client_bytes": "134217728", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_client_messages": "512", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_disabled_modules": "", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_max_pg_creating": "1024", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_max_pg_num_change": "128", 2024-04-22T19:54:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_mds_bytes": "134217728", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_mds_messages": "128", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_mon_bytes": "134217728", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_mon_messages": "128", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_osd_bytes": "536870912", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_osd_messages": "8192", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_pool": "true", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_standby_modules": "true", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_stats_period": "5", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_stats_threshold": "5", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_tick_period": "2", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-22T19:54:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_allow_pool_delete": "true", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_allow_pool_size_one": "true", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_auth_validate_all_caps": "true", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_bytes": "104857600", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_directed_command_retry": "2", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-22T19:54:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_hunt_parallel": "3", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_log_interval": "1.000000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_ping_interval": "10.000000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_client_target_rank": "-1", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_level": "debug", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_file": "true", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_journald": "false", 2024-04-22T19:54:28.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_compact_on_bootstrap": "false", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_compact_on_start": "false", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_compact_on_trim": "true", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_cpu_threads": "4", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_crush_min_required_version": "hammer", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_daemon_bytes": "419430400", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-22T19:54:28.272 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_data_avail_crit": "5", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_data_avail_warn": "5", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_data_size_warn": "16106127360", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_dump_json": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_dump_transactions": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_extra_checks": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_no_require_reef": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_no_require_squid": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-22T19:54:28.273 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_down_mkfs_grace": "120", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_down_uptime_grace": "60", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_election_default_strategy": "1", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_election_timeout": "5.000000", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_elector_ping_divisor": "2", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_enable_op_tracker": "true", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_fake_pool_delete": "false", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_force_quorum_join": "false", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_globalid_prealloc": "10000", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_detail_to_clog": "false", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_log_update_period": "5", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_max_detail": "50", 2024-04-22T19:54:28.274 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_to_clog": "true", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_to_clog_interval": "600", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_host": "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.138", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_host_override": "", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_initial_members": "", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_lease": "5.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_log_full_interval": "50", 2024-04-22T19:54:28.275 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_log_max": "10000", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_log_max_summary": "50", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_log_epochs": "500", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_osd": "10000", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_pg_per_osd": "10000", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_pool_pg_num": "65536", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mds_force_trim_to": "0", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mds_skip_sanity": "false", 2024-04-22T19:54:28.276 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_memory_autotune": "true", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_memory_target": "2147483648", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_beacon_grace": "30", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_digest_period": "5", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_inactive_grace": "60", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_min_osdmap_epochs": "500", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_complaint_time": "30", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_history_duration": "600", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_history_size": "20", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_history_slow_op_size": "20", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_op_log_threshold": "5", 2024-04-22T19:54:28.277 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_auto_mark_in": "false", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_cache_size": "500", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_down_out_interval": "600", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-22T19:54:28.278 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_force_trim_to": "0", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_min_down_reporters": "2", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-22T19:54:28.279 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_report_timeout": "900", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_stuck_threshold": "60", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-22T19:54:28.280 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_probe_timeout": "2.000000", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_reweight_max_change": "0.050000", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_reweight_max_osds": "4", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_scrub_interval": "86400", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_scrub_max_keys": "100", 2024-04-22T19:54:28.281 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_scrub_timeout": "300", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_session_timeout": "300", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_smart_report_timeout": "5", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_stat_smooth_intervals": "6", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_stretch_pool_min_size": "2", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_stretch_pool_size": "4", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_debug": "false", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_provider_kill_at": "0", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_requester_kill_at": "0", 2024-04-22T19:54:28.282 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_sync_timeout": "60.000000", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_target_pg_per_osd": "100", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_tick_interval": "5", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_timecheck_interval": "300.000000", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_use_min_delay_socket": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_older_version_delay": "604800", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_misplaced": "false", 2024-04-22T19:54:28.283 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_older_version": "true", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "monmap": "", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-22T19:54:28.284 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "motr_tracing_enabled": "false", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_op_threads": "3", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_cm": "false", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_device_name": "", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_dscp": "96", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_local_gid": "", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-22T19:54:28.285 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_port_num": "1", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_sl": "3", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_support_srq": "true", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_rdma_type": "ib", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_async_reap_threshold": "5", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_before_connect": "false", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_ipv4": "true", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_ipv6": "false", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_msgr1": "true", 2024-04-22T19:54:28.286 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_msgr2": "true", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_port_max": "7568", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_port_min": "6800", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_retry_count": "3", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_bind_retry_delay": "5", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_blackhole_client": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_blackhole_mds": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_blackhole_mgr": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_blackhole_mon": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_blackhole_osd": "false", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_client_mode": "crc secure", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_cluster_mode": "crc secure", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_cluster_type": "", 2024-04-22T19:54:28.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_compress_secure": "false", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_connection_idle_timeout": "900", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_connection_ready_timeout": "10", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_crc_data": "true", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_crc_header": "true", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_die_on_bad_msg": "false", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_die_on_bug": "true", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_die_on_old_message": "true", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_die_on_skipped_message": "false", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_coremask": "0xF", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-22T19:54:28.288 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_enable_tso": "true", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_hugepages": "", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_lro": "true", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_memory_channel": "4", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_pmd": "", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_port_id": "0", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-22T19:54:28.289 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_dump_on_send": "false", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_initial_backoff": "0.200000", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_delay_max": "1.000000", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_delay_type": "", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_network_congestion": "0", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_inject_socket_failures": "0", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_learn_addr_from_peer": "true", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_max_accept_failures": "4", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_max_backoff": "15.000000", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_mon_client_mode": "secure crc", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_mon_service_mode": "secure crc", 2024-04-22T19:54:28.290 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_osd_compress_min_size": "1024", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_osd_compress_mode": "none", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_pq_min_cost": "65536", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_public_type": "", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_service_mode": "crc secure", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_tcp_listen_backlog": "512", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_tcp_nodelay": "true", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_tcp_rcvbuf": "0", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ms_type": "async+posix", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "no_config_file": "false", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_completion_locks_per_session": "32", 2024-04-22T19:54:28.291 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_inflight_ops": "1024", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_tick_interval": "5.000000", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter_timeout": "10.000000", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objectstore_blackhole": "false", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "openssl_engine_opts": "", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_delay_time": "5.000000", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_hist_halflife": "1000", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_max_low_ops": "2", 2024-04-22T19:54:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_max_ops": "4", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_agent_slop": "0.020000", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_asio_thread_count": "2", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_async_recovery_min_cost": "100", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backfill_scan_max": "512", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backfill_scan_min": "64", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backoff_on_degraded": "false", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backoff_on_peering": "false", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_backoff_on_unfound": "true", 2024-04-22T19:54:28.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_beacon_report_interval": "300", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bench_duration": "30", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bench_max_block_size": "67108864", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_blkin_trace_all": "false", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_check_for_log_corruption": "false", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-22T19:54:28.294 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_class_update_on_start": "true", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_client_message_cap": "256", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_client_message_size_cap": "524288000", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_client_op_priority": "63", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_client_watch_timeout": "30", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_command_max_records": "256", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_compact_on_start": "false", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_crush_update_on_start": "true", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_crush_update_weight_set": "true", 2024-04-22T19:54:28.295 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_feed_pullee": "-1", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_misdirected_ops": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_no_acting_change": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_no_purge_strays": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_op_order": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-22T19:54:28.296 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_shutdown": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_trim_objects": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_verify_snaps": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_keys": "1024", 2024-04-22T19:54:28.297 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_stride": "524288", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_default_notify_timeout": "30", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_delete_sleep": "0.000000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_discard_disconnected_ops": "true", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_enable_op_tracker": "true", 2024-04-22T19:54:28.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_fast_info": "true", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_fast_shutdown": "true", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_function_tracing": "false", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_grace": "20", 2024-04-22T19:54:28.299 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_interval": "6", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_min_peers": "10", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_min_size": "2000", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_stale": "600", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_hit_set_max_size": "100000", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_hit_set_min_size": "1000", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-22T19:54:28.300 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_journal_size": "5120", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_kill_backfill_at": "0", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_map_cache_size": "50", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_map_dedup": "true", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_map_message_max": "40", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_map_share_max_epochs": "40", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_attr_name_len": "100", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_attr_size": "0", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_backfills": "1", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_markdown_count": "5", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_markdown_period": "600", 2024-04-22T19:54:28.301 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_object_name_len": "2048", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_object_namespace_len": "256", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_object_size": "134217728", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_pg_blocked_by": "16", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_pg_log_entries": "10000", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_pgls": "1024", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_push_cost": "8388608", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_push_objects": "10", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_scrubs": "3", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-22T19:54:28.302 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_trimming_pgs": "2", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_write_op_reply_len": "64", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_max_write_size": "90", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_profile": "balanced", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-22T19:54:28.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_base": "805306368", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_cache_min": "134217728", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_target": "4294967296", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_target_autotune": "false", 2024-04-22T19:54:28.304 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_min_pg_log_entries": "250", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_min_recovery_priority": "0", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mon_report_interval": "5", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_num_cache_shards": "32", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_num_op_tracker_shard": "32", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_numa_auto_affinity": "true", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_numa_node": "-1", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_numa_prefer_iface": "true", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-22T19:54:28.305 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_objecter_finishers": "1", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_objectstore": "bluestore", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_objectstore_fuse": "false", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_objectstore_tracing": "false", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_complaint_time": "30.000000", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_history_duration": "600", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_history_size": "20", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_history_slow_op_size": "20", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_log_threshold": "5", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_shards": "0", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_shards_hdd": "5", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_shards_ssd": "8", 2024-04-22T19:54:28.306 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_pq_min_cost": "65536", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_queue_cut_off": "high", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_op_thread_timeout": "15", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_open_classes_on_start": "true", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_os_flags": "0", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_peering_op_priority": "255", 2024-04-22T19:54:28.307 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_delete_cost": "1048576", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_delete_priority": "5", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_log_trim_max": "10000", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_log_trim_min": "100", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-22T19:54:28.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_crimson": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_flags": "0", 2024-04-22T19:54:28.309 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_min_size": "0", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_pg_num": "32", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_pgp_num": "0", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_read_ratio": "70", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_size": "2", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_default_type": "replicated", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_push_per_object_cost": "1000", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-22T19:54:28.310 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recover_clone_overlap": "true", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_cost": "20971520", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_active": "0", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_max_single_start": "1", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_op_priority": "3", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_priority": "5", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-22T19:54:28.311 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_sleep": "0.000000", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_repair_during_recovery": "false", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_requested_scrub_priority": "120", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_auto_repair": "false", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_begin_hour": "0", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_begin_week_day": "0", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_chunk_max": "25", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_chunk_min": "5", 2024-04-22T19:54:28.312 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_cost": "52428800", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_during_recovery": "false", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_end_hour": "0", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_end_week_day": "0", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_event_cost": "4096", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_invalid_stats": "true", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_max_preemptions": "5", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-22T19:54:28.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_priority": "5", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_scrub_sleep": "0.000000", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_skip_data_digest": "false", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_smart_report_timeout": "5", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_cost": "1048576", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_priority": "5", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-22T19:54:28.314 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_target_transaction_size": "30", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-22T19:54:28.315 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_tracing": "false", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_use_stale_snap": "false", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "osdc_blkin_trace_all": "false", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_kill_at": "0", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_max_join_drift": "10", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_min": "500", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_min_wait": "0.050000", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_propose_interval": "1.000000", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_service_trim_max": "500", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-22T19:54:28.316 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_service_trim_min": "250", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_stash_full_interval": "25", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_trim_max": "500", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "paxos_trim_min": "250", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "perf": "true", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "-", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrv": "", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "public_bind_addr": "-", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "public_network": "", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "public_network_interface": "", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "qat_compressor_enabled": "false", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "qat_compressor_session_max_number": "256", 2024-04-22T19:54:28.317 INFO:teuthology.orchestra.run.smithi111.stdout: "rados_mon_op_timeout": "0", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rados_osd_op_timeout": "0", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rados_tracing": "false", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_atime_update_interval": "60", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_balance_parent_reads": "false", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_balance_snap_reads": "false", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_blkin_trace_all": "false", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache": "true", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-22T19:54:28.318 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_policy": "writearound", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_size": "33554432", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_clone_copy_on_read": "false", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_compression_hint": "none", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_concurrent_management_ops": "10", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_clone_format": "auto", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_data_pool": "", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_features": "61", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_format": "2", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_map_options": "", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_order": "22", 2024-04-22T19:54:28.319 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_pool": "rbd", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_stripe_count": "0", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_default_stripe_unit": "0", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_enable_alloc_hint": "true", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_io_scheduler": "simple", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-22T19:54:28.320 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_order": "24", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_pool": "", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_journal_splay_width": "4", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_localize_parent_reads": "false", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_localize_snap_reads": "false", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-22T19:54:28.321 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-22T19:54:28.322 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-22T19:54:28.323 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_mtime_update_interval": "60", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_non_blocking_aio": "true", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_op_thread_timeout": "60", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_op_threads": "1", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_parent_cache_enabled": "false", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_plugins": "", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_bps_burst": "0", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_bps_limit": "0", 2024-04-22T19:54:28.324 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_exclude_ops": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_iops_burst": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_iops_limit": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-22T19:54:28.325 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_read_from_replica_policy": "default", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_skip_partial_discard": "true", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_tracing": "false", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_validate_names": "true", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd_validate_pool": "true", 2024-04-22T19:54:28.326 INFO:teuthology.orchestra.run.smithi111.stdout: "restapi_base_url": "", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "restapi_log_level": "", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_account_default_quota_max_size": "-1", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_acl_grants_max_num": "100", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_admin_entry": "admin", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_backend_store": "rados", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_barbican_url": "", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_beast_enable_async": "true", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_counters_cache": "false", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-22T19:54:28.327 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_cache_enabled": "true", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_cache_expiry_interval": "900", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_cache_lru_size": "10000", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_config_store": "rados", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_content_length_compat": "false", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_copy_obj_progress": "true", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_cors_rules_max_num": "100", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_cross_domain_policy": "", 2024-04-22T19:54:28.328 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_addr": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_password": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_kmip_username": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_require_ssl": "true", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-22T19:54:28.329 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_addr": "", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_auth": "token", 2024-04-22T19:54:28.330 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_namespace": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_prefix": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_token_file": "", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_curl_buffersize": "524288", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_curl_low_speed_time": "300", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-22T19:54:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-22T19:54:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_d4n_port": "6379", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_log_changes_size": "1000", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_log_num_shards": "128", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_log_window": "30", 2024-04-22T19:54:28.334 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-22T19:54:28.335 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dns_name": "", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dns_s3website_name": "", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_dynamic_resharding": "true", 2024-04-22T19:54:28.336 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_gc_threads": "true", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_lc_threads": "true", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_ops_log": "false", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_quota_threads": "true", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_static_website": "false", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enable_usage_log": "false", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_enforce_swift_acls": "true", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_exit_timeout_secs": "120", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_expose_bucket": "false", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_extended_http_attrs": "", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_filter": "none", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-22T19:54:28.337 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_frontends": "beast port=7480", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_deferred": "50", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_objs": "32", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_gc_processor_period": "3600", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-22T19:54:28.338 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_init_timeout": "300", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_kafka_connection_idle": "300", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_domain": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_password": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_password_path": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_project": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_tenant": "", 2024-04-22T19:54:28.339 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_token": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_token_path": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_admin_user": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_api_version": "2", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_barbican_domain": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_barbican_password": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_barbican_project": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_barbican_user": "", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-22T19:54:28.340 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_url": "", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_debug_interval": "-1", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_lock_max_time": "90", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_max_objs": "32", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_max_rules": "1000", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_max_worker": "3", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lc_thread_delay": "0", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_dnattr": "uid", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-22T19:54:28.341 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_searchfilter": "", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ldap_uri": "", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_log_http_headers": "", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_log_object_name_utc": "false", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-22T19:54:28.342 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_attr_name_len": "0", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_attr_size": "0", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_chunk_size": "4194304", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_listing_results": "1000", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_notify_retries": "10", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_put_param_size": "1048576", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_put_size": "5368709120", 2024-04-22T19:54:28.343 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_max_slo_entries": "1000", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_md_log_max_shards": "64", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_mp_lock_max_time": "600", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-22T19:54:28.344 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_max_gc": "300", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_num_async_rados_threads": "32", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_num_control_oids": "8", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_numa_node": "-1", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_objexp_chunk_size": "100", 2024-04-22T19:54:28.345 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_objexp_gc_interval": "600", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_op_thread_timeout": "600", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_op_tracing": "false", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_opa_token": "", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_opa_url": "", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_opa_verify_ssl": "true", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ops_log_rados": "false", 2024-04-22T19:54:28.346 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_ops_log_socket_path": "", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_period_push_interval": "2.000000", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_cache_lanes": "3", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_cache_partitions": "3", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-22T19:54:28.347 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_print_continue": "true", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_rados_tracing": "false", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_realm": "", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_realm_id": "", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_region": "", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-22T19:54:28.348 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_request_uri": "", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_reshard_batch_size": "64", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_reshard_max_aio": "128", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_reshard_num_logs": "16", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_reshard_thread_interval": "600", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_resolve_cname": "false", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_run_sync_thread": "true", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-22T19:54:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_scheduler_type": "throttler", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_script_uri": "", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_service_provider_name": "", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_client_id": "", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_client_secret": "", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_entry": "sts", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_key": "sts", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-22T19:54:28.350 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_min_session_duration": "900", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sts_token_introspection_url": "", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_account_in_url": "false", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_auth_entry": "auth", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_auth_url": "", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_custom_header": "", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_need_stats": "true", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_tenant_name": "", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_token_expiration": "86400", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_url": "", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_url_prefix": "swift", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-22T19:54:28.351 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_lease_period": "120", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_thread_pool_size": "512", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-22T19:54:28.352 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_comment": "", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_createby": "", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_encoding": "", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_flag": "false", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_origin": "", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_torrent_tracker": "", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_trust_forwarded_https": "false", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_usage_max_shards": "32", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_usage_max_user_shards": "1", 2024-04-22T19:54:28.353 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_use_opa_authz": "false", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_counters_cache": "false", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_max_buckets": "1000", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_policies_max_num": "100", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_user_unique_email": "true", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_verify_ssl": "true", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-22T19:54:28.354 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zone": "", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zone_id": "", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zonegroup": "", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zonegroup_id": "", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgwlc_auto_session_clear": "true", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_block_size": "4096", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_size": "536870912", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-22T19:54:28.355 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_index_type": "binary_search", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_partition_filters": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_perf": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-22T19:54:28.356 INFO:teuthology.orchestra.run.smithi111.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "run_dir": "/var/run/ceph", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_block_create": "true", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_cache_lru_size": "67108864", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_default_max_object_size": "16777216", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_device_size": "53687091200", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_journal_batch_capacity": "16", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_main_device_type": "SSD", 2024-04-22T19:54:28.357 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "seastore_segment_size": "67108864", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "set_keepcaps": "false", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "setgroup": "", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "setuser": "", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "setuser_match_path": "", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "thp": "false", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "threadpool_default_timeout": "60", 2024-04-22T19:54:28.358 INFO:teuthology.orchestra.run.smithi111.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-22T19:54:28.359 INFO:teuthology.orchestra.run.smithi111.stdout: "throttler_perf_counter": "true" 2024-04-22T19:54:28.359 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:28.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-22T19:54:28.501 INFO:teuthology.orchestra.run.smithi111.stdout:mon.a: {} 2024-04-22T19:54:28.501 INFO:teuthology.orchestra.run.smithi111.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:54:28.514 INFO:teuthology.orchestra.run.smithi111.stdout:mon.b: {} 2024-04-22T19:54:28.514 INFO:teuthology.orchestra.run.smithi111.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:54:28.523 INFO:teuthology.orchestra.run.smithi111.stdout:mon.c: {} 2024-04-22T19:54:28.523 INFO:teuthology.orchestra.run.smithi111.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:54:28.539 DEBUG:teuthology.orchestra.run.smithi111:> type ceph-objectstore-tool 2024-04-22T19:54:28.543 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-22T19:54:28.543 DEBUG:teuthology.orchestra.run.smithi138:> type ceph-objectstore-tool 2024-04-22T19:54:28.549 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-22T19:54:28.549 INFO:teuthology.run_tasks:Running task workunit... 2024-04-22T19:54:28.562 INFO:tasks.workunit:Pulling workunits from ref 9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:54:28.562 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-22T19:54:28.562 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-22T19:54:28.563 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-22T19:54:28.563 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:54:28.563 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:54:28.563 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-22T19:54:28.563 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-22T19:54:28.563 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-22T19:54:28.564 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-22T19:54:28.564 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:28.564 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-22T19:54:28.564 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:28.565 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-22T19:54:28.565 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:54:28.587 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:28.585+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:28.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T19:54:28.590 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-22T19:54:28.591 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-22T19:54:28.638 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-22T19:54:28.639 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-22T19:54:28.666 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:28.665+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:28.686 INFO:tasks.workunit:timeout=3h 2024-04-22T19:54:28.686 INFO:tasks.workunit:cleanup=True 2024-04-22T19:54:28.687 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9ed8263edff7e87907bf24b054e5c7144c194dbe 2024-04-22T19:54:28.706 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:28.706 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:28.710 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-22T19:54:28.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:28.736 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:28.736 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:28.743 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-22T19:54:28.755 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:28.756 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:28.766 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:28.765+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:28.788 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:28.788 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:28.806 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:28.806 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:28.826 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:28.826 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:28.847 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:28.847 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:28.865 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:28.865 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:28.867 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:28.867 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:28.868 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:28.869+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:28.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:28.891 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:28.891 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:28.909 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-22T19:54:28.934 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:54:28.968 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:28.969+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:29.005 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.005 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.018 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:29.068 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:29.065+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:29.088 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-04-22T19:54:29.132 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.132 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.148 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:29.169 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:29.169+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:29.270 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:29.269+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:29.279 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-04-22T19:54:29.301 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.301 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.314 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:29.402 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:29.401+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:29.447 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-04-22T19:54:29.464 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.464 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.478 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:29.478 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:29.473+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:29.574 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:29.573+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:29.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-04-22T19:54:29.632 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.632 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.646 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:29.673 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:29.673+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:29.775 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:29.773+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:29.777 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-04-22T19:54:29.800 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.801 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.814 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:29.875 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:29.873+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:29.966 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:29.966 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:29.976 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:29.973+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:29.979 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:30.077 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:30.073+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:30.135 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.136 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.148 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:30.179 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:30.177+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:30.279 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:30.277+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:30.305 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.305 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.318 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:30.380 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:30.377+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:30.431 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.431 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.445 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:30.492 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:30.493+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:30.577 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.578 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.582 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:30.581+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:30.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:30.683 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:30.681+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:30.755 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.755 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.770 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:30.812 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:30.813+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:30.885 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:30.881+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:30.910 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:30.936 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:30.936 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:30.950 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:30.959 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:54:31.006 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:31.005+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:31.067 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:31.067 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:31.077 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:31.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:31.093 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:31.093 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:31.110 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:31.110 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:31.127 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:31.128 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:31.128 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:31.129+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:31.144 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:31.144 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:31.161 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:31.161 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:31.180 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:31.180 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:31.188 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:31.185+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:31.199 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:31.213 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:31.289 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:31.285+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:31.387 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.998899958999999, 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:54:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:54:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:54:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:54:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.993495297000001, 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:54:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:54:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.020303345, 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:54:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:54:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.939137785, 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:54:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:54:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.935486534000001, 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:54:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:54:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:54:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.905773428, 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:54:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:54:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:54:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.888585187, 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:54:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.864426736, 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.842148151, 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:54:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:54:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.842087764, 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:54:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.838510985999999, 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:54:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:54:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.833830844, 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.833756894, 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.833671291, 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:54:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:54:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.796302406000001, 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.794368059, 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.791289781, 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.788115249000001, 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.482 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.578064407999999, 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:54:31.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:54:31.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.531790025999999, 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.488 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:54:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.493 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:31.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:31.495 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:31.493+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:31.596 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:31.593+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:31.622 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:31.622 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:31.622 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:31.622 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:31.636 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:31.697 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:31.697+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:31.755 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:31.755 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:31.755 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:31.755 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:31.755 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:31.771 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:31.798 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:31.793+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:31.899 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:31.901+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.929 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.575406792000001, 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:54:31.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:54:31.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.543652283, 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:54:31.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:54:31.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.528373609999999, 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:54:31.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.948 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.525347756, 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:31.949 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:54:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:54:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.441860652000001, 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.955 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:54:31.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:31.959 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.543419614999999, 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:31.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.963 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.460570081, 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:54:31.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.414019884, 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.968 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:54:31.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:54:31.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:54:31.972 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.410730467, 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:54:31.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:54:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.409670449, 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:54:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:54:31.981 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.405979624, 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:31.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:54:31.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.403040046999999, 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:54:31.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:54:31.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.391693494, 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.990 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:31.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.386015231, 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:54:31.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:54:31.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.376539069, 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:31.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:54:32.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.359889921000001, 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:54:32.003 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.007 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.354653450000001, 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:54:32.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:54:32.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.352320341, 2024-04-22T19:54:32.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:54:32.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.272694605, 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:54:32.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.218387492, 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:54:32.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.026 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.026 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:32.027 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:32.027 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:32.029+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:32.106 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:54:32.127 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:32.125+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:32.152 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:32.152 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:32.152 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:32.152 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:32.166 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:32.228 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:32.225+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:32.328 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:32.328 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:32.328 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:32.328 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:32.328 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:32.329 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:32.329+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:32.341 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:32.430 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:32.429+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:32.508 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.742771349999998, 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:54:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:54:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.742578698000003, 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:54:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:54:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.682886834999998, 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:54:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:54:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.682822252999998, 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:54:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:54:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:54:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.682691317, 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.576053166000001, 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:54:32.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.543 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575922204000001, 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.544 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:54:32.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:54:32.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:54:32.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575682985999997, 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.549 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575607007000002, 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575534263999998, 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:54:32.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:54:32.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:32.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575222459999999, 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:54:32.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575156987, 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:32.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:54:32.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.575096713999997, 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:54:32.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:54:32.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:54:32.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.574937368000001, 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:32.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.574864189000003, 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:54:32.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:32.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:54:32.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:54:32.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.326652392, 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:54:32.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:54:32.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:54:32.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:54:32.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.326547660000003, 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:54:32.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:54:32.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.605 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.326529495000003, 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:54:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.326512481000002, 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.326409261999999, 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:54:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:54:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:54:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:32.623 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:32.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:32.625 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:32.621+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:32.726 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:32.725+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:32.755 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:32.755 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:32.755 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:32.755 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:32.769 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:32.826 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:32.825+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:32.887 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:32.887 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:32.887 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:32.887 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:32.887 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:32.901 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:32.927 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:32.929+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:33.029 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:33.029+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:33.030 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.303089614000001, 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:54:33.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:54:33.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.301705978999998, 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026123969999999998, 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.035 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727438+0000", 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.007e-06 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727510+0000", 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1957000000000002e-05 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727537+0000", 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6342e-05 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727589+0000", 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2092999999999997e-05 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727729+0000", 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139949 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727760+0000", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1807000000000002e-05 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.729873+0000", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021121769999999998 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.730049+0000", 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017606499999999999 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.039 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.266009250000003, 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:33.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:54:33.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.265076661000002, 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:54:33.044 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:54:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.263853730999998, 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:54:33.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:54:33.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.262085524, 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.083392486000001, 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:54:33.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.082373163, 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.069671057999997, 2024-04-22T19:54:33.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:33.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:54:33.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.838154656999997, 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:54:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:54:33.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:54:33.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.830712687000002, 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:54:33.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:54:33.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:54:33.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:33.078 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.617789888000001, 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:54:33.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.659785088, 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.084 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:54:33.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:54:33.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.089 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.639958545000001, 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:54:33.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:54:33.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:54:33.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.609551364, 2024-04-22T19:54:33.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.593723862999999, 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.101 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.565277889000001, 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:33.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:54:33.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:54:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:33.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.546661124, 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:33.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:54:33.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:54:33.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.492605058000001, 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:54:33.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:54:33.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:54:33.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.074128625, 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:33.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:33.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:33.129 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:33.131 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:33.131 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:33.129+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:33.214 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:33.232 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:33.233+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:33.301 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:33.302 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:33.302 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:33.302 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:33.317 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:33.366 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:33.365+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:33.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:33.371 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:33.388 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:33.388 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:33.405 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:33.405 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:33.421 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:33.422 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:33.433 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:33.433+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:33.441 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:33.441 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:33.442 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:33.442 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:33.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:33.463 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:33.464 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:33.484 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:33.484 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:33.505 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:33.505 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:33.534 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:33.533+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:33.578 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:33.578 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:33.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:33.638 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:33.637+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:33.713 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:33.713 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:33.727 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:33.736 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:33.737+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:33.836 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:33.837+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:33.886 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:33.886 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:33.901 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:33.946 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:33.945+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:34.018 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.018 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:34.039 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:34.037+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:34.131 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:54:34.178 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:34.177+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:34.200 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.201 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.216 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:34.262 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:34.261+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:34.342 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:34.341+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:34.375 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.375 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.390 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:34.478 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:34.477+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:34.544 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:34.541+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:34.550 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.551 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.564 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:34.644 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:34.641+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:34.697 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.697 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:34.756 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:34.757+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:34.835 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:34.836 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:34.847 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:34.849+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:34.849 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:34.948 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:34.949+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:35.014 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:35.015 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:35.029 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:35.049 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:35.049+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:54:35.150 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:35.145+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:35.196 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:35.196 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:35.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:35.256 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:35.257+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:35.336 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:35.336 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:35.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:35.392 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:35.393+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:35.453 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:35.449+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:35.512 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:35.512 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:35.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:35.526 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:35.570 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:35.569+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:35.652 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:35.652 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:35.654 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:35.653+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:35.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:35.678 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:35.678 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:35.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:35.695 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:35.712 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:35.712 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:35.727 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:35.728 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:35.748 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:35.748 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:35.755 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:35.753+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:35.766 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:35.766 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:35.786 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:35.787 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:35.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:35.805 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:35.805 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:35.884 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:35.885+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:35.957 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:35.957+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:35.968 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.612733939999998, 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.969 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:35.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:54:35.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:54:35.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.580979430999999, 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:54:35.976 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:54:35.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:54:35.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:35.982 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.565700757999998, 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:35.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:35.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:54:35.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.562674904000001, 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:54:35.988 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:54:35.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.479187799999998, 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.994 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:35.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:54:35.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:54:35.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.580746763, 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:35.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:54:36.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.497897228999999, 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:54:36.003 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:54:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.451347031999999, 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:54:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.448057615, 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:54:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:54:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.446997596999999, 2024-04-22T19:54:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:54:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.443306772, 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.440367195, 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.429020641999999, 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:54:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.423342378999999, 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:54:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:54:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.413866217000001, 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:54:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:54:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:54:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.397217069, 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:54:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:54:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.391980598, 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:54:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:54:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.389647489, 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:54:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:54:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.310021753000001, 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.255714640000001, 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:54:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:54:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:54:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.064 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:36.066 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:36.066 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:36.065+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:36.166 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:36.165+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:36.234 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:36.234 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:36.234 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:36.234 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:36.248 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:36.292 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:36.293+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:36.366 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:36.366 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:36.367 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:36.367 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:36.367 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:36.368 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:36.369+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:36.381 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:36.472 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:36.473+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:36.554 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:36.554 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:36.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:36.554 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.788149509, 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:54:36.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.787956856999998, 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.728264994, 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:54:36.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:54:36.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.728200412, 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.728069476000002, 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:54:36.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:54:36.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:54:36.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.621431325000003, 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:54:36.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:54:36.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:54:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.621300363000003, 2024-04-22T19:54:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:54:36.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.621061144999999, 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:54:36.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:54:36.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:36.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:54:36.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620985165999997, 2024-04-22T19:54:36.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:54:36.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:54:36.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620912423, 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:54:36.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:54:36.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.610 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620600619000001, 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:54:36.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620535146000002, 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.616 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:54:36.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:54:36.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:54:36.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620474872999999, 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.622 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620315527000002, 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:54:36.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.620242347999998, 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.638 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.372030551000002, 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:54:36.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:54:36.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.371925818999998, 2024-04-22T19:54:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.371907653999997, 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.650 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:54:36.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.371890639999997, 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:54:36.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:54:36.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.371787421000001, 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:36.662 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:54:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:54:36.667 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.668 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.668 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.668 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:36.668 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:36.668 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:36.669 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:36.670 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:36.665+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:36.771 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:36.769+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:36.802 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:36.803 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:36.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:36.872 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:36.869+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:36.934 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:36.934 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:36.934 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:36.934 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:36.934 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:36.948 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:36.990 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:36.989+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:37.073 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:37.069+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:54:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.390867925000002, 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-04-22T19:54:37.122 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.389484289999999, 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026123969999999998, 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727438+0000", 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.007e-06 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727510+0000", 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1957000000000002e-05 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727537+0000", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6342e-05 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727589+0000", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2092999999999997e-05 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727729+0000", 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139949 2024-04-22T19:54:37.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727760+0000", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1807000000000002e-05 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.729873+0000", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021121769999999998 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.730049+0000", 2024-04-22T19:54:37.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017606499999999999 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.353787560999997, 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:54:37.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:54:37.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.131 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.352854972000003, 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:54:37.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:54:37.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:54:37.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.351632041999999, 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.136 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:54:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:54:37.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.349863835000001, 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:54:37.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.171170797000002, 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:54:37.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:54:37.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.170151474000001, 2024-04-22T19:54:37.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:54:37.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.153 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.157449368999998, 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.925932967999998, 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:54:37.158 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:54:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.918490998000003, 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:54:37.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:54:37.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.705568198999998, 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.167 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:54:37.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.747563399000001, 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:54:37.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:54:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:54:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.727736856, 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:54:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.697329674999999, 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:37.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.190 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.681502173999998, 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:37.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:54:37.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:54:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:54:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.653056200000002, 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:54:37.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.634439435000001, 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:54:37.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.580383369, 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:54:37.208 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:54:37.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.161906936000001, 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:54:37.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:54:37.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.219 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:37.220 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:54:37.221 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:37.222 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:37.217+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:37.322 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:37.321+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:37.390 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:37.390 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:37.390 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:37.390 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:37.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:37.450 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:37.449+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:37.523 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:37.521+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:37.570 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:37.570 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:37.570 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:37.570 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:37.570 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:37.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:37.626 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:37.625+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:37.725 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:37.725+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.398447618999999, 2024-04-22T19:54:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:54:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:54:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.359573127000001, 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:54:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:54:37.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.354495817, 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:54:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.762 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.353837579, 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:54:37.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.347060612, 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.767 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:54:37.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.252382117, 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.367899629, 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.777 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:54:37.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:54:37.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:54:37.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.348740697, 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:54:37.783 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:54:37.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:54:37.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:54:37.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.322631412, 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:54:37.789 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:54:37.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.303911185, 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.795 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.270692656000001, 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:54:37.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:54:37.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.242650620999999, 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:54:37.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:54:37.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:54:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.227141969000002, 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:54:37.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:54:37.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:54:37.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:54:37.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.818 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.216792179999999, 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:37.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:54:37.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:54:37.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:54:37.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.824 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.183217356, 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.892001233999999, 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:54:37.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:37.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:54:37.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.805253451999999, 2024-04-22T19:54:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:37.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.744237459000001, 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.841 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:54:37.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:54:37.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.59054678, 2024-04-22T19:54:37.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.524410431, 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:37.858 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:37.858 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:37.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:37.861 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:37.861+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:37.961 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:37.957+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:38.023 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:38.024 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:38.024 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:38.024 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:38.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:38.045 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:38.046 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:38.062 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:38.061+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:38.063 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:38.064 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:38.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:38.080 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:38.110 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:38.111 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:38.131 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:38.131 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:38.151 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:38.153 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:38.163 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:38.161+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:38.170 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.170 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:38.172 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:38.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:38.193 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:38.193 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:38.264 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:38.265+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:38.308 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.308 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.322 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:38.370 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:38.369+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:38.398 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:54:38.446 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.446 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:38.502 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:38.501+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:38.567 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:38.565+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:38.620 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.620 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.635 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:38.682 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:38.681+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:38.750 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.750 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:38.768 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:38.769+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:38.869 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:38.865+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:38.897 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:38.897 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:38.912 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:38.970 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:38.969+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:39.034 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.034 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.049 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:39.093 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:39.093+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:39.174 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:39.173+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:39.217 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.217 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:39.275 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:39.277+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:39.377 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:39.373+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:39.401 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.401 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.416 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:39.476 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:39.473+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:39.536 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.536 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.550 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:39.577 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:39.573+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:39.667 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.667 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.678 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:39.677+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:39.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:39.779 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:39.777+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:39.803 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.803 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:39.880 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:39.881+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:39.935 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:39.935 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:39.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:39.981 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:39.977+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:40.082 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:40.081+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:40.111 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:40.111 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:40.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:40.182 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:40.181+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:40.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:40.283 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:40.280+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:40.305 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:40.366 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:40.366 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:40.383 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:40.383 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:40.383 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:40.381+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:40.399 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:40.400 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:40.416 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:40.416 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:40.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:54:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:40.436 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:40.436 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:40.437 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:40.456 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:40.456 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:40.473 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:40.473 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:40.484 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:40.480+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:40.492 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:40.492 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:40.585 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:40.580+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.836240904999997, 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:54:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.836048253000001, 2024-04-22T19:54:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:54:40.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:40.615 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.776356389999997, 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:40.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:54:40.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:54:40.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.621 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.776291808000003, 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:40.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.776160871999998, 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:54:40.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:54:40.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.634 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.669522721, 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:54:40.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:54:40.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:54:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.669391759, 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:54:40.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:54:40.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:54:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.669152541000003, 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:54:40.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:54:40.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.669076562000001, 2024-04-22T19:54:40.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:40.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:54:40.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:40.659 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.669003818999997, 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:54:40.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:54:40.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.668692014999998, 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:54:40.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.672 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.668626541999998, 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.673 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:54:40.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:54:40.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.668566269000003, 2024-04-22T19:54:40.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:54:40.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:54:40.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:54:40.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.668406922999999, 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.686 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:54:40.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:54:40.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.668333744000002, 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:54:40.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:54:40.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.420121946999998, 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:54:40.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.420017215000001, 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.706 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:40.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:54:40.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:54:40.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.419999050000001, 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:54:40.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.419982036, 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:54:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:54:40.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:54:40.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.725 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.419878816999997, 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:40.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:40.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:54:40.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:40.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.731 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.732 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.732 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:40.732 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:40.732 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:40.733 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:40.733+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:40.734 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:40.834 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:40.833+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:40.859 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:40.859 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:40.859 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:40.859 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:40.873 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:40.935 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:40.932+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:40.992 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:40.993 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:41.006 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:41.037 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:41.037+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:41.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:41.132+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:41.175 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.448846256000003, 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:54:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:54:41.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.447462621, 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026123969999999998, 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727438+0000", 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.007e-06 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727510+0000", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1957000000000002e-05 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727537+0000", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6342e-05 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727589+0000", 2024-04-22T19:54:41.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2092999999999997e-05 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727729+0000", 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139949 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727760+0000", 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1807000000000002e-05 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.729873+0000", 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021121769999999998 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.730049+0000", 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017606499999999999 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.411765891999998, 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:54:41.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.410833302999997, 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:54:41.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:54:41.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:54:41.195 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.409610373, 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:54:41.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.407842166000002, 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:54:41.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:54:41.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.229149128000003, 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:54:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.228129805000002, 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:54:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:54:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.215427699999999, 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:54:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:54:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.983911298999999, 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.976469328999997, 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.763546529999999, 2024-04-22T19:54:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:54:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:54:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:54:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.805541730000002, 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:54:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:54:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:54:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.785715187000001, 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:54:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:54:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.755308006, 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.739480505, 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:54:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:54:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.711034530999999, 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.692417765999998, 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.638361700000001, 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:54:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:54:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.219885266999999, 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:54:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:54:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.282 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:41.283 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:41.284 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:41.281+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:41.384 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:41.380+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:41.406 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:54:41.459 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:41.459 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:41.459 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:41.459 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:41.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:41.485 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:41.485+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:41.586 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:41.585+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:41.634 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:41.635 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:41.635 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:41.635 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:41.635 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:41.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:41.686 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:41.685+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.421566855999998, 2024-04-22T19:54:41.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:41.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:54:41.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.382692364, 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:54:41.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:41.781 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.377615054, 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.376956816, 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.370179848999999, 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.790 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:41.794 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.275501353999999, 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.391018866, 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.800 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:54:41.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.371859934, 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.806 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:54:41.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:54:41.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.345750648999999, 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:54:41.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:54:41.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.327030422, 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.818 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:54:41.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:54:41.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:54:41.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.293811893000001, 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:54:41.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:54:41.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.265769857999999, 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:41.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:54:41.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:54:41.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.250261206000001, 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:54:41.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.239911416999998, 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:54:41.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:54:41.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.206336593, 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.849 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:54:41.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:54:41.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:54:41.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:54:41.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.915120471000002, 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:54:41.854 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:54:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:54:41.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.828372688999998, 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.859 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:54:41.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:54:41.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.767356696, 2024-04-22T19:54:41.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:54:41.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:54:41.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:41.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.613666017, 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.547529667999999, 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:41.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:54:41.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:41.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:41.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:41.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:41.882 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:41.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:41.884 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:41.881+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:41.985 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:41.980+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:42.012 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:42.012 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:42.012 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:42.012 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:42.026 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:42.114 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:42.112+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:42.186 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:42.185+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:42.194 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:42.194 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:42.194 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:42.195 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:42.195 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:42.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:42.287 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:42.285+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:42.377 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.968750918000001, 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:54:42.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:54:42.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:54:42.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.953373932000002, 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.384 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:54:42.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:54:42.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:54:42.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.977246815000001, 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:54:42.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.967874362, 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:54:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.889490470999998, 2024-04-22T19:54:42.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:54:42.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:54:42.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:54:42.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:42.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.575020266999999, 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:54:42.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:54:42.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.571444708000001, 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:54:42.412 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:54:42.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:54:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.535902471, 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:42.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:54:42.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:54:42.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.407692904000001, 2024-04-22T19:54:42.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.404037705, 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:54:42.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:54:42.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.352768510000001, 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.436 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:54:42.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.348931985, 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:54:42.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:54:42.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.339220332, 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.448 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:54:42.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:54:42.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:54:42.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:54:42.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:54:42.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.335732701000001, 2024-04-22T19:54:42.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:54:42.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.293025567000001, 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:42.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:54:42.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:54:42.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.289105368000001, 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.206803441000002, 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:54:42.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:54:42.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.203091003000001, 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:42.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:54:42.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:54:42.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.113212064999999, 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:54:42.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:54:42.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.099995460999999, 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.492 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:54:42.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:42.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:42.497 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:42.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:42.499 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:42.497+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:42.512 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:42.599 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:42.597+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:42.626 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:42.627 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:42.642 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:42.690 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:42.690 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:42.700 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:42.701+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:42.707 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:42.707 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:42.725 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:42.725 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:42.741 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:42.741 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:42.760 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:42.760 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:42.762 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:42.762 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:42.774 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:42.783 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:42.783 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:42.800 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:42.796+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:42.804 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:42.804 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:42.825 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:42.825 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:42.890 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:42.890 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:42.901 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:42.896+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:42.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:43.002 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:43.001+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:43.036 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.036 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:43.136 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:43.137+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:43.203 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:43.204+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:43.216 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.216 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:43.320 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:43.321+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:43.401 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.402 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.405 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:43.405+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:43.416 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:43.429 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:54:43.506 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:43.505+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:43.584 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.584 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:43.641 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:43.641+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:43.707 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:43.705+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:43.765 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.765 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.780 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:43.824 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:43.825+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:43.908 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:43.909+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:43.947 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:43.947 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:43.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:44.009 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:44.004+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:44.110 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:44.109+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:44.128 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.128 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.142 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:44.232 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:44.233+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:44.308 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.308 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.312 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:44.313+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:44.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:44.413 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:44.413+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:44.420 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:54:44.490 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.491 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.504 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:44.514 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:44.512+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:44.615 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:44.613+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:44.674 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.674 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:44.717 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:44.712+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:44.817 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:44.816+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:44.843 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:44.853 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.853 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:44.918 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:44.917+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:44.989 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:44.990 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:44.998 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:44.998 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:45.004 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:45.015 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:45.016 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:45.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:45.016+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:45.034 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:45.034 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:45.050 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:45.050 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:45.070 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:45.070 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:45.090 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:45.090 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:45.111 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:45.113 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:45.119 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:45.116+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:45.122 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:45.122 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:45.122 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:45.122 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:45.131 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:45.132 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:45.136 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:45.234 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:45.232+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:45.305 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:45.305 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:45.305 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:45.306 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:45.306 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:45.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:45.321 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:45.321+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:45.422 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:45.421+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.768521231999998, 2024-04-22T19:54:45.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:54:45.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:54:45.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.500 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.767137597000001, 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026123969999999998, 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727438+0000", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.007e-06 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727510+0000", 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1957000000000002e-05 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727537+0000", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6342e-05 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727589+0000", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2092999999999997e-05 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727729+0000", 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139949 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727760+0000", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1807000000000002e-05 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.729873+0000", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021121769999999998 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.730049+0000", 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017606499999999999 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.504 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.731440868, 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:54:45.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.730508278999999, 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:54:45.509 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:54:45.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:54:45.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.729285349000001, 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:54:45.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:54:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:54:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.727517141999996, 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:54:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.548824103999998, 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:54:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.547804780999996, 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.535102676000001, 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:54:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.303586275000001, 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:54:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.296144304999999, 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:54:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:54:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.083221506000001, 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:54:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.125216706, 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:54:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:54:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:54:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.105390162999999, 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:54:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:54:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:54:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.074982982000002, 2024-04-22T19:54:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.059155481000001, 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:54:45.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:54:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:54:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:54:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.030709507000001, 2024-04-22T19:54:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:54:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.012092742, 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:54:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.958036675999999, 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:54:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.539560243, 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:54:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:45.597 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:45.598 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:45.599 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:45.596+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:45.699 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:45.696+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:45.770 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:45.770 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:45.770 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:45.770 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:45.784 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:45.826 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:45.824+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:45.900 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:45.901+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:45.944 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:45.944 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:45.944 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:45.944 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:45.944 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:45.959 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:46.006 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:46.004+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:46.082 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.735079212000002, 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.696204720000001, 2024-04-22T19:54:46.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:54:46.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.091 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.69112741, 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:54:46.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:54:46.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.690469172, 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.683692205, 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.100 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:54:46.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.104 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.58901371, 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:46.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.704531222, 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.110 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.68537229, 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:54:46.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:54:46.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:54:46.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:54:46.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.659263005, 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.122 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:54:46.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:54:46.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.127 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.640542778, 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:54:46.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:54:46.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.607324249000001, 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.579282213999999, 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:54:46.139 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:54:46.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:54:46.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.563773562000002, 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:54:46.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:54:46.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.553423772999999, 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.519848949, 2024-04-22T19:54:46.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.228632826999998, 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:54:46.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.141885044999999, 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.166 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:54:46.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.080869052000001, 2024-04-22T19:54:46.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:54:46.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:54:46.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.927178373, 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:46.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:54:46.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.182 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.861042024, 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:46.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:54:46.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.188 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:46.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:46.190 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:46.188+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:46.290 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:46.288+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:46.361 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:46.361 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:46.362 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:46.362 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:46.376 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:46.391 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:46.388+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:46.446 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:54:46.492 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:46.492+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:46.537 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:46.537 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:46.537 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:46.537 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:46.537 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:46.552 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:46.594 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:46.592+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.27276809, 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:54:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.257391104, 2024-04-22T19:54:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:54:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:54:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:54:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:54:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.281263986999999, 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:54:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:54:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.271891534000002, 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:54:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.193507643, 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.879037439000001, 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:54:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:54:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.87546188, 2024-04-22T19:54:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:54:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.839919643000002, 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:54:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:54:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.711710075999999, 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:54:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.708054876999999, 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:54:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:54:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.656785681999999, 2024-04-22T19:54:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:54:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:54:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:54:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:54:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.652949156999998, 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.643237503999998, 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:54:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:54:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:54:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.639749873, 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:54:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.597042738999999, 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:54:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:54:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:54:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.59312254, 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:54:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.510820613, 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:54:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:54:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.507108174999999, 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:54:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:54:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.417229237000001, 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:54:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:54:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:54:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:54:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.404012633000001, 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:46.796 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:46.798 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:46.798 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:46.796+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:46.898 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:46.896+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:46.967 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:46.967 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:46.967 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:46.967 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:46.981 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:47.022 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:47.020+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:47.100 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:47.096+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:47.146 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:47.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:47.146 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:47.146 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:47.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:47.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:47.160 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:47.201 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:47.200+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:47.295 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:47.296 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:47.302 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:47.300+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:47.312 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:47.312 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.908411248, 2024-04-22T19:54:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:54:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:54:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.917635006000001, 2024-04-22T19:54:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:54:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:54:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:54:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.917526847000001, 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:54:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.950178696999998, 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:54:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:54:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.91202358, 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:54:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:54:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.871230176000001, 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:54:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:54:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:54:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.863944977999999, 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:54:47.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:54:47.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.369 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.8567608, 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.761856927, 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:54:47.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.688370438, 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:54:47.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:54:47.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:47.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.686892574000002, 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:54:47.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:54:47.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:47.393 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.683632801000002, 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:47.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:54:47.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.453584826, 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.440010321999999, 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:54:47.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:54:47.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:47.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386391221, 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:54:47.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:54:47.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:47.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:47.416 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.308240151, 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:47.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.281752361999999, 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:54:47.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:54:47.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:54:47.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.201568897000001, 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.428 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:54:47.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:54:47.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.181982230999999, 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:54:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.089308828, 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:54:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:47.446 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:47.446 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:47.447 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:47.448 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:47.448 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:47.448 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:47.449 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:47.449 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:47.449 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:47.450 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:47.450 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:47.450 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:47.450 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:47.451 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:47.444+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:47.454 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:54:47.548 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:47.544+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:47.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:47.648 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:47.644+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:47.749 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:47.748+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:47.760 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:47.760 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:47.775 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:47.850 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:47.848+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:47.941 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:47.941 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:47.950 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:47.948+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:47.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:48.051 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:48.048+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:48.120 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.120 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:48.152 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:48.148+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:48.253 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.253 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.254 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:48.252+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:48.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:48.355 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:48.356+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:48.424 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.424 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:48.458 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:48.452+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:48.557 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:48.556+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:48.563 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.563 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.577 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:48.658 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:48.652+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:48.742 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.742 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:48.758 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:48.756+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:48.860 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:48.860+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:48.877 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:48.877 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:48.892 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:48.961 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:48.960+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:49.014 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:49.014 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:49.029 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:49.073 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:49.072+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:49.163 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:49.164+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:49.196 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:49.196 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:49.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:49.264 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:49.264+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:49.331 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:49.331 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:49.347 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:49.394 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:49.392+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:49.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:49.475 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:54:49.480 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:49.480 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:49.481 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:49.476+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:49.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:49.586 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:49.584+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:49.606 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:49.606 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:49.624 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:49.640 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:49.641 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:49.657 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:49.657 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:49.668 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:49.664+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:49.677 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:49.677 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:49.685 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:49.685 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:49.685 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:49.685 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:49.686 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:49.698 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:49.698 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:49.700 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:49.719 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:49.719 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:49.739 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:49.739 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:49.802 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:49.800+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:49.834 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:49.834 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:49.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:49.834 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:49.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.108931957999999, 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.107548323000003, 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026123969999999998, 2024-04-22T19:54:49.839 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727436+0000", 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727438+0000", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.007e-06 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727510+0000", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1957000000000002e-05 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727537+0000", 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6342e-05 2024-04-22T19:54:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727589+0000", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2092999999999997e-05 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727729+0000", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139949 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.727760+0000", 2024-04-22T19:54:49.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1807000000000002e-05 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.729873+0000", 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021121769999999998 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.730049+0000", 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017606499999999999 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.071851594000002, 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:54:49.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:54:49.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.070919005, 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:54:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.069696075000003, 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:49.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 53.067927867999998, 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.857 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:54:49.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:54:49.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.889234829999999, 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:54:49.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:54:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.888215506999998, 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:54:49.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.875513402000003, 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:54:49.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.643997001000002, 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:54:49.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:54:49.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.636555031, 2024-04-22T19:54:49.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:54:49.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.423632232000003, 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:54:49.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:54:49.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:54:49.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.465627432000002, 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.890 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:54:49.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:49.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.895 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.445800889000001, 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:54:49.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:49.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.901 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.415393708, 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:54:49.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:54:49.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:49.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.399566206999999, 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:54:49.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.371120232999999, 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.913 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:54:49.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.352503467999998, 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.919 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:54:49.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:54:49.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.298447402000001, 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:54:49.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:54:49.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.879970968999999, 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:54:49.930 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:54:49.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:49.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:49.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:49.936 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:49.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:49.938 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:49.936+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:50.038 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:50.036+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:50.108 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:50.108 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:50.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:50.139 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:50.136+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:50.241 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:50.240+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:50.287 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:50.287 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:50.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:50.342 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:50.340+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:50.427 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:50.427 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:50.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:50.427 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.079861612999998, 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:54:50.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.040987121000001, 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:50.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:54:50.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:54:50.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.035909811000003, 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:54:50.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:54:50.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:54:50.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.035251572999996, 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:50.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.028474606000003, 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.446 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:54:50.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:54:50.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.933796110999999, 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.451 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:54:50.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:54:50.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:54:50.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:54:50.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.049313623, 2024-04-22T19:54:50.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:54:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.030154691, 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.462 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:54:50.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:54:50.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.004045405999999, 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:50.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:54:50.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:54:50.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.985325179, 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:50.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:54:50.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.952106650000001, 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:54:50.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.485 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.924064614999999, 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:54:50.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:54:50.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.908555963000001, 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.898206173999998, 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:54:50.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:54:50.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.503 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.86463135, 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:54:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:54:50.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.573415228000002, 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.486667445999998, 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:54:50.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:54:50.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.425651453, 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.525 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.271960774, 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.526 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:54:50.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.531 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.205824424999999, 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:50.532 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:50.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:50.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:50.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:54:50.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:50.537 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:50.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:50.540 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:54:50.540 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:50.536+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:50.639 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:50.636+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:50.709 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:50.709 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:50.709 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:50.709 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:50.723 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:50.770 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:50.768+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:50.841 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:50.840+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:50.843 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:50.843 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:50.843 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:50.843 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:50.843 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:50.857 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:50.946 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:50.944+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:51.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.619724253999998, 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:54:51.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:54:51.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.604347267999998, 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.039 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.628220151000001, 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.040 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:54:51.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:54:51.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.618847698000003, 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:54:51.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:54:51.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.540463806999998, 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.052 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:54:51.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:54:51.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.225993602999999, 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.058 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:54:51.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.063 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.222418044000001, 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:54:51.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.069 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.186875807, 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.070 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:54:51.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.075 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.058666240000001, 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:54:51.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.081 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.055011041, 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.082 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:54:51.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:54:51.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.003741846, 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:54:51.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.999905321, 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:54:51.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:54:51.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.099 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.990193668, 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:54:51.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:54:51.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:51.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.986706037000001, 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:54:51.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:54:51.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:51.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.943998903000001, 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:51.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:54:51.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:54:51.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:51.117 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.940078704000001, 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:54:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:54:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.857776777000002, 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:54:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:54:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.854064339000001, 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:54:51.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:54:51.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.764185400999999, 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:54:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.750968796999999, 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.142 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:54:51.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:54:51.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.148 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:51.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:51.150 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:51.144+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:51.250 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:51.248+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:51.318 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:51.318 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:51.318 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:51.318 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:51.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:51.351 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:51.348+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:51.451 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:51.448+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:51.452 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:51.452 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:51.452 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:51.452 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:51.452 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:51.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:51.552 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:51.552+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:51.633 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.215731771000002, 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:54:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:54:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.224955528999999, 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:54:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:54:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:54:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.224847369999999, 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:54:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.25749922, 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:54:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.219344103000001, 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:54:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:54:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.178550698999999, 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:54:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:54:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.171265501000001, 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:54:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:54:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.164081323000001, 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:54:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:54:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.069177450000002, 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:54:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.995690961000001, 2024-04-22T19:54:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:54:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.994213096999999, 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:54:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.990953323999999, 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:54:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:54:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.760905349000002, 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:54:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.747330845, 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:54:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:54:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:54:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.693711744000002, 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:54:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.615560674000001, 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:54:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.589072885, 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:54:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:54:51.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:54:51.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:54:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.508889419999999, 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:54:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:54:51.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:54:51.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:54:51.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.489302754000001, 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.742 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:54:51.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:54:51.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:54:51.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.396629351000001, 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:51.748 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:54:51.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:54:51.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:51.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:51.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:51.754 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:51.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:51.756 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:51.752+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:51.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:51.857 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:51.852+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:51.888 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:51.888 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:51.888 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:51.888 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:51.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:51.906 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:51.906 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:51.923 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:51.923 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:51.939 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:51.939 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:51.955 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:51.955 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:51.957 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:51.952+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:51.973 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:51.973 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:51.992 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:51.992 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:52.012 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:52.013 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:52.026 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.026 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.032 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:52.032 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:52.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:52.090 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:52.088+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:52.159 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.159 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.159 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:52.156+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:52.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:52.261 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:52.260+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:52.340 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.341 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.355 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:52.362 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:52.360+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:52.463 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:52.460+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:52.471 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.471 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:52.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:54:52.586 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:52.584+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:52.609 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.609 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.623 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:52.669 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:52.668+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:52.747 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.747 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:52.766 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:52.764+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:52.868 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:52.864+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:52.929 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:52.929 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:52.943 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:52.989 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:52.988+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:53.064 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.064 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.069 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:53.068+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:53.079 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:53.170 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:53.168+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:53.246 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.246 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:53.308 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:53.308+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:53.372 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:53.368+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:53.394 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.394 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.398 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:53.484 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:54:53.484 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:53.484+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:53.562 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.563 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.573 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:53.572+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:53.577 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:53.674 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:53.672+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:53.706 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.707 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.720 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:53.775 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:53.772+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:53.876 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:53.872+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:53.885 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:53.885 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:53.899 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:53.976 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:53.976+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:54.049 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:54.067 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:54.067 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:54.077 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:54.076+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:54.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:54.177 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:54.172+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:54.199 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:54.217 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:54.217 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:54.233 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:54.234 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:54.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:54.266 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:54.269 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:54.269 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:54.269 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:54.269 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:54.279 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:54.276+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:54.288 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:54.296 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:54.297 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:54.318 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:54.318 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:54.338 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:54.339 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:54.359 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:54.360 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:54.415 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:54.412+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:54.428 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:54.514 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:54.512+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:54.582 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:54.580+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.248752475000003, 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:54:54.598 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:54:54.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.209877982999998, 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:54:54.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:54:54.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.204800673000001, 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:54:54.607 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:54:54.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.204142435000001, 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:54:54.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:54:54.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.197365468000001, 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:54:54.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.102686972999997, 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.218204485000001, 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:54:54.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.199045552999998, 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.632 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:54:54.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:54:54.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.172936268000001, 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.638 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:54:54.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:54:54.643 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.154216040999998, 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.644 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:54:54.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:54:54.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.649 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.120997512000002, 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.650 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.655 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.092955476999997, 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:54.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:54:54.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:54:54.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.077446825000003, 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.661 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.067097036, 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.667 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:54:54.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.672 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.033522212000001, 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:54:54.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:54.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.74230609, 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:54:54.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:54:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.655558308000003, 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:54:54.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:54:54.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.594542314999998, 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:54:54.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.440851635999998, 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:54:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:54:54.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:54:54.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:54:54.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.374715287000001, 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:54:54.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:54:54.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:54.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:54:54.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:54.705 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:54.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:54.707 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:54.708+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:54.807 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:54.808+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:54.879 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:54.879 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:54.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:54.942 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:54.940+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:55.010 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:55.008+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:55.015 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:55.015 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:55.015 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:55.016 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:55.016 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:55.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:55.110 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:55.108+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.794690731000003, 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:54:55.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.779313745000003, 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:55.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:54:55.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.803186627999999, 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:54:55.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:54:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:54:55.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.793814175000001, 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:54:55.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:54:55.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:54:55.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.715430284, 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.225 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:54:55.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.400960079999997, 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:54:55.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.236 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.397384520999999, 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:54:55.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:54:55.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:54:55.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.361842283999998, 2024-04-22T19:54:55.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:54:55.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.233632716999999, 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:54:55.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.229977517999998, 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.254 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:54:55.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.178708323000002, 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.260 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:54:55.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:54:55.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:54:55.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.174871797999998, 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:54:55.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.271 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.165160145000002, 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:54:55.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.161672514000003, 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.277 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:54:55.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.118965379999999, 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.283 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.288 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.115045180999999, 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.032743254000003, 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.294 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:54:55.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:54:55.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.029030816000002, 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:54:55.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:54:55.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:54:55.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.939151877999997, 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.305 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.925935273999997, 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.311 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:54:55.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:54:55.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:54:55.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.316 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:55.317 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:55.318 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:55.316+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:55.418 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:55.416+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:55.445 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:55.445 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:55.445 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:55.445 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:55.460 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:55.514 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:54:55.546 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:55.544+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:55.619 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:55.616+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:55.625 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:55.625 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:55.626 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:55.626 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:55.626 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:55.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:55.721 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:55.720+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:55.799 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:55.799 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.382764389000002, 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:55.800 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:54:55.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.391988146999999, 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:54:55.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.811 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.391879987999999, 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:54:55.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.424531838, 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.818 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.823 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.386376720999998, 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:54:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.345583316999999, 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.830 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:54:55.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:54:55.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.338298119000001, 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:54:55.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:54:55.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.331113940999998, 2024-04-22T19:54:55.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:54:55.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:54:55.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.236210067999998, 2024-04-22T19:54:55.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:55.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:54:55.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:55.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.162723579000001, 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:54:55.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.161245715, 2024-04-22T19:54:55.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:54:55.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.157985942000003, 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.927937966999998, 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:55.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:54:55.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:55.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.914363463000001, 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:55.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.860744361999998, 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:54:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:54:55.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:54:55.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:54:55.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.782593292000001, 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:54:55.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:54:55.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.756105503000001, 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.894 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:54:55.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.675922038000003, 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.900 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:54:55.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.656335372000001, 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.906 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:54:55.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:54:55.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.563661969000002, 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:55.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:54:55.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:54:55.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:54:55.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:55.917 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:55.919 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:54:55.919 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:55.916+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:56.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:56.016+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:56.050 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:56.050 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:56.050 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:56.050 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:56.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:54:56.120 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:56.120+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:56.185 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:54:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:54:56.186 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:56.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:54:56.221 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:56.220+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:56.322 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:56.320+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.022217593000001, 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:54:56.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.990742378999997, 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:54:56.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.382 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.975546588, 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.383 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:54:56.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:54:56.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.897561058000001, 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:54:56.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:54:56.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:54:56.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:54:56.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.877839662, 2024-04-22T19:54:56.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:54:56.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:54:56.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.871654169999999, 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:54:56.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:54:56.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.405 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.859683892, 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:54:56.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:54:56.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:54:56.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.781963756000003, 2024-04-22T19:54:56.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:54:56.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:54:56.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.776548452999997, 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.422 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.77436247, 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:54:56.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:54:56.428 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.682824856000003, 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:54:56.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:54:56.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:54:56.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:54:56.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.492150623999997, 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:54:56.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:54:56.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:54:56.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.421861475999997, 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:54:56.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:54:56.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.417762256000003, 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:54:56.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:54:56.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.408264930999998, 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:54:56.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.261020948999999, 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:54:56.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:54:56.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:54:56.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:54:56.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:54:56.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.253875416, 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:54:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:54:56.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:54:56.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.249907989999997, 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:54:56.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:54:56.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.188517427999997, 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:54:56.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:54:56.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:54:56.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.479 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.184065068000002, 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:54:56.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:54:56.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:54:56.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:54:56.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:54:56.485 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:56.485 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:54:56.486 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:54:56.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:54:56.490 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:56.488+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:56.588 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:56.584+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:56.632 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:56.633 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:56.649 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:56.659 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:54:56.659 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:54:56.659 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:54:56.659 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:54:56.666 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:56.667 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:56.673 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:54:56.684 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:56.684 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:56.701 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:56.702 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:56.717 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:56.716+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:56.719 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:56.738 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:56.738 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:56.757 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:56.757 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:56.789 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:56.788+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:56.792 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:56.792 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:56.807 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:54:56.893 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:56.892+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:56.974 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:56.974 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:56.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:54:57.037 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:57.036+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:57.091 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:57.088+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:57.160 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.160 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:54:57.192 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:57.192+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:57.293 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:57.292+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:57.341 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.342 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.357 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:54:57.394 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:57.392+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:57.495 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:57.492+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:57.518 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.518 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:54:57.596 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:57.592+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:57.653 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.653 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:54:57.713 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:54:57.712+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:54:57.789 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.790 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.797 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:57.792+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:57.804 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:54:57.898 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:57.900+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:57.961 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:57.961 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:57.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:54:57.999 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:57.996+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:58.100 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:58.100+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:58.107 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.107 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:54:58.201 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:58.196+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:58.243 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.243 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:54:58.303 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:58.300+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:58.403 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:58.400+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:58.421 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.421 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.435 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:54:58.504 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:58.500+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:58.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:54:58.559 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.559 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.574 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:54:58.605 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:58.604+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:58.706 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:58.704+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:58.747 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.747 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:54:58.776 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:54:58.811 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:58.804+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:58.908 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:54:58.904+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:54:58.933 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:54:58.933 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:54:58.942 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:54:58.942 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:54:58.948 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:54:58.959 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:54:58.959 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:54:58.975 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:54:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:54:58.991 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:54:58.992 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:54:59.009 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:59.004+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:59.014 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:54:59.014 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:54:59.032 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:54:59.032 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:54:59.053 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:54:59.053 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:54:59.073 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:54:59.074 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:54:59.074 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.074 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:59.074 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:59.074 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:59.090 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:54:59.135 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:54:59.132+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:54:59.211 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:59.208+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:59.249 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:59.250 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:59.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:54:59.312 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:59.312+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.385 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.977965597000001, 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:54:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:59.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:59.391 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.962588611000001, 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:54:59.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:54:59.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.986461493999997, 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.397 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:54:59.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.977089040999999, 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.403 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:54:59.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:54:59.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.898705149999998, 2024-04-22T19:54:59.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.584234946000002, 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:54:59.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:54:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:54:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.580659386999997, 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:54:59.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:54:59.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:54:59.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.545117150000003, 2024-04-22T19:54:59.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:54:59.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:54:59.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:54:59.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.416907582999997, 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:54:59.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:54:59.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.413252384000003, 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.361983189, 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.441 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:54:59.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:54:59.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.358146664000003, 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.447 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.452 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.348435010999999, 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.453 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:54:59.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:54:59.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.344947380000001, 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:54:59.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:54:59.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:54:59.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:54:59.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.302240245999997, 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.464 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.469 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.298320046999997, 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.470 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.216018120000001, 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:54:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:54:59.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.212305682, 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.481 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:54:59.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:54:59.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.122426744000002, 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.487 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:54:59.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.109210140000002, 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.493 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:54:59.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.499 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.499 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.499 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:59.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:54:59.501 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:54:59.496+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:54:59.514 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:54:59.601 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:54:59.600+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:54:59.642 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.642 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:59.642 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:54:59.642 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:59.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:54:59.702 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:54:59.700+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:54:59.778 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.778 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:54:59.778 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:54:59.778 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:54:59.778 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:54:59.792 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:54:59.803 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:54:59.800+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:54:59.903 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:54:59.900+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:54:59.922 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:54:59.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.546248978999998, 2024-04-22T19:54:59.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:54:59.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:54:59.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:54:59.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.555472737000002, 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.973 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:54:59.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:54:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:54:59.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.555364578000002, 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:54:59.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.588016428000003, 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.985 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:54:59.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:54:59.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.549861311000001, 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:54:59.991 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:54:59.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.509067907000002, 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:54:59.997 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:54:59.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:55:00.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:55:00.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.501782708999997, 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:55:00.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.494598531000001, 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.009 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:00.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:00.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.399694658000001, 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:55:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:55:00.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.326208168999997, 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.021 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:55:00.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:55:00.026 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.324730305000003, 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:00.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.032 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.321470531999999, 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:00.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:00.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:00.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.091422557000001, 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:55:00.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:55:00.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.077848052999997, 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.045 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:00.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:55:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.024228952000001, 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.051 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:55:00.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:55:00.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.946077881999997, 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:00.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.919590092999997, 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:55:00.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:55:00.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.839406627999999, 2024-04-22T19:55:00.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:00.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:55:00.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:00.075 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.819819961999997, 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:55:00.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:55:00.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:55:00.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.727146558999998, 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:55:00.081 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:55:00.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:00.087 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:00.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:00.089 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:00.088+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:00.190 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:00.188+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:00.211 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:00.212 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:00.212 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:00.212 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:00.226 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:00.291 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:00.288+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:00.392 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:00.388+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:00.396 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:00.397 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:00.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:00.492 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:00.492+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:00.531 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.183377514, 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.151902300000003, 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.136706509, 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:55:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.058720979, 2024-04-22T19:55:00.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:55:00.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.038999582999999, 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:55:00.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:55:00.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:55:00.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.032814090999999, 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.559 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:55:00.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:55:00.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:00.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:00.564 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.020843812999999, 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:55:00.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:55:00.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.943123677000003, 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:00.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:00.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.937708374000003, 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.935522390999999, 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.582 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:55:00.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:55:00.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.843984777000003, 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:00.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.653310544999997, 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:55:00.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:55:00.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.599 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.583021397000003, 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.600 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:55:00.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:55:00.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:55:00.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.578922177000003, 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:55:00.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:55:00.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.569424851999997, 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:55:00.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:55:00.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:55:00.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.422180869999998, 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:55:00.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:55:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.415035336999999, 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.624 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.411067911000004, 2024-04-22T19:55:00.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:00.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:55:00.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.349677348999997, 2024-04-22T19:55:00.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:55:00.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:55:00.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:55:00.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.345224989000002, 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:00.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:00.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:55:00.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:00.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:55:00.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:55:00.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:00.647 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:00.648 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:00.649 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:00.650 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:00.648+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:00.750 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:00.748+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:00.819 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:00.819 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:00.819 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:00.819 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:00.835 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:00.877 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:00.876+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:00.952 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:00.952+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:00.994 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:00.994 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:00.994 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:00.994 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:00.994 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:01.009 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:01.053 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:01.052+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:01.096 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:01.154 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:01.152+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.789324008999998, 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.783919347000001, 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:01.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:01.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.188 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.810727395000001, 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.189 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:01.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.729561834999998, 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.195 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:01.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:01.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:01.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.725910583999998, 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.201 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:01.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:01.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:01.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.696197478000002, 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:01.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.212 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.679009237000002, 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:01.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:01.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:01.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:01.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:01.217 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.654850785999997, 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:01.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.632572201000002, 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.632511813999997, 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:01.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.628935036000001, 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:01.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:01.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:01.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.624254894000003, 2024-04-22T19:55:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:01.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:01.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.624180944000003, 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.246 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.624095341, 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:01.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:01.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.586726456000001, 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:01.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:01.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.584792108999999, 2024-04-22T19:55:01.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:01.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.581713831000002, 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:01.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:01.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.578539298999999, 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.274 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:01.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.368488458000002, 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:01.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:01.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:01.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.322214076000002, 2024-04-22T19:55:01.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:01.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.289 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:01.290 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:01.290 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:01.291 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:01.292 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:01.292 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:01.293 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:01.293 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:01.292+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:01.293 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:01.293 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:01.300 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:01.301 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:01.322 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:01.322 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:01.343 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:01.343 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:01.363 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:01.363 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:01.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:01.382 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:01.392 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:01.388+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:01.468 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:01.468 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:01.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:01.525 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:01.524+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:01.547 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:55:01.593 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:01.592+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:01.646 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:01.646 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:01.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:01.705 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:01.704+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:01.795 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:01.792+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:01.824 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:01.824 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:01.838 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:01.896 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:01.892+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:01.959 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:01.959 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:01.973 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:01.997 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:01.992+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:02.098 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:02.096+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:02.140 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.140 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.155 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:02.199 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:02.200+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:02.277 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.277 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.291 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:02.338 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:02.336+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:02.400 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:02.400+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:02.422 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.422 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:02.522 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:02.520+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:02.526 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:55:02.601 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:02.596+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.618 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:02.706 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:02.704+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:02.785 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.785 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.799 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:02.842 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:02.840+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:02.904 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:02.900+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:02.961 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:02.961 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:02.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:03.018 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:03.016+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:03.105 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:03.100+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:03.139 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:03.140 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:03.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:03.206 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:03.204+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:03.307 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:03.308+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:03.323 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:03.323 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:03.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:03.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:03.446 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:03.444+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:03.459 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:03.459 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:03.475 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:03.518 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:03.516+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:03.539 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:03.539 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:03.556 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:03.556 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:03.574 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:03.575 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:03.591 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:03.609 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:03.604+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:03.612 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:03.633 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:03.633 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:03.634 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:03.634 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:03.634 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:03.635 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:03.635 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:03.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:03.653 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:03.654 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:03.674 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:03.674 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:03.734 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:03.732+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:03.782 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.374204579000001, 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:55:03.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:55:03.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.788 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.358827593000001, 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:55:03.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.382700475999997, 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:55:03.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:03.799 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.373328022999999, 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.294944131999998, 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:55:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:55:03.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.980473928000002, 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:55:03.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.976898368999997, 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:55:03.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:55:03.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:55:03.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:55:03.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.941356132000003, 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:03.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.813146564999997, 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.809491366000003, 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.831 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:03.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.758222171, 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:55:03.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:55:03.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:55:03.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.754385646000003, 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:55:03.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:55:03.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.744673992999999, 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.741186362000001, 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:55:03.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.698479227999997, 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.859 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:55:03.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.694559028999997, 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:55:03.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.612257102000001, 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:03.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:55:03.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:55:03.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.608544664, 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:55:03.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.518665726000002, 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:55:03.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:55:03.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:55:03.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:55:03.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.505449122000002, 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:03.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:03.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:03.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:03.893 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:03.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:03.895 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:03.896+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:03.995 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:03.992+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:04.066 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:04.066 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:04.066 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:04.066 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:04.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:04.127 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:04.124+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:04.197 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:04.192+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:04.200 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:04.200 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:04.200 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:04.201 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:04.201 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:04.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:04.302 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:04.300+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.968051060999997, 2024-04-22T19:55:04.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:04.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:55:04.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:55:04.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:55:04.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.977274819000002, 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:55:04.392 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.977166660000002, 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:55:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:55:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:55:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.009818510000002, 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:55:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:55:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:55:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.971663393, 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:55:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.930869989000001, 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:55:04.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:55:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.923584791000003, 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.422 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:55:04.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:55:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.916400613, 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.428 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:04.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.821496740000001, 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.434 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:55:04.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:55:04.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:04.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:55:04.440 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.748010250999997, 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.441 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:55:04.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.746532387000002, 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:04.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.743272613999999, 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.513224639000001, 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.459 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:55:04.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:55:04.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.464 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.499650135000003, 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:55:04.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:55:04.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:55:04.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.446031034000001, 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:55:04.470 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:55:04.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:55:04.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:55:04.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:04.476 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.367879963999997, 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:04.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:55:04.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:04.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.341392175000003, 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:55:04.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:04.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:04.488 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.261208709999998, 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:55:04.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:55:04.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.241622044000003, 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:55:04.494 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.499 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.148948640999997, 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.500 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:55:04.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:55:04.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:04.506 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:04.506 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:04.507 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:04.508 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:04.508+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:04.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:55:04.608 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:04.604+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:04.645 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:04.645 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:04.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:04.709 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:04.704+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:04.782 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:04.782 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:04.782 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:04.782 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:04.782 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:04.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:04.841 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:04.840+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:04.911 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:04.908+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:04.924 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:04.924 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:04.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.574547838999997, 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.925 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:04.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:04.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:04.930 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.543072625000001, 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:04.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.527876833999997, 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:55:04.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.449891303999998, 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:55:04.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:55:04.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:55:04.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:55:04.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.430169908000003, 2024-04-22T19:55:04.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:55:04.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.423984416000003, 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.412014138000004, 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.960 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:55:04.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.965 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.334294002, 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.966 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:04.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:04.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.328878699000001, 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:04.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.326692715999997, 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:55:04.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.235155102, 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:04.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:04.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.044480870000001, 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:55:04.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:04.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:04.996 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.974191722, 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:55:04.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:55:04.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:55:05.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.970092502, 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:55:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.960595177000002, 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.008 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:55:05.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.813351195000003, 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.014 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:05.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:55:05.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.806205661999996, 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.802238236000001, 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.026 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:55:05.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:55:05.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:55:05.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.740847674000001, 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:55:05.031 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:55:05.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.736395313999999, 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:55:05.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.043 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:05.045 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:05.045 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:05.044+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:05.146 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:05.144+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:05.214 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:05.214 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:05.214 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:05.214 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:05.228 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:05.247 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:05.248+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:05.348 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:05.344+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:05.354 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:05.354 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:05.354 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:05.354 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:05.354 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:05.369 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:05.457 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:05.456+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:05.527 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:05.543 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.154606995000002, 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:05.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:05.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:05.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.149202332999998, 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:05.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:05.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.176010380999998, 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.555 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:05.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:05.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.094844821000002, 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:05.566 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.091193570000002, 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:05.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:05.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:05.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:05.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.061480463999999, 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:05.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:05.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.044292222999999, 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.020133772000001, 2024-04-22T19:55:05.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:05.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:05.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:05.589 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.997855186999999, 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.997794800000001, 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.595 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:05.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.994218021999998, 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:05.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:05.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.98953788, 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:05.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:05.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.989463929999999, 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:05.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:05.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.989378326999997, 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:05.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:05.624 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.952009441999998, 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:05.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.950075095000003, 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:05.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:05.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.946996816999999, 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.634 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.943822285000003, 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:05.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:05.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.733771443999998, 2024-04-22T19:55:05.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.687497061999998, 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:05.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:05.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:05.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:05.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:05.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.655 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:05.655 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:05.655 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:05.657 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:05.652+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:05.657 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:05.692 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:05.757 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:05.756+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:05.828 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:05.828 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:05.828 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:05.828 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:05.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:05.850 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:05.850 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:05.858 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:05.856+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:05.866 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:05.866 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:05.883 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:05.883 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:05.899 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:05.899 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:05.918 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:05.935 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:05.935 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:05.953 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:05.959 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:05.956+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:05.973 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:05.973 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:06.060 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:06.056+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:06.148 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.148 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.161 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:06.160+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:06.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:06.261 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:06.260+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:06.329 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.329 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:06.362 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:06.360+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:06.463 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:06.460+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:06.466 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.466 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:06.564 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:06.560+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:06.603 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.603 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.617 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:06.664 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:06.660+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:06.750 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.750 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:06.766 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:06.764+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:06.866 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:06.864+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:06.925 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:06.925 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:06.939 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:06.967 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:06.964+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:07.068 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:07.064+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:07.105 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.105 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:07.169 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:07.164+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:07.243 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.243 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:07.298 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:07.296+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:07.371 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:07.368+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:07.425 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.425 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:07.472 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:07.468+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:07.572 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:07.568+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:07.605 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.605 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.620 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:07.658 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:55:07.673 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:07.672+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:07.774 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:07.776+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:07.798 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.798 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.813 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:07.875 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:07.872+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:07.928 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:07.929 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:07.943 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:07.976 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:07.976+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:07.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:08.077 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:08.076+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:08.110 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:08.110 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:08.125 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:08.175 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:08.175 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:08.177 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:08.172+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:08.192 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:08.193 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:08.209 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:08.209 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:08.225 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:08.225 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:08.242 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:08.243 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:08.243 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:08.243 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:08.246 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:08.246 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:08.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:08.267 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:08.267 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:08.288 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:08.288 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:08.284+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:08.309 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:08.309 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:08.380 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:08.376+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:08.386 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:08.387 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:08.387 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:08.387 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:08.387 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:08.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:08.481 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:08.476+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:08.518 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:08.518 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:08.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:08.518 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:08.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.102857669000002, 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.519 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:55:08.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:55:08.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:08.524 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.112081427, 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:08.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:55:08.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:55:08.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.111973268, 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.530 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:55:08.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:55:08.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:55:08.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.144625118, 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:55:08.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:55:08.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.106470000999998, 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.541 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:08.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:08.546 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.065676597, 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:55:08.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:55:08.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:55:08.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:55:08.551 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.058391399000001, 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.552 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:55:08.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:55:08.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:55:08.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.051207220999999, 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.557 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:08.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:08.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:08.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.956303347999999, 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:55:08.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.882816859000002, 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:55:08.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:55:08.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:55:08.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.881338995, 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.575 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:08.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.878079221999997, 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:08.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.648031246999999, 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:55:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:55:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:55:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.634456743000001, 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:55:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:55:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.580837641999999, 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:55:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.502686572000002, 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:55:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:55:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.476198783000001, 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:55:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:55:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:55:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:55:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.396015318000003, 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:55:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:55:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:55:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.376428652000001, 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:55:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:55:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:55:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.283755249000002, 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:55:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:55:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:55:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:55:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:08.632 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:08.633 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:55:08.634 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:08.635 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:08.632+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:08.735 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:08.732+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:08.767 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:08.767 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:08.767 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:08.767 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:08.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:08.873 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:08.872+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:08.936 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:08.932+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:08.952 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:08.952 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:08.952 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:08.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:08.952 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:08.966 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:09.053 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:09.052+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:09.137 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:09.136+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.139 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.789124135999998, 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.757648922000001, 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:09.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:09.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:09.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.742453130999998, 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.149 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.154 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.664467600999998, 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:55:09.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:55:09.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.644746204999997, 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:55:09.160 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:55:09.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:55:09.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:55:09.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.638560712999997, 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.626590434999997, 2024-04-22T19:55:09.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.548870299000001, 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.543454996000001, 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:09.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:09.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:09.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.187 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.541269012999997, 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.449731399000001, 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:09.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.198 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.259057167000002, 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:09.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:55:09.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:55:09.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:55:09.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:55:09.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.188768019000001, 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:55:09.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:55:09.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.184668799000001, 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:55:09.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.175171474000003, 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:55:09.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:55:09.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.027927492000003, 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:55:09.221 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:55:09.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.020781958999997, 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:55:09.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:55:09.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.016814533000002, 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.232 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:55:09.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.955423971000002, 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.950971611, 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:55:09.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.249 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.249 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.249 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:09.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:09.251 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:09.248+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:09.351 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:09.348+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:09.420 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:09.420 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:09.420 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:09.420 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:09.434 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:09.452 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:09.452+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:09.553 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:09.552+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:09.602 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:09.603 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:09.603 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:09.603 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:09.603 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:09.617 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:09.661 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:09.660+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:09.755 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:09.756+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.399999018999999, 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.789 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:09.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:09.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.394594357000003, 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.795 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:09.800 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.421402405000002, 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:09.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:09.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.340236845, 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.807 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:09.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:09.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:09.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.336585593999999, 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:09.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:09.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.818 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.306872488000003, 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:09.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:09.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.289684246999997, 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:09.824 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:09.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:09.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:09.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.265525795999999, 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:09.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:09.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.243247211000003, 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.836 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:09.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:09.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.243186823999999, 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:09.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:09.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:09.847 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.239610046000003, 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.234929903999998, 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.853 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:09.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:09.858 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.234855953999997, 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:09.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.234770351000002, 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:09.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:09.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:09.870 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.197401466000002, 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:09.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.874 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.195467119, 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.192388841000003, 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.879 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:09.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:09.883 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.189214309, 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:09.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.979163468000003, 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:09.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:09.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:09.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.932889086000003, 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:09.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:09.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:09.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:09.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:09.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:09.899 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:09.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:09.901 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:09.900+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:10.002 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:10.000+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:10.029 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:10.029 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:10.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:10.030 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:10.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:10.102 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:10.100+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:10.165 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:10.165 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:10.165 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:10.166 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:10.166 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:10.179 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:10.221 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:10.220+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:10.304 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:10.304+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:10.327 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:10.350 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.994374458999999, 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:10.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:55:10.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:55:10.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:55:10.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:55:10.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.962619949999997, 2024-04-22T19:55:10.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:55:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:55:10.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:10.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.947341277, 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:10.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:55:10.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:55:10.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:10.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.944315422999999, 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.370 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:10.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:55:10.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.860828318999999, 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:55:10.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:55:10.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.962387282000002, 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.380 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:55:10.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.384 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.879537747999997, 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.832987551000002, 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:55:10.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:55:10.394 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.829698133999997, 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:55:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:55:10.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.828638116, 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:55:10.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:55:10.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:10.403 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.824947291000001, 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.407 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.822007714000001, 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:55:10.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:10.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.810661160999999, 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:10.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.416 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.804982897999999, 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:10.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:55:10.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.421 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.795506736, 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:55:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:55:10.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.778857588000001, 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.426 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:10.430 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.773621116999998, 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:55:10.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.434 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.771288007999999, 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:55:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:55:10.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.691662272000002, 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:55:10.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.443 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.637355159000002, 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:10.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:10.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.448 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:10.448 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:10.448 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:10.449 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:10.450 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:10.444+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:10.482 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:10.482 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:10.498 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:10.499 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:10.516 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:10.533 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:10.533 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:10.550 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:10.548+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:10.553 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:10.554 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:10.574 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:10.574 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:10.594 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:10.594 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:10.614 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:10.614 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:10.620 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:10.621 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:10.635 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:10.636 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:55:10.681 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:10.680+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:10.751 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:10.748+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:10.758 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:10.759 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:10.774 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:10.852 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:10.848+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:10.945 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:10.946 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:10.953 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:10.948+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:10.960 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:11.054 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:11.052+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:11.098 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.098 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.113 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:11.155 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:11.152+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:11.249 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.249 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.256 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:11.252+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:11.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:11.356 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:11.352+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:11.434 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.434 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:11.458 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:11.456+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:11.559 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:55:11.561 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:11.556+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:11.639 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.639 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.654 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:11.702 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:11.700+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:11.761 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:11.760+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:11.775 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.775 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:11.882 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:11.880+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:11.955 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:11.955 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:11.962 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:11.960+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:11.969 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:12.066 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:12.060+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:12.136 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:12.137 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:12.151 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:12.194 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:12.196+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:12.261 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:12.261 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:12.264 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:12.264+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:12.274 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:12.365 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:12.364+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:12.444 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:12.444 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:12.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:12.466 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:12.464+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:12.567 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:12.568+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:12.615 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:12.615 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:12.629 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:12.632 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:12.668 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:12.664+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:12.769 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:12.768+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:12.786 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:12.786 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:12.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:12.811 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:12.812 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:12.829 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:12.829 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:12.848 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:12.848 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:12.864 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:12.864 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:12.870 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:12.868+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:12.885 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:12.885 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:12.906 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:12.907 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:12.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.509247735000002, 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:12.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:55:12.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.518471493, 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.518363334, 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.937 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:55:12.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:55:12.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.551015184000001, 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.948 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.512860066999998, 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:55:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:55:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:55:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.472066663, 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:55:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:55:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.464781465000002, 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:55:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.965 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.457597286999999, 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.362693413999999, 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:55:12.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:55:12.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.289206925000002, 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:55:12.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:55:12.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:55:12.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.287729061, 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.284469287999997, 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.994 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.054421312999999, 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:12.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:55:12.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:55:12.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.040846809000001, 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:55:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:55:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.987227707999999, 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:55:13.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.909076638000002, 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:13.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:55:13.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:55:13.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.882588849000001, 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.017 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.022 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.802405383999997, 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:13.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:55:13.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.782818718000001, 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:55:13.028 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:55:13.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:55:13.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:55:13.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.690145315000002, 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:55:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:55:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:13.040 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:13.041 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:13.041 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:13.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:13.042 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:13.043 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:13.043 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:13.040+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:13.142 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:13.140+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:13.175 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:13.175 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:13.175 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:13.175 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:13.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:13.277 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:13.276+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:13.343 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:13.344+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:13.358 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:13.358 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:13.358 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:13.358 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:13.358 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:13.372 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:13.461 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:13.460+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:13.546 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.197293307000002, 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:13.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:13.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:13.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:13.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.553 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.165818092999999, 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.554 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.150622302000002, 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:55:13.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:13.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:55:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.568 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.072636772000003, 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:55:13.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.052915376000001, 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.575 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:55:13.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.046729884000001, 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:55:13.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.034759606000001, 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:55:13.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:55:13.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:55:13.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:55:13.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:13.598 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.957039469999998, 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:13.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:13.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.604 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.951624166999999, 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.949438184000002, 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:13.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:55:13.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:55:13.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.857900569999998, 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.621 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:13.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:13.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.667226337999999, 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:55:13.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.596937189999998, 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:55:13.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:55:13.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:55:13.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:55:13.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.592837969999998, 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:55:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:55:13.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:55:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:55:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.583340645, 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:55:13.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:55:13.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:55:13.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:55:13.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:55:13.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:55:13.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.436096663000001, 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:55:13.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.428951130000002, 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:55:13.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:13.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:55:13.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:13.671 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.424983703999999, 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:55:13.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:55:13.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.363593141999999, 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.679 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:55:13.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.359140781999997, 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:13.687 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:13.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:13.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:13.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:55:13.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.695 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:13.695 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:13.695 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:13.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:55:13.696 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:13.544+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:13.697 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:13.697 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:13.696+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:13.797 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:13.796+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:13.869 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:13.870 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:13.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:13.870 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:13.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:13.897 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:13.896+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:13.998 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:14.000+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:14.006 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.006 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:14.006 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:14.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:14.006 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.020 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:14.099 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:14.100+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:14.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.757075440000001, 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:14.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.751670777999998, 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.150 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.157 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.778478825999997, 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:14.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.697313266000002, 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:14.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:14.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:14.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.693662015000001, 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:14.169 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:14.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:14.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:14.174 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.663948908999998, 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.175 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:14.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:14.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:14.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.646760667999999, 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.181 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:14.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:14.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.622602217000001, 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:14.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:14.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:14.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:14.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.600323631999998, 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:14.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:14.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:14.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.600263245000001, 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:14.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:14.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:14.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.596686466999998, 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:14.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:14.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.592006325, 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:14.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.216 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.591932374999999, 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.217 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.591846771999997, 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:14.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:14.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:14.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.554477886999997, 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.228 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:14.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:14.232 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.552543540000002, 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:14.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.236 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.549465261999998, 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:14.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:14.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:14.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:14.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.546290730000003, 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:14.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.336239888999998, 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.245 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:14.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:14.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.289965506999998, 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:14.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:14.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.256 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:14.258 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:14.256+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:14.359 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:14.360+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:14.385 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.385 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:14.385 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:14.385 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.399 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:14.460 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:14.460+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:14.516 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.516 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:14.516 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:14.516 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:14.516 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:14.573 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:55:14.577 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:14.576+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:14.656 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.656 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.301559802, 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:55:14.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:14.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.269805292999997, 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:55:14.664 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:55:14.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.25452662, 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:55:14.670 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:55:14.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:55:14.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:55:14.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.251500765999999, 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:55:14.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:55:14.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.168013662, 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.269572625000002, 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:55:14.686 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:55:14.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.186723090999998, 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.140172894000003, 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.136883476999998, 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.699 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.135823459000001, 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.703 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:55:14.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:55:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:14.707 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.132132634000001, 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:55:14.711 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.129193057000002, 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:55:14.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.117846503999999, 2024-04-22T19:55:14.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:14.720 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.112168240999999, 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:55:14.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:55:14.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:55:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.102692079000001, 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:55:14.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:55:14.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.086042931000001, 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:14.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.080806459999998, 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.733 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:55:14.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.078473351, 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:55:14.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:55:14.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.998847615000003, 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.742 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:55:14.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:55:14.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.944540502000002, 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:14.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:55:14.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:14.751 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.753 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:14.753 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:14.752+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:14.854 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:14.852+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:14.923 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:14.923 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:14.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:14.923 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:14.939 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:14.981 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:14.980+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:15.044 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:15.056 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:15.052+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:15.106 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:15.106 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:15.106 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:15.106 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:15.106 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:15.121 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:15.167 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:15.164+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:15.195 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:15.195 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:15.211 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:15.212 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:15.228 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:15.228 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:15.244 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:15.244 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:15.257 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:15.256+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:15.263 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:15.263 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:15.284 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:15.284 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.528164066000002, 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.294 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:15.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:15.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.527971414000007, 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.468279550999995, 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.468214969000002, 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:15.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.468084032999997, 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:15.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:15.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:15.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:15.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.361445881999998, 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.321 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.326 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.361314919999998, 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:15.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:15.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:15.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:15.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:15.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.361075701999994, 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:15.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:15.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:15.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360999723000006, 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.337 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:15.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:15.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.342 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360926980000002, 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360615175999996, 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360549703000004, 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360489430000001, 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360330083999997, 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.360256905, 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.112045108000004, 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.111940376000007, 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.111922211000007, 2024-04-22T19:55:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.111905196999999, 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.111801978000003, 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:15.401 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:15.402 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:15.402 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:15.403 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:15.403 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:15.400+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:15.403 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:15.404 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:15.503 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:15.504+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:15.564 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:15.564 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:15.577 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:15.606 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:15.604+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:15.705 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:15.704+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:15.740 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:15.740 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:15.754 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:15.806 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:15.804+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:15.907 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:15.908+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:15.923 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:15.923 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:15.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:16.008 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:16.004+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:16.102 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.102 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.109 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:16.108+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:16.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:16.210 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:16.212+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:16.238 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.238 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:16.342 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:16.344+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:16.400 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.400 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.412 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:16.407+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:16.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:16.513 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:16.511+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:16.575 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.575 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:16.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:55:16.613 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:16.611+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:16.714 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:16.712+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:16.722 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.722 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:16.814 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:16.811+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:16.891 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:16.892 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:16.904 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:16.915 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:16.911+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:17.016 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:17.016+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:17.028 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:17.028 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:17.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:17.117 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:17.115+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:17.214 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:17.214 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:17.218 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:17.220+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:17.228 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:17.319 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:17.320+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:17.387 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:17.387 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:17.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:17.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:17.445 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:17.443+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:17.521 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:17.520+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:17.530 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:17.530 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:17.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:17.586 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:17.587 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:17.592 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:55:17.613 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:17.613 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:17.630 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:17.630 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:17.633 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:17.631+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:17.646 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:17.646 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:17.662 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:17.663 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:17.681 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:17.681 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:17.700 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:17.700 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:17.716 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:17.716 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:17.716 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:17.716 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:17.716 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:17.719 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:17.719 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:17.722 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:17.719+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:17.731 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:17.823 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:17.824+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:17.899 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.548789839000001, 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:17.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.517314624999997, 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:17.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:17.908 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.502118834000001, 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033977780000000002, 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-22T19:55:17.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394762+0000", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394765+0000", 2024-04-22T19:55:17.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394780+0000", 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4912000000000001e-05 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394818+0000", 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8071000000000002e-05 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394835+0000", 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6758000000000001e-05 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.394976+0000", 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109499999999999 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395207+0000", 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231494 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.395679+0000", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047200699999999998 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397119+0000", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001439819 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.397995+0000", 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087551700000000003 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398090+0000", 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5371999999999994e-05 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.398160+0000", 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9521000000000001e-05 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.914 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.424133304000001, 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003414565, 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472747+0000", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472750+0000", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472763+0000", 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3055e-05 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472792+0000", 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9317999999999999e-05 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472807+0000", 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5116000000000001e-05 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.472924+0000", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116267 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473140+0000", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021679499999999999 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.473588+0000", 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044749900000000002 2024-04-22T19:55:17.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.474981+0000", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00139266 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.475896+0000", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000915557 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476046+0000", 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015003 2024-04-22T19:55:17.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.476162+0000", 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011563800000000001 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.404411908, 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029653409999999998, 2024-04-22T19:55:17.920 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 241 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492469+0000", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492473+0000", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8929999999999998e-06 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492488+0000", 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455e-05 2024-04-22T19:55:17.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492534+0000", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5952999999999999e-05 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492560+0000", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5984999999999999e-05 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.492723+0000", 2024-04-22T19:55:17.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016284900000000001 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493066+0000", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034317199999999999 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.493586+0000", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052022600000000004 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.494906+0000", 2024-04-22T19:55:17.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001319499 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495217+0000", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031103400000000002 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495318+0000", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101462 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.495434+0000", 2024-04-22T19:55:17.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115813 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.398226416, 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033416499999999998, 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 278 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498654+0000", 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498656+0000", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.793e-06 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498667+0000", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1246e-05 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498691+0000", 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3481000000000001e-05 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498726+0000", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5123999999999998e-05 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.498871+0000", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145348 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499279+0000", 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000407439 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499996+0000", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071762300000000002 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501744+0000", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001748007 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501777+0000", 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2597e-05 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501885+0000", 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010805499999999999 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501996+0000", 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110937 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:347 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.931 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.386256138, 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031280879999999998, 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 347 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510624+0000", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510627+0000", 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7360000000000001e-06 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510641+0000", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3859000000000001e-05 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510683+0000", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1853000000000001e-05 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510704+0000", 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1458999999999999e-05 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.510957+0000", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025302499999999998 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511262+0000", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000304884 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.511817+0000", 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055441099999999999 2024-04-22T19:55:17.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513195+0000", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013785010000000001 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513533+0000", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033751199999999999 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513651+0000", 2024-04-22T19:55:17.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011845000000000001 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.513753+0000", 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010139799999999999 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.308536001999997, 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.937 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:17.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:17.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.303120698999997, 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:17.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:17.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:17.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:17.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:17.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:506 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.300934716, 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030799270000000001, 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 506 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595946+0000", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595948+0000", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7439999999999999e-06 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595955+0000", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6850000000000001e-06 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595979+0000", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3677999999999999e-05 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595991+0000", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1603999999999999e-05 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596099+0000", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108288 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596231+0000", 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013225699999999999 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.596509+0000", 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027796500000000003 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597465+0000", 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000955936 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598876+0000", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001410492 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598969+0000", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3728999999999997e-05 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.599026+0000", 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6548999999999997e-05 2024-04-22T19:55:17.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.209397101999997, 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:17.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:17.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.018722869999998, 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028734960000000001, 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 775 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.960 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878158+0000", 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878160+0000", 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6259999999999999e-06 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878173+0000", 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2182e-05 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878204+0000", 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1044999999999998e-05 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878224+0000", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0390999999999998e-05 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878371+0000", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146835 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878590+0000", 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021902099999999999 2024-04-22T19:55:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.878926+0000", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033611200000000001 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880036+0000", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00111038 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880848+0000", 2024-04-22T19:55:17.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00081133599999999996 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.880962+0000", 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114813 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.881031+0000", 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8755000000000002e-05 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.948433721999997, 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028282799999999999, 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 808 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948447+0000", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948449+0000", 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4959999999999999e-06 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948463+0000", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3926e-05 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948493+0000", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9665000000000001e-05 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948508+0000", 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4601e-05 2024-04-22T19:55:17.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948636+0000", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012875300000000001 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.948854+0000", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021811199999999999 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.949158+0000", 2024-04-22T19:55:17.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030334399999999999 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.950290+0000", 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011325420000000001 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951111+0000", 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082108799999999998 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951197+0000", 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5333000000000004e-05 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.951275+0000", 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8419999999999998e-05 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.944334501999997, 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031553760000000001, 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 810 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:17.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952546+0000", 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952548+0000", 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952556+0000", 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9300000000000003e-06 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952574+0000", 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8128e-05 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952585+0000", 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1256e-05 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952699+0000", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113694 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.952923+0000", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224334 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.953395+0000", 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000471457 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.954659+0000", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001264474 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955534+0000", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087443999999999998 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955633+0000", 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9289000000000004e-05 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.955701+0000", 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8473999999999995e-05 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.934837176999999, 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027819699999999999, 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962043+0000", 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962046+0000", 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.373e-06 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962057+0000", 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0913e-05 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962087+0000", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363999999999999e-05 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962102+0000", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5294999999999998e-05 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962203+0000", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100315 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962399+0000", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019656 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.962710+0000", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031110399999999998 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.963974+0000", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012640450000000001 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964661+0000", 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000686979 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964746+0000", 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819000000000002e-05 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.964825+0000", 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9202999999999994e-05 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.787593194999999, 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028335220000000002, 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-22T19:55:17.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109287+0000", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109290+0000", 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:55:17.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109302+0000", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2019e-05 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109334+0000", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1233999999999999e-05 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109352+0000", 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109498+0000", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146045 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.109730+0000", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232158 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.110072+0000", 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034150199999999998 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111064+0000", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00099197900000000004 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.111964+0000", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089971300000000001 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112055+0000", 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1695999999999998e-05 2024-04-22T19:55:17.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.112121+0000", 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5678000000000004e-05 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.780447662, 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029447560000000002, 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.988 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116433+0000", 2024-04-22T19:55:17.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116435+0000", 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.249e-06 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116446+0000", 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1163e-05 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116478+0000", 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1294000000000002e-05 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116492+0000", 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4506e-05 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116674+0000", 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182072 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.116897+0000", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022321099999999999 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.117221+0000", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032397399999999999 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.118567+0000", 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013454000000000001 2024-04-22T19:55:17.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119220+0000", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065345300000000002 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119305+0000", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4839999999999994e-05 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.119378+0000", 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2594000000000003e-05 2024-04-22T19:55:17.993 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.776480235999998, 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028461340000000002, 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:17.994 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 885 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:17.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120400+0000", 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120402+0000", 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.719e-06 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120411+0000", 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6100000000000006e-06 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120431+0000", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0395e-05 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120443+0000", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2386e-05 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120538+0000", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4877999999999995e-05 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:17.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120662+0000", 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123824 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.120929+0000", 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026686100000000002 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.122073+0000", 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011443639999999999 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123086+0000", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001012757 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123173+0000", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6502999999999995e-05 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.123247+0000", 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3837000000000005e-05 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:17.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.715089673999998, 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003108736, 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 913 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.000 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181791+0000", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181793+0000", 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181804+0000", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0946e-05 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181833+0000", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8628000000000001e-05 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181848+0000", 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4785e-05 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.181960+0000", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112491 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182184+0000", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022420799999999999 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.182522+0000", 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000338139 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.183619+0000", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001096828 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184623+0000", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010041780000000001 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184786+0000", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016279599999999999 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.184900+0000", 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011343700000000001 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.710637314000003, 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003236952, 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 915 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186243+0000", 2024-04-22T19:55:18.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186245+0000", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186267+0000", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2622000000000001e-05 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186286+0000", 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9222e-05 2024-04-22T19:55:18.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186297+0000", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0899e-05 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186411+0000", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011404399999999999 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.186643+0000", 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232098 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.187134+0000", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049065999999999997 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.188320+0000", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011855990000000001 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189196+0000", 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087657499999999999 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189364+0000", 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016757600000000001 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:21.189480+0000", 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116364 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.010 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:18.012 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:18.007+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:18.115 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:18.111+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:18.182 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:18.182 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:18.182 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:18.182 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:18.241 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:18.239+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:18.317 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:18.316+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:18.368 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:18.368 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:18.368 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:18.368 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:18.369 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.383 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:18.418 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:18.420+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:18.509 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:18.509 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:18.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:18.509 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:18.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.120121736999998, 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.510 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:18.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.114717075000002, 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.516 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:18.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.141525123000001, 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.060359562999999, 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:18.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:18.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:18.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:18.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.056708311999998, 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:18.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:18.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.026995206000002, 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.540 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:18.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:18.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.009806965000003, 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.546 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:18.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:18.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.985648513999998, 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:18.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:18.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:18.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:18.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.963369929000002, 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:18.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:18.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:18.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.562 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.963309541999998, 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:18.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:18.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.568 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.959732764000002, 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.955052621999997, 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.574 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.954978672000003, 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:18.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.954893069000001, 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.586 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:18.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.591 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.917524184000001, 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.915589836999999, 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:18.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:18.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.912511559000002, 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:18.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.909337026999999, 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.605 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.699286186000002, 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:18.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:18.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:18.615 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.653011804000002, 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:18.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:18.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:18.621 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.623 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:18.623 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:18.624+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:18.723 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:18.719+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:18.750 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:18.751 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:18.751 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:18.751 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.765 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:18.824 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:18.824+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:18.925 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:18.923+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:18.933 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:18.933 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:18.933 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:18.933 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:18.933 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:18.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:19.025 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:19.024+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:19.114 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:19.114 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:19.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:19.114 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:19.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.757919567000002, 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.726165057999999, 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:55:19.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:55:19.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:55:19.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:19.127 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.710886385000002, 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:19.133 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.707860531000001, 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:19.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:55:19.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:19.139 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.624373427000002, 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:19.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:55:19.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.725932389999997, 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.144 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:19.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.643082855999999, 2024-04-22T19:55:19.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.596532658999998, 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.593243242, 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.157 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:55:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.161 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.592183224000003, 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:19.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.588492399000003, 2024-04-22T19:55:19.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:55:19.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:55:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.170 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.585552821999997, 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:55:19.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:55:19.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:19.175 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.574206269000001, 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:55:19.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:55:19.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.568528006000001, 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.559051844000003, 2024-04-22T19:55:19.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:55:19.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.188 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.542402696000003, 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:55:19.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.537166225, 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:55:19.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:19.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:55:19.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.534833116000001, 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:19.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:55:19.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:55:19.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:19.202 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.455207379999997, 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.206 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.400900266999997, 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:19.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:55:19.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:55:19.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.212 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:19.213 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:19.214 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:19.211+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:19.314 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:19.311+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:19.387 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:19.387 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:19.387 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:19.388 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:19.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:19.415 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:19.416+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:19.516 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:19.516+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:19.568 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:19.568 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:19.568 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:19.569 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:19.569 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:19.583 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:19.617 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:55:19.618 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:19.616+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:19.707 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.941425374999994, 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:19.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:19.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.713 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.941232722999999, 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:19.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.881540860000001, 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:19.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.881476277999994, 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:19.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.730 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.881345342000003, 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.731 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:19.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:19.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:19.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.774707191000005, 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:19.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.774576229000004, 2024-04-22T19:55:19.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:19.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.774337011, 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:19.753 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.774261031999998, 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:19.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:19.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:19.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.774188288999994, 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:19.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:19.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.773876485000002, 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.765 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:19.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.773811011999996, 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:19.771 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:19.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.773750738999993, 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.777 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:19.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.773591393000004, 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:19.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.773518214000006, 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.525306416999996, 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.525201684999999, 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.525183519999999, 2024-04-22T19:55:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.525166506000005, 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 82.525063286999995, 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:19.823 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:19.824 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:19.825 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:19.819+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:19.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:19.925 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:19.923+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:19.939 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:19.939 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:19.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:19.970 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:19.970 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:20.001 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:20.002 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:20.020 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:20.020 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:20.025 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:20.023+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:20.037 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:20.037 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:20.058 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:20.058 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:20.088 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.088 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:20.092 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:20.103 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:20.116 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:20.116 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:20.127 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:20.123+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:20.137 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:20.138 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:20.227 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:20.223+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:20.243 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.244 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:20.329 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:20.327+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:20.366 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.366 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:20.429 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:20.427+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:20.496 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.496 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:20.558 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:20.559+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:20.597 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:55:20.631 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:20.627+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:20.639 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.639 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.652 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:20.733 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:20.731+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:20.813 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.813 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.827 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:20.874 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:20.875+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:20.934 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:20.931+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:20.937 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:20.937 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:20.950 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:21.035 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:21.031+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:21.120 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.120 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:21.135 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:21.131+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:21.236 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:21.235+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:21.253 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.254 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.267 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:21.354 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:21.355+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:21.438 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:21.439+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:21.439 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.439 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.453 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:21.539 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:21.535+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:21.619 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.619 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:21.640 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:21.639+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:21.741 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:21.739+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:21.763 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.763 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:21.869 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:21.867+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:21.943 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:21.943 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:21.943 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:21.939+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:21.957 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:22.049 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:22.047+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:22.126 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:22.126 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:22.140 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:22.156 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:22.181 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:22.179+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:22.246 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:22.243+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:22.304 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:22.305 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:22.305 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:22.305 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:22.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:22.322 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:22.322 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:22.338 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:22.338 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:22.346 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:22.347+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:22.355 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:22.356 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:22.373 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:22.374 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:22.391 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:22.391 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:22.410 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:22.411 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:22.430 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:22.430 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:22.442 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:22.442 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:22.442 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:22.442 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:22.442 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:22.456 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:22.486 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:22.487+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:22.548 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:22.543+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:22.577 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:22.577 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:22.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:22.577 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.188542827000006, 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:55:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:55:22.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:55:22.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.183138165000003, 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.584 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:55:22.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:55:22.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.209946213000002, 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.590 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:55:22.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:55:22.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.128780653, 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033183990000000001, 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446512+0000", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446515+0000", 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:22.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446526+0000", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1139e-05 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446557+0000", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0846999999999998e-05 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446571+0000", 2024-04-22T19:55:22.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4603000000000001e-05 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446682+0000", 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111061 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.446910+0000", 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022722700000000001 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.447340+0000", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043043399999999999 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.448711+0000", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013704889999999999 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449625+0000", 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091481600000000004 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449716+0000", 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1145999999999998e-05 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.449831+0000", 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114337 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.125129401999999, 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033914230000000002, 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450164+0000", 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450166+0000", 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3e-06 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450177+0000", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1086e-05 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450208+0000", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0608000000000002e-05 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450222+0000", 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4501000000000001e-05 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450360+0000", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772599999999999 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.450684+0000", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032459299999999997 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.451370+0000", 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068551500000000004 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453029+0000", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016587150000000001 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453408+0000", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037932800000000001 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453492+0000", 2024-04-22T19:55:22.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4153000000000006e-05 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.453555+0000", 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2898000000000007e-05 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.095416296000003, 2024-04-22T19:55:22.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003306813, 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479877+0000", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479879+0000", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479891+0000", 2024-04-22T19:55:22.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1342000000000001e-05 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479922+0000", 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1130999999999997e-05 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.479936+0000", 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4739000000000001e-05 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480042+0000", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106094 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480247+0000", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000204067 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.480679+0000", 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000432717 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.481925+0000", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012457849999999999 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483033+0000", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001108234 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483117+0000", 2024-04-22T19:55:22.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3722999999999998e-05 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.483184+0000", 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6570999999999997e-05 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.078228054999997, 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:55:22.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:55:22.618 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:384 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.054069603999999, 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032837209999999999, 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 384 2024-04-22T19:55:22.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521223+0000", 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521227+0000", 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1200000000000002e-06 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521240+0000", 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3852000000000001e-05 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521273+0000", 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2366999999999997e-05 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521299+0000", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6395000000000001e-05 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521439+0000", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013940400000000001 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521587+0000", 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148362 2024-04-22T19:55:22.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521950+0000", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000362612 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524269+0000", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023197959999999998 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524302+0000", 2024-04-22T19:55:22.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2320999999999998e-05 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524400+0000", 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8450999999999996e-05 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524507+0000", 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010704099999999999 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.624 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.031791019000003, 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:55:22.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:55:22.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:55:22.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:55:22.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:22.630 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.031730631999999, 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:55:22.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:22.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:22.636 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.028153854000003, 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:55:22.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:55:22.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.023473711999998, 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038703589999999999, 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.642 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 429 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551819+0000", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551821+0000", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9190000000000002e-06 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551830+0000", 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0170000000000002e-06 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551853+0000", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3173999999999999e-05 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551865+0000", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1809e-05 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551951+0000", 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6133999999999999e-05 2024-04-22T19:55:22.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552069+0000", 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117213 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552315+0000", 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000246254 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555296+0000", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029813800000000001 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555373+0000", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6309000000000004e-05 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555556+0000", 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018317499999999999 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555690+0000", 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013397499999999999 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.023399761999997, 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.648 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:55:22.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:55:22.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.023314159000002, 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:55:22.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:496 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.985945274000002, 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033197489999999999, 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589348+0000", 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589349+0000", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.33e-06 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589361+0000", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1895e-05 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589380+0000", 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8930999999999999e-05 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589392+0000", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1783000000000001e-05 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589509+0000", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117644 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589541+0000", 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1736999999999998e-05 2024-04-22T19:55:22.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592552+0000", 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030111780000000002 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592668+0000", 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115251 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:498 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.984010927, 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041635769999999999, 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591282+0000", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591284+0000", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9479999999999998e-06 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591299+0000", 2024-04-22T19:55:22.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4487e-05 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591330+0000", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1408999999999997e-05 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591347+0000", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6852999999999999e-05 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591488+0000", 2024-04-22T19:55:22.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140937 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.591537+0000", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9030000000000003e-05 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595336+0000", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003798905 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595446+0000", 2024-04-22T19:55:22.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011000799999999999 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.980932649000003, 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037183709999999998, 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594360+0000", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594362+0000", 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.888e-06 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594378+0000", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5616000000000001e-05 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594413+0000", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5085e-05 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594431+0000", 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-05 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594584+0000", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153397 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594644+0000", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0118000000000003e-05 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598004+0000", 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033604429999999999 2024-04-22T19:55:22.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598079+0000", 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4294000000000004e-05 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:508 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.977758117, 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037761040000000002, 2024-04-22T19:55:22.673 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597535+0000", 2024-04-22T19:55:22.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597537+0000", 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1469999999999999e-06 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597553+0000", 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6342e-05 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597589+0000", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5413999999999997e-05 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597609+0000", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0520999999999999e-05 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597735+0000", 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125213 2024-04-22T19:55:22.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.597784+0000", 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8933000000000001e-05 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601204+0000", 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034209470000000001 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.601311+0000", 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106587 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.767707276000003, 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003355935, 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807586+0000", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807589+0000", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1990000000000002e-06 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807603+0000", 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4019000000000001e-05 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807634+0000", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1310999999999999e-05 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807649+0000", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4408e-05 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.807816+0000", 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166806 2024-04-22T19:55:22.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808173+0000", 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035729099999999998 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.808708+0000", 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053558200000000005 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.809984+0000", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00127556 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810717+0000", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073344399999999998 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810807+0000", 2024-04-22T19:55:22.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.988e-05 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.810942+0000", 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134435 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:22.684 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.721432894000003, 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:22.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:55:22.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:22.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:22.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:22.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:22.691 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:22.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:55:22.694 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:22.694 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:22.691+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:22.794 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:22.791+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:22.864 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:22.865 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:22.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:22.865 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:22.879 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:22.894 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:22.895+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:22.995 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:22.991+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:23.039 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:23.039 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:23.039 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:23.039 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:23.040 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:23.053 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:23.097 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:23.095+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:23.197 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:23.195+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:23.219 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.864242223000005, 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:55:23.220 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:55:23.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:55:23.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:23.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:55:23.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.832487713999996, 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.230 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:55:23.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:55:23.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:55:23.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.817209040999998, 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:55:23.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:55:23.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.242 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:23.242 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:23.242 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.814183186999998, 2024-04-22T19:55:23.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:23.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:55:23.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.730696082999998, 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:55:23.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:55:23.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:55:23.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:55:23.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:55:23.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.832255046, 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.257 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:55:23.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.749405512000003, 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:55:23.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.702855315000001, 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:55:23.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:55:23.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.699565898000003, 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:55:23.271 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:55:23.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:55:23.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.698505879999999, 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:55:23.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:55:23.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.694815054999999, 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:55:23.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:55:23.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.691875478, 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:55:23.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.289 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.680528924999997, 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:55:23.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:55:23.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.674850661999997, 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.294 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:55:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.665374499999999, 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:55:23.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:55:23.302 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.648725352, 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:55:23.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:23.307 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.643488881000003, 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:55:23.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.641155771999998, 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:55:23.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:23.316 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.561530036000001, 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:23.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.507222923, 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:55:23.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:55:23.324 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.325 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.325 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.325 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.325 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.325 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:23.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:23.327 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:23.323+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:23.427 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:23.423+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:23.458 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:23.459 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:23.459 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:23.459 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:23.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:23.565 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:23.563+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:23.617 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:55:23.629 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:23.627+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:23.645 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:23.646 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:23.646 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:23.646 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:23.646 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:23.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:23.729 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:23.727+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:23.827 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:23.827 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.060722069999997, 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.833 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.060529418000002, 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:23.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:23.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.000837555000004, 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.840 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:23.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.845 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.000772972999997, 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:23.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.000642037000006, 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.851 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:23.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.894003885999993, 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.857 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:23.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.862 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893872923999993, 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.863 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:23.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:23.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.868 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893633706000003, 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:23.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893557727000001, 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.874 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:23.879 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893484983999997, 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.880 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:23.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.885 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893173180000005, 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.886 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:23.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893107706999999, 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:23.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:23.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.897 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.893047433999996, 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:23.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:23.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.892888088000007, 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.903 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.908 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.892814908999995, 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.909 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:23.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.644603111999999, 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:23.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:23.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.644498380000002, 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:23.920 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:23.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:23.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.644480215000002, 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:23.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:23.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.644463200999994, 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:23.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.644359981999997, 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:23.943 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:23.945 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:23.945 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:23.943+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:24.046 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:24.043+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:24.098 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:24.196 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:24.196 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:24.196 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:24.198 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:24.198 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:24.195+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:24.299 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:24.299+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:24.308 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:24.308 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:24.309 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:24.309 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:24.309 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:24.322 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:24.410 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:24.411+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:24.446 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.774683236000001, 2024-04-22T19:55:24.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:24.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:24.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.737602871999997, 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:24.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.736670282999995, 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.735447352999998, 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:24.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.518 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.733679146, 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.554986107999994, 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.553966785, 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:24.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.541264679999998, 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:24.531 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:24.535 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.309748279000004, 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:24.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:24.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.302306309000002, 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:24.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.089383510000005, 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.544 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:24.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.131378710000007, 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:24.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.111552166999999, 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.081144985999998, 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.561 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:24.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:24.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.065317484999994, 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.567 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:24.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:24.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.036871511000001, 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.572 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:24.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:24.577 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.018254745999997, 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:24.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:24.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:24.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:24.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.964198680000003, 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:24.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:24.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:24.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:24.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.545722247, 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:24.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:24.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:24.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.987914275000001, 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:24.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:24.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:24.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:24.600 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:24.499+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:24.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:24.601 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:24.602 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:24.604 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:24.603+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:24.613 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:24.613 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:24.639 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:24.639 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:24.672 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:24.672 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:24.704 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:24.704 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:24.704 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:24.699+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:24.724 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:24.725 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:24.733 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:24.733 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:24.745 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:24.745 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:24.746 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:24.777 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:24.805 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:24.803+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:24.906 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:24.907+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:24.942 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:24.942 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:24.959 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:25.007 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:25.003+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:25.108 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:25.103+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:25.209 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:25.207+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:25.229 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.229 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.242 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:25.310 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:25.307+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:25.349 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.350 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:25.410 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:25.411+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:25.497 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.497 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.512 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:25.507+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:25.514 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:25.612 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:25.607+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:25.639 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:55:25.691 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.691 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:25.714 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:25.711+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:25.814 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:25.811+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:25.858 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:25.858 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:25.876 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:25.923 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:25.923+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:26.016 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:26.011+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:26.056 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.057 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:26.121 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:26.119+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:26.207 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.207 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.218 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:26.219+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:26.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:26.319 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:26.319+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:26.387 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.387 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:26.420 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:26.419+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:26.521 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:26.519+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:26.522 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.522 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.536 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:26.621 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:26.619+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:26.622 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:55:26.661 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.662 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.676 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:26.722 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:26.723+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:26.792 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.792 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.800 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:26.806 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:26.847 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:26.847+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:26.924 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:26.919+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:26.929 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:26.929 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:26.944 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:26.968 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:26.995 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:26.995 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:27.023 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:27.024 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:27.029 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:27.027+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:27.053 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:27.085 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:27.085 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:27.101 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:27.101 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:27.116 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:27.116 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:27.116 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:27.134 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:27.134 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:27.157 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:27.155+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:27.164 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:27.164 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:27.226 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:27.223+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:27.276 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:27.276 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:27.276 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:27.276 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:27.276 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:27.290 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:27.327 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:27.327+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:27.412 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:27.412 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.055999254, 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:27.413 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:55:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:27.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:27.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.420 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903869244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.024244745000004, 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038694480000000002, 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386722+0000", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386725+0000", 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.543e-06 2024-04-22T19:55:27.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386736+0000", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1099e-05 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.798e-05 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386784+0000", 2024-04-22T19:55:27.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0203999999999998e-05 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386951+0000", 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166873 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387163+0000", 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000211812 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387541+0000", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037860299999999998 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.389185+0000", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001644171 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390331+0000", 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011454900000000001 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390448+0000", 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011672599999999999 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.390592+0000", 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014394700000000001 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.008966072000007, 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028507329999999998, 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402001+0000", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402003+0000", 2024-04-22T19:55:27.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1849999999999998e-06 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402012+0000", 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1279999999999997e-06 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402041+0000", 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9051999999999999e-05 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402074+0000", 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2521999999999998e-05 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402200+0000", 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126002 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402362+0000", 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162817 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.402519+0000", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156553 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.403541+0000", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010217959999999999 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404613+0000", 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001071762 2024-04-22T19:55:27.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404752+0000", 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013896500000000001 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.404852+0000", 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9951000000000006e-05 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.432 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903869239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.005940218000006, 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002650141, 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405027+0000", 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405028+0000", 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6139999999999999e-06 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405038+0000", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6819999999999998e-06 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405064+0000", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5975000000000001e-05 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405083+0000", 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9598000000000001e-05 2024-04-22T19:55:27.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405202+0000", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824000000000001 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405320+0000", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118501 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.405523+0000", 2024-04-22T19:55:27.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020269 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.406376+0000", 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085331299999999997 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407510+0000", 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001133946 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407585+0000", 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4778999999999997e-05 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.407677+0000", 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1803000000000002e-05 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:27.438 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.922453114000007, 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001726198, 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488514+0000", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488516+0000", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0829999999999998e-06 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488531+0000", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4802e-05 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488568+0000", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7450000000000002e-05 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488589+0000", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1131000000000001e-05 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488732+0000", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014287699999999999 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.488766+0000", 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3877000000000001e-05 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490159+0000", 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013933249999999999 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.490240+0000", 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0653000000000002e-05 2024-04-22T19:55:27.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.024012076999995, 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023123340000000001, 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386955+0000", 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2399999999999998e-07 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386964+0000", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3729999999999993e-06 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.386995+0000", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1250000000000001e-05 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387016+0000", 2024-04-22T19:55:27.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0562000000000001e-05 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387186+0000", 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017024600000000001 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.387242+0000", 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389183+0000", 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019409550000000001 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.389267+0000", 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4083000000000001e-05 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:27.447 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.941162543000004, 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002009336, 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469804+0000", 2024-04-22T19:55:27.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469806+0000", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0140000000000001e-06 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469818+0000", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2129e-05 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469847+0000", 2024-04-22T19:55:27.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8960000000000001e-05 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469860+0000", 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2986000000000001e-05 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.469995+0000", 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013492500000000001 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.470046+0000", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.024e-05 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471736+0000", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001690471 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.471814+0000", 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7610999999999999e-05 2024-04-22T19:55:27.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.452 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:372 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.894612346000002, 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001720269, 2024-04-22T19:55:27.453 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516354+0000", 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516356+0000", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7060000000000001e-06 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516369+0000", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2329e-05 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516396+0000", 2024-04-22T19:55:27.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7433999999999999e-05 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516416+0000", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9915000000000002e-05 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516553+0000", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136842 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.516594+0000", 2024-04-22T19:55:27.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1e-05 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.517954+0000", 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136035 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.518075+0000", 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120693 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:377 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.891322928999998, 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022885420000000002, 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519644+0000", 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519646+0000", 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9769999999999999e-06 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519663+0000", 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7079e-05 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519697+0000", 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3989999999999998e-05 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519716+0000", 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9025000000000002e-05 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519856+0000", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014043500000000001 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.519915+0000", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8165000000000003e-05 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521817+0000", 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001902684 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.521932+0000", 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011518699999999999 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:382 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'3, mlcod=29'1)", 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.890262910999994, 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032554179999999999, 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.462 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520704+0000", 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520706+0000", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8300000000000001e-06 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520720+0000", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4439e-05 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520750+0000", 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0221000000000001e-05 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520772+0000", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1804999999999999e-05 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520914+0000", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141948 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.520969+0000", 2024-04-22T19:55:27.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5084999999999999e-05 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523874+0000", 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029051900000000002 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.523959+0000", 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4900000000000004e-05 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:386 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.886572086000001, 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022203639999999998, 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:27.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524395+0000", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524397+0000", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8029999999999999e-06 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524410+0000", 2024-04-22T19:55:27.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3708e-05 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524449+0000", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9084000000000001e-05 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524468+0000", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8768000000000001e-05 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524629+0000", 2024-04-22T19:55:27.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161037 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.524671+0000", 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2315999999999999e-05 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526495+0000", 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001824008 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.526615+0000", 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011964 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:392 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.883632508999995, 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018264139999999999, 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.471 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527334+0000", 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527336+0000", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.533e-06 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527349+0000", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3362e-05 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527382+0000", 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2848000000000001e-05 2024-04-22T19:55:27.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527402+0000", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9704999999999999e-05 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527533+0000", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130872 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.527567+0000", 2024-04-22T19:55:27.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999998e-05 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529054+0000", 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014867529999999999 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.529161+0000", 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107141 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:413 6.c e32/26 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 32'3, mlcod=32'1)", 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.872285955999999, 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019623800000000001, 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:27.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538681+0000", 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538683+0000", 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538698+0000", 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5622000000000001e-05 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538734+0000", 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5383999999999999e-05 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538753+0000", 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9114999999999999e-05 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538905+0000", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151986 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.538958+0000", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2717999999999999e-05 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540546+0000", 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001588728 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.540643+0000", 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6867000000000006e-05 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:425 6.a e32/26 6:50d64734:::obj_delete_at_hint.0000000009:head v 32'2, mlcod=0'0)", 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.866607693000006, 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060076569999999996, 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544359+0000", 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544361+0000", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9e-06 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544375+0000", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4087000000000001e-05 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544405+0000", 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9431999999999999e-05 2024-04-22T19:55:27.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544421+0000", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6067e-05 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544539+0000", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011859 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544570+0000", 2024-04-22T19:55:27.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0685999999999997e-05 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550285+0000", 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057148069999999997 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550367+0000", 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2088000000000004e-05 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:430 6.a e32/26 6:5127e642:gc::gc.21:head v 32'4, mlcod=32'1)", 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.857131530999993, 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002242132, 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553835+0000", 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553837+0000", 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.393e-06 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553847+0000", 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0389e-05 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553872+0000", 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5052e-05 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553890+0000", 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8221000000000001e-05 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553984+0000", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3419999999999997e-05 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554014+0000", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0292000000000001e-05 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555974+0000", 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001959747 2024-04-22T19:55:27.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556077+0000", 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103618 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:460 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.840482382999994, 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002831798, 2024-04-22T19:55:27.489 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570484+0000", 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570486+0000", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.542e-06 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570500+0000", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4365000000000001e-05 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570535+0000", 2024-04-22T19:55:27.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4536999999999998e-05 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570570+0000", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5519999999999999e-05 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570702+0000", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013191599999999999 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.570752+0000", 2024-04-22T19:55:27.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9579000000000001e-05 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573208+0000", 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024560710000000002 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.573316+0000", 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108268 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:469 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.835245912000005, 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025844150000000001, 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:27.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575721+0000", 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575723+0000", 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.857e-06 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575736+0000", 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2721999999999999e-05 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575756+0000", 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0675000000000001e-05 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575771+0000", 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4731e-05 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575910+0000", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013953500000000001 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.575961+0000", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0995999999999998e-05 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578189+0000", 2024-04-22T19:55:27.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022272360000000001 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578305+0000", 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116663 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:471 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'9, mlcod=32'7)", 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.832912802999999, 2024-04-22T19:55:27.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017565090000000001, 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578054+0000", 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578056+0000", 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5260000000000001e-06 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578067+0000", 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578090+0000", 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2731999999999999e-05 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578101+0000", 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1428e-05 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578288+0000", 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018703900000000001 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.578349+0000", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0665000000000003e-05 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579700+0000", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013517519999999999 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.579811+0000", 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110151 2024-04-22T19:55:27.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:600 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'11, mlcod=32'9)", 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.753287067000002, 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003531873, 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657680+0000", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657682+0000", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657694+0000", 2024-04-22T19:55:27.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2665e-05 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657728+0000", 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3387999999999999e-05 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657740+0000", 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2108e-05 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657877+0000", 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013728699999999999 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.657931+0000", 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4221000000000001e-05 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661127+0000", 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031960970000000002 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.661212+0000", 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4376000000000007e-05 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:676 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'4, mlcod=32'2)", 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.698979953999995, 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001879244, 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.507 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711987+0000", 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.711989+0000", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6309999999999999e-06 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712000+0000", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712019+0000", 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9375999999999999e-05 2024-04-22T19:55:27.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712031+0000", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1659e-05 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712125+0000", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.712158+0000", 2024-04-22T19:55:27.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713792+0000", 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001634136 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.713866+0000", 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4404000000000001e-05 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.512 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.512 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:27.513 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:27.513 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:27.511+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:27.614 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:27.611+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:27.642 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:27.642 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:27.642 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:27.642 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:27.656 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:27.715 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:27.711+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:27.777 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:27.777 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:27.777 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:27.777 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:27.777 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:27.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:27.816 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:27.815+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:27.917 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:27.915+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:27.958 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.191983871000005, 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.959 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:27.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:27.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:27.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.191791218999995, 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.965 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:27.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:27.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.132099355999998, 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.971 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:27.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.132034774000005, 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:27.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:27.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:27.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.982 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.131903837999999, 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:27.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:27.988 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.025265687000001, 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:27.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:27.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.025134725000001, 2024-04-22T19:55:27.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:27.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:27.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:27.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024895506999997, 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:28.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:28.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024819527999995, 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:28.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:28.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024746785000005, 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:28.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024434980999999, 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.018 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.023 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024369508000007, 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:28.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:28.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024309235000004, 2024-04-22T19:55:28.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:28.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:28.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:28.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:28.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024149889, 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.024076710000003, 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:28.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:28.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:28.046 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.775864913000007, 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:28.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.775760180999995, 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.052 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:28.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:28.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:28.057 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.775742015999995, 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:28.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:28.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:28.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.775725002000001, 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:28.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:28.069 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.775621783000005, 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:28.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:28.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:28.075 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:28.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:28.077 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:28.075+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:28.177 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:28.175+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:28.186 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:28.186 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:28.186 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:28.187 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:28.199 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:28.287 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:28.287+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:28.349 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:28.349 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:28.349 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:28.361 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:28.403 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:28.403+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:28.479 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:28.479+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.806212105, 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.769131740999995, 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.768199151999994, 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.766976221999997, 2024-04-22T19:55:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.765208014999999, 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.586514976999993, 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.558 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.585495653999999, 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:28.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:28.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.572793548999996, 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.341277148000003, 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:28.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.333835178000001, 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:28.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.120912379000004, 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.576 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:28.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:28.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:28.581 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.162907579000006, 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:28.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.143081035999998, 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:28.587 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:28.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.112673854999997, 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.593 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:28.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:28.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:28.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.096846353999993, 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.06840038, 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:28.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:28.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:28.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:28.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.049783614999996, 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:28.610 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:28.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:28.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:28.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.995727548999994, 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.616 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:28.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.577251115999999, 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.622 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:28.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:28.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.019443144, 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:28.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:28.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:28.633 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:28.635 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:28.635 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:28.631+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:28.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:55:28.736 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:28.735+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:28.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:28.863 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:28.863+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:28.937 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:28.935+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:29.009 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:29.010 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:29.010 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:29.010 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:29.010 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:29.026 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:29.037 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:29.035+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:29.138 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:29.135+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:29.175 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 75.827434937999996, 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:29.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:29.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.788560446000005, 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.180 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:29.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.783483136000001, 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.782824898000001, 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:29.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:29.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:29.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.776047930999994, 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:29.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:29.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.681369435999997, 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.197 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:29.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:29.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:29.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.796886947999994, 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:29.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.777728015999998, 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:29.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.751618730999994, 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.732898504000005, 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.699679974999995, 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.231 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.671637939999997, 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:29.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.656129288000002, 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.242 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.645779499, 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:29.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:29.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.612204675000001, 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:29.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.320988553000007, 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:29.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:29.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.234240771000003, 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.173224778000005, 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.019534098999998, 2024-04-22T19:55:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.953397749999993, 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:29.280 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:29.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:29.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:29.283 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:29.279+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:29.383 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:29.383+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:29.483 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:29.483 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:29.483 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:29.483 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:29.483 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:29.483+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:29.496 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:29.505 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:29.505 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:29.534 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:29.534 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:29.553 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:29.553 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:29.581 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:29.581 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:29.584 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:29.579+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:29.614 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:29.614 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:29.637 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:55:29.638 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:29.638 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:29.660 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:29.660 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:29.673 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:29.673 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:29.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:29.694 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:29.694 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:29.695 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:29.691+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:29.785 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:29.783+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:29.852 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:29.852 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:29.869 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:29.911 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:29.911+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:29.923 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:55:29.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-22T19:55:29.987 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:29.983+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:30.061 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.061 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:30.088 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:30.087+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:30.189 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:30.187+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:30.258 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.258 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.276 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:30.323 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:30.323+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:30.391 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:30.387+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:30.399 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.399 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.413 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:30.493 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:30.487+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:30.544 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.544 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.558 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:30.601 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:30.599+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:30.644 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.0 to 1 (10000) 2024-04-22T19:55:30.668 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-22T19:55:30.694 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:30.691+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:30.728 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.728 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:30.795 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:30.795+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:30.896 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:30.895+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:30.905 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:30.905 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:30.920 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:30.996 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:30.991+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:31.042 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.043 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:31.097 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:31.095+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:31.198 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:31.195+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:31.228 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.228 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:31.329 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:31.327+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:31.399 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:31.399+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:31.412 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.412 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.426 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:31.501 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:31.499+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:31.591 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.591 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.602 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:31.599+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:31.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:31.641 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.1 to 1 (10000) 2024-04-22T19:55:31.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:55:31.670 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-22T19:55:31.703 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:31.699+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:31.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:31.731 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.731 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.745 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:31.837 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:31.835+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:31.905 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:31.903+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:31.919 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:31.919 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:31.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:31.967 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:31.968 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:32.006 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:32.003+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:32.028 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:32.028 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:32.058 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:32.058 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:32.091 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:32.091 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:32.106 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:32.106 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:32.107 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:32.103+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:32.121 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:32.123 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:32.123 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:32.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:32.154 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:32.184 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:32.184 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:32.246 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:32.247+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:32.288 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:32.288 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:32.288 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:32.288 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:32.288 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:32.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:32.345 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:32.343+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:32.410 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:32.407+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.656583905000005, 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:32.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:32.429 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.656391252999995, 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:32.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:32.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.435 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.596699389999998, 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:32.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:32.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.441 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.596634808000005, 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.596503872, 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.448 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:32.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.453 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489865721000001, 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:32.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:32.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:32.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:32.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489734759000001, 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:32.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:32.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:32.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.464 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489495540999997, 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489419561999995, 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.470 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:32.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:32.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:32.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489346819000005, 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.476 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:32.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:32.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:32.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.489035014999999, 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:32.481 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:32.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.488969542000007, 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.487 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.488909269000004, 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.488749923, 2024-04-22T19:55:32.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:32.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:32.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.488676744000003, 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.503 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:32.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:32.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.240464947000007, 2024-04-22T19:55:32.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:32.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:32.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:32.513 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.240360214999995, 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.514 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:32.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.240342049999995, 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.520 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:32.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:32.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:32.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.240325036000002, 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.526 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:32.531 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.240221817000005, 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:32.532 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:32.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:32.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.537 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:32.538 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:32.538 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:32.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:32.540 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:32.539+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:32.639 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:32.639+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:32.654 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:55:32.655 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.2 to 1 (10000) 2024-04-22T19:55:32.692 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-22T19:55:32.710 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:32.710 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:32.710 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:32.710 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:32.729 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:32.771 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:32.771+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:32.841 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:32.839+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:32.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:32.940 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:32.940 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:32.940 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:32.940 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:32.942 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:32.939+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:32.960 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:33.047 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:33.047+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:33.144 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:33.143+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.174 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.447009086999998, 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.409928722999993, 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:33.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.408996134000006, 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:33.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.407773203999994, 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:33.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:33.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.406004996999997, 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:33.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.227311959000005, 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:33.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:33.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:33.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.226292635999997, 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:33.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.213590530999994, 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:33.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:33.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:33.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.982074130000001, 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:33.207 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:33.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:33.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:33.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.974632159999999, 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.211 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 75.761709361000001, 2024-04-22T19:55:33.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.803704561000004, 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:33.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.783878017999996, 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.226 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:33.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.753470836999995, 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.232 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:33.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:33.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:33.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:33.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.737643336000005, 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:33.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:33.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.709197361999998, 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:33.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:33.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.690580596999993, 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.248 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:33.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.253 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.636524531000006, 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:33.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:33.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:33.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:33.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:33.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.218048097999997, 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:33.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:33.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:33.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.660240125999998, 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.264 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:33.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:33.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.269 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:33.270 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:33.271 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:33.267+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:33.371 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:33.371+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:33.473 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:33.471+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:33.482 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:33.483 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:33.483 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:33.483 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:33.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:33.573 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:33.571+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:33.659 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.3 to 1 (10000) 2024-04-22T19:55:33.677 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:33.671+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:33.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-22T19:55:33.712 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:33.712 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:33.732 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:33.775 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:33.775+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:33.877 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:33.871+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:33.952 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:33.952 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.603476624999999, 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:33.953 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.564602132999994, 2024-04-22T19:55:33.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:33.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.559524823000004, 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:33.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:33.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.558866585000004, 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:33.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.552089617999997, 2024-04-22T19:55:33.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:33.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:33.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.457411123, 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.976 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:33.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:33.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.572928634999997, 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.982 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:33.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:33.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:33.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.553769703, 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:33.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:33.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:33.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:33.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.527660417999996, 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:33.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:33.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:33.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:33.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.508940190999994, 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:34.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:34.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.475721661999998, 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:34.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:34.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.447679626999999, 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:34.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:34.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:34.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.432170975000005, 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:34.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:34.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.024 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.421821186000003, 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:34.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.388246362000004, 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:34.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:34.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:34.036 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.097030239999995, 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.010282458000006, 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.949266464999994, 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.795575786000001, 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.729439436999996, 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:34.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:34.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:34.064 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:34.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:34.066 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:34.063+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:34.167 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:34.163+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:34.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:34.267 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:34.267+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:34.276 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:34.276 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:34.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:34.383 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:34.383+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:34.403 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:34.403 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:34.435 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:34.435 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:34.465 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:34.465 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:34.468 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:34.467+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:34.495 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:34.495 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:34.507 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:34.507 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:34.524 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:34.527 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:34.528 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:34.560 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:34.570 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:34.567+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:34.593 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:34.593 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:34.625 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:34.625 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:34.671 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:34.667+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:34.691 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.4 to 1 (10000) 2024-04-22T19:55:34.693 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:55:34.698 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:34.698 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:34.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-22T19:55:34.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:34.772 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:34.767+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:34.872 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:34.867+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:34.935 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:34.936 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:34.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:34.973 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:34.971+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:35.074 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:35.071+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:35.124 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.124 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.137 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:35.175 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:35.171+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:35.248 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.248 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:35.305 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:35.303+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:35.377 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:35.375+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:35.394 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.394 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.408 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:35.493 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:35.491+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:35.568 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.568 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.579 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:35.579+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:35.583 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:35.680 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:35.679+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:35.701 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.5 to 1 (10000) 2024-04-22T19:55:35.710 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:55:35.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-22T19:55:35.751 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.752 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:35.783 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:35.783+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:35.882 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:35.879+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:35.883 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:35.883 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:35.898 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:35.983 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:35.983+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:36.020 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.021 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:36.084 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:36.079+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:36.151 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.152 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.166 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:36.184 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:36.183+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:36.286 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:36.283+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:36.334 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.334 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.349 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:36.386 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:36.383+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:36.467 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.467 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:36.525 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:36.523+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:36.587 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:36.587+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:36.604 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.604 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.618 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:36.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:36.695 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:36.695+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:36.713 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.6 to 1 (10000) 2024-04-22T19:55:36.742 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-22T19:55:36.786 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.786 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.789 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:36.787+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:36.800 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:36.858 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:36.858 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:36.889 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:36.889 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:36.890 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:36.887+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:36.919 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:36.919 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:36.949 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:36.949 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:36.967 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:36.967 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:36.981 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:36.982 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:36.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:37.012 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:37.012 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:37.025 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:37.023+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:37.042 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:37.042 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:37.072 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:37.072 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:37.090 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:37.087+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:55 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.381182557, 2024-04-22T19:55:37.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011423162000000001, 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764058+0000", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764060+0000", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.35e-06 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764180+0000", 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119809 2024-04-22T19:55:37.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764200+0000", 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0567000000000001e-05 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764217+0000", 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766370+0000", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021529359999999998 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766507+0000", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013731600000000001 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.766708+0000", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201075 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.769798+0000", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030899600000000001 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775219+0000", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054211479999999998 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775367+0000", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014824200000000001 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.775482+0000", 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011422899999999999 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:56 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.38098990500001, 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013008723, 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.154 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 56 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764251+0000", 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764253+0000", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3799999999999999e-06 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764263+0000", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764286+0000", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2866000000000001e-05 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.764322+0000", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6032999999999999e-05 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.767917+0000", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035942890000000001 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768147+0000", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000230478 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.768536+0000", 2024-04-22T19:55:37.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038930099999999999 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.770221+0000", 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016849199999999999 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.776983+0000", 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067612319999999998 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777141+0000", 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158255 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.777260+0000", 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119072 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.159 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.321298042, 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011392618, 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 86 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823943+0000", 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823944+0000", 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4600000000000004e-07 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823950+0000", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8100000000000003e-06 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823960+0000", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0164e-05 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.823969+0000", 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1260000000000004e-06 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830641+0000", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066716689999999999 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830765+0000", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124552 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.830981+0000", 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021571900000000001 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834938+0000", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003957215 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835063+0000", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012547599999999999 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835226+0000", 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162786 2024-04-22T19:55:37.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835336+0000", 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109355 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.32123346, 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011851542, 2024-04-22T19:55:37.165 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824008+0000", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824009+0000", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1170000000000001e-06 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824082+0000", 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3355999999999994e-05 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824111+0000", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9377e-05 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824121+0000", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1230000000000006e-06 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.831978+0000", 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078577390000000007 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832264+0000", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028588499999999999 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.832455+0000", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190352 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834948+0000", 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024939469999999998 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835594+0000", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00064507500000000005 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835747+0000", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015301600000000001 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835859+0000", 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112555 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.170 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.321102524, 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012099136999999999, 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-22T19:55:37.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824139+0000", 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2999999999999999e-07 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824146+0000", 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4030000000000004e-06 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824165+0000", 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9596999999999999e-05 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.824173+0000", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3429999999999998e-06 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.833880+0000", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097068750000000002 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834074+0000", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019463600000000001 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.834275+0000", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200371 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.835881+0000", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064709999999999 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836104+0000", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000222728 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836180+0000", 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6513000000000004e-05 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.836238+0000", 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7370000000000001e-05 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.214464373, 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014423718, 2024-04-22T19:55:37.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930777+0000", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930779+0000", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930790+0000", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930823+0000", 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2398999999999999e-05 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930838+0000", 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5234e-05 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937572+0000", 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067346940000000003 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.937803+0000", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023053799999999999 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.938161+0000", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000357964 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942266+0000", 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041052859999999997 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945045+0000", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027785380000000001 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945132+0000", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6719999999999996e-05 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945200+0000", 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8851999999999997e-05 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.214333411, 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014617554, 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930908+0000", 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.930909+0000", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5570000000000001e-06 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931057+0000", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014749500000000001 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931082+0000", 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5775999999999999e-05 2024-04-22T19:55:37.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931098+0000", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5466999999999999e-05 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939762+0000", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086643929999999994 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.939890+0000", 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012771200000000001 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.940089+0000", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019858199999999999 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945017+0000", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049281960000000001 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945405+0000", 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038789299999999999 2024-04-22T19:55:37.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945467+0000", 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2632999999999995e-05 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945525+0000", 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7849999999999997e-05 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.21409419299999, 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014521055, 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931147+0000", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931148+0000", 2024-04-22T19:55:37.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.497e-06 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931159+0000", 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.096e-05 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931181+0000", 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1899000000000002e-05 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931196+0000", 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941141+0000", 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099444300000000006 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941314+0000", 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017301600000000001 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.941521+0000", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020697200000000001 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945275+0000", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037539209999999999 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945539+0000", 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026469800000000001 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945599+0000", 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9576e-05 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945668+0000", 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8973000000000005e-05 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.21401821400001, 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:55:37.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:55:37.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:55:37.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213945471, 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:55:37.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:55:37.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213633667, 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.205 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.210 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213568194, 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.211 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213507921, 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:55:37.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:55:37.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:55:37.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213348575, 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 100.213275396, 2024-04-22T19:55:37.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:55:37.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:55:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.965063599000004, 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884825000000001, 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 137 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180177+0000", 2024-04-22T19:55:37.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180178+0000", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9900000000000002e-07 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180259+0000", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1549000000000001e-05 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180267+0000", 2024-04-22T19:55:37.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.593e-06 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180272+0000", 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9269999999999996e-06 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186080+0000", 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058079840000000004 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186195+0000", 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115217 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.186372+0000", 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176856 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190660+0000", 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004287875 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192985+0000", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023253520000000001 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193027+0000", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1414e-05 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193062+0000", 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5759000000000001e-05 2024-04-22T19:55:37.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.964958867000007, 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012847760999999999, 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.239 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180282+0000", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180283+0000", 2024-04-22T19:55:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7300000000000001e-07 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180286+0000", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180291+0000", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6450000000000004e-06 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180295+0000", 2024-04-22T19:55:37.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6009999999999999e-06 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188846+0000", 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085514470000000002 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.188935+0000", 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8420999999999999e-05 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189141+0000", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020624700000000001 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191048+0000", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001907307 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193070+0000", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00202155 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193102+0000", 2024-04-22T19:55:37.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2759000000000003e-05 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193130+0000", 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.964940702000007, 2024-04-22T19:55:37.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012916531, 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180300+0000", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180301+0000", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1399999999999998e-07 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180304+0000", 2024-04-22T19:55:37.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2679999999999999e-06 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180308+0000", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4580000000000003e-06 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180312+0000", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.467e-06 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.189885+0000", 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095729890000000005 2024-04-22T19:55:37.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190001+0000", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011649700000000001 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.190174+0000", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017303500000000001 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192975+0000", 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028006039999999999 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193139+0000", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016399399999999999 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193182+0000", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2930999999999999e-05 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193217+0000", 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4974000000000001e-05 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.249 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.964923687999999, 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014687356, 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.250 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180317+0000", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180318+0000", 2024-04-22T19:55:37.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0400000000000002e-07 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180396+0000", 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7892000000000006e-05 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180406+0000", 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.043e-05 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180410+0000", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4989999999999996e-06 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191106+0000", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010695766000000001 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191214+0000", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010816500000000001 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.191404+0000", 2024-04-22T19:55:37.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018987299999999999 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.193565+0000", 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021603299999999998 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194817+0000", 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001252317 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.194926+0000", 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109084 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195005+0000", 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8695999999999993e-05 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.964820469000003, 2024-04-22T19:55:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017192622000000001, 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180421+0000", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3300000000000002e-07 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180425+0000", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:37.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180465+0000", 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0085e-05 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.180478+0000", 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3008e-05 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192215+0000", 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011736682999999999 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192332+0000", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117521 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.192505+0000", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172614 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.195655+0000", 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031501099999999998 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197459+0000", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018036650000000001 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197546+0000", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7253e-05 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:57.197613+0000", 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7376e-05 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:37.261 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:37.261 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:37.262 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:37.263 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:37.259+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:37.363 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:37.359+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:37.434 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:37.434 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:37.434 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:37.434 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:37.454 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:37.464 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:37.463+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:37.565 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:37.563+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:37.623 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:37.623 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:37.623 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:37.623 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:37.623 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:37.641 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:37.666 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:37.667+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:37.726 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.7 to 1 (10000) 2024-04-22T19:55:37.735 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:55:37.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-22T19:55:37.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:55:37.803 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:37.803+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:37.854 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:37.854 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.127410578, 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.09033021400001, 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:37.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.089397625, 2024-04-22T19:55:37.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:37.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.08817469500001, 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:37.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:37.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:37.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.08640648799999, 2024-04-22T19:55:37.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:37.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:37.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.90771345, 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.90669412699999, 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.89399202200001, 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.662475621, 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.655033651, 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:37.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.898 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.442110851999999, 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.899 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:37.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.484106052000001, 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.905 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:37.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.464279508999994, 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.911 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:37.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.433872328000007, 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:37.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.922 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.418044827000003, 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:37.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:37.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:37.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.389598852999995, 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:37.928 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:37.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:37.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.370982088000005, 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.934 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:37.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:37.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:37.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:37.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.939 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.316926022000004, 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.898449588999995, 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:37.945 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:37.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:37.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.340641617000003, 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:37.951 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:37.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:37.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:37.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:37.957 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:37.958 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:37.959 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:37.955+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:38.060 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:38.055+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:38.161 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:38.159+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:38.172 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:38.172 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:38.172 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:38.172 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:38.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:38.261 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:38.259+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:55:38.350 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:55:38.358 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:38.358 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:38.367 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-22T19:55:37.727459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231300,"kb_used_data":6800,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743420,"statfs":{"total":773094113280,"available":772857262080,"internally_reserved":0,"allocated":6963200,"data_stored":4117846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.071411"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149808+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:55:35.149808+0000","last_peered":"2024-04-22T19:55:35.149808+0000","last_clean":"2024-04-22T19:55:35.149808+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:55:35.149808+0000","last_undegraded":"2024-04-22T19:55:35.149808+0000","last_fullsized":"2024-04-22T19:55:35.149808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145464+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:55:35.145464+0000","last_peered":"2024-04-22T19:55:35.145464+0000","last_clean":"2024-04-22T19:55:35.145464+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:55:35.145464+0000","last_undegraded":"2024-04-22T19:55:35.145464+0000","last_fullsized":"2024-04-22T19:55:35.145464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691846+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:55:34.691846+0000","last_peered":"2024-04-22T19:55:34.691846+0000","last_clean":"2024-04-22T19:55:34.691846+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:55:34.691846+0000","last_undegraded":"2024-04-22T19:55:34.691846+0000","last_fullsized":"2024-04-22T19:55:34.691846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146503+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:55:35.146503+0000","last_peered":"2024-04-22T19:55:35.146503+0000","last_clean":"2024-04-22T19:55:35.146503+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:55:35.146503+0000","last_undegraded":"2024-04-22T19:55:35.146503+0000","last_fullsized":"2024-04-22T19:55:35.146503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690624+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:55:34.690624+0000","last_peered":"2024-04-22T19:55:34.690624+0000","last_clean":"2024-04-22T19:55:34.690624+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:55:34.690624+0000","last_undegraded":"2024-04-22T19:55:34.690624+0000","last_fullsized":"2024-04-22T19:55:34.690624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685306+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:55:34.685306+0000","last_peered":"2024-04-22T19:55:34.685306+0000","last_clean":"2024-04-22T19:55:34.685306+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:55:34.685306+0000","last_undegraded":"2024-04-22T19:55:34.685306+0000","last_fullsized":"2024-04-22T19:55:34.685306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149586+0000","last_change":"2024-04-22T19:54:09.335968+0000","last_active":"2024-04-22T19:55:35.149586+0000","last_peered":"2024-04-22T19:55:35.149586+0000","last_clean":"2024-04-22T19:55:35.149586+0000","last_became_active":"2024-04-22T19:54:09.335354+0000","last_became_peered":"2024-04-22T19:54:09.335354+0000","last_unstale":"2024-04-22T19:55:35.149586+0000","last_undegraded":"2024-04-22T19:55:35.149586+0000","last_fullsized":"2024-04-22T19:55:35.149586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691049+0000","last_change":"2024-04-22T19:54:11.352164+0000","last_active":"2024-04-22T19:55:34.691049+0000","last_peered":"2024-04-22T19:55:34.691049+0000","last_clean":"2024-04-22T19:55:34.691049+0000","last_became_active":"2024-04-22T19:54:11.351808+0000","last_became_peered":"2024-04-22T19:54:11.351808+0000","last_unstale":"2024-04-22T19:55:34.691049+0000","last_undegraded":"2024-04-22T19:55:34.691049+0000","last_fullsized":"2024-04-22T19:55:34.691049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149279+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:55:35.149279+0000","last_peered":"2024-04-22T19:55:35.149279+0000","last_clean":"2024-04-22T19:55:35.149279+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:55:35.149279+0000","last_undegraded":"2024-04-22T19:55:35.149279+0000","last_fullsized":"2024-04-22T19:55:35.149279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757585+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:55:34.757585+0000","last_peered":"2024-04-22T19:55:34.757585+0000","last_clean":"2024-04-22T19:55:34.757585+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:55:34.757585+0000","last_undegraded":"2024-04-22T19:55:34.757585+0000","last_fullsized":"2024-04-22T19:55:34.757585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147330+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:55:35.147330+0000","last_peered":"2024-04-22T19:55:35.147330+0000","last_clean":"2024-04-22T19:55:35.147330+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:55:35.147330+0000","last_undegraded":"2024-04-22T19:55:35.147330+0000","last_fullsized":"2024-04-22T19:55:35.147330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686543+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:55:34.686543+0000","last_peered":"2024-04-22T19:55:34.686543+0000","last_clean":"2024-04-22T19:55:34.686543+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:55:34.686543+0000","last_undegraded":"2024-04-22T19:55:34.686543+0000","last_fullsized":"2024-04-22T19:55:34.686543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146964+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:55:35.146964+0000","last_peered":"2024-04-22T19:55:35.146964+0000","last_clean":"2024-04-22T19:55:35.146964+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:55:35.146964+0000","last_undegraded":"2024-04-22T19:55:35.146964+0000","last_fullsized":"2024-04-22T19:55:35.146964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147518+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:55:35.147518+0000","last_peered":"2024-04-22T19:55:35.147518+0000","last_clean":"2024-04-22T19:55:35.147518+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:55:35.147518+0000","last_undegraded":"2024-04-22T19:55:35.147518+0000","last_fullsized":"2024-04-22T19:55:35.147518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144240+0000","last_change":"2024-04-22T19:54:48.937027+0000","last_active":"2024-04-22T19:55:35.144240+0000","last_peered":"2024-04-22T19:55:35.144240+0000","last_clean":"2024-04-22T19:55:35.144240+0000","last_became_active":"2024-04-22T19:54:48.936273+0000","last_became_peered":"2024-04-22T19:54:48.936273+0000","last_unstale":"2024-04-22T19:55:35.144240+0000","last_undegraded":"2024-04-22T19:55:35.144240+0000","last_fullsized":"2024-04-22T19:55:35.144240+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:15.579075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148178+0000","last_change":"2024-04-22T19:54:11.366719+0000","last_active":"2024-04-22T19:55:35.148178+0000","last_peered":"2024-04-22T19:55:35.148178+0000","last_clean":"2024-04-22T19:55:35.148178+0000","last_became_active":"2024-04-22T19:54:11.366430+0000","last_became_peered":"2024-04-22T19:54:11.366430+0000","last_unstale":"2024-04-22T19:55:35.148178+0000","last_undegraded":"2024-04-22T19:55:35.148178+0000","last_fullsized":"2024-04-22T19:55:35.148178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:20.853206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684835+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:55:34.684835+0000","last_peered":"2024-04-22T19:55:34.684835+0000","last_clean":"2024-04-22T19:55:34.684835+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:55:34.684835+0000","last_undegraded":"2024-04-22T19:55:34.684835+0000","last_fullsized":"2024-04-22T19:55:34.684835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147178+0000","last_change":"2024-04-22T19:54:48.940408+0000","last_active":"2024-04-22T19:55:35.147178+0000","last_peered":"2024-04-22T19:55:35.147178+0000","last_clean":"2024-04-22T19:55:35.147178+0000","last_became_active":"2024-04-22T19:54:48.938505+0000","last_became_peered":"2024-04-22T19:54:48.938505+0000","last_unstale":"2024-04-22T19:55:35.147178+0000","last_undegraded":"2024-04-22T19:55:35.147178+0000","last_fullsized":"2024-04-22T19:55:35.147178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:33.852890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146716+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:55:35.146716+0000","last_peered":"2024-04-22T19:55:35.146716+0000","last_clean":"2024-04-22T19:55:35.146716+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:55:35.146716+0000","last_undegraded":"2024-04-22T19:55:35.146716+0000","last_fullsized":"2024-04-22T19:55:35.146716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757949+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:55:34.757949+0000","last_peered":"2024-04-22T19:55:34.757949+0000","last_clean":"2024-04-22T19:55:34.757949+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:55:34.757949+0000","last_undegraded":"2024-04-22T19:55:34.757949+0000","last_fullsized":"2024-04-22T19:55:34.757949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147729+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:55:35.147729+0000","last_peered":"2024-04-22T19:55:35.147729+0000","last_clean":"2024-04-22T19:55:35.147729+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:55:35.147729+0000","last_undegraded":"2024-04-22T19:55:35.147729+0000","last_fullsized":"2024-04-22T19:55:35.147729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758413+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:55:34.758413+0000","last_peered":"2024-04-22T19:55:34.758413+0000","last_clean":"2024-04-22T19:55:34.758413+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:55:34.758413+0000","last_undegraded":"2024-04-22T19:55:34.758413+0000","last_fullsized":"2024-04-22T19:55:34.758413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145445+0000","last_change":"2024-04-22T19:54:11.366667+0000","last_active":"2024-04-22T19:55:35.145445+0000","last_peered":"2024-04-22T19:55:35.145445+0000","last_clean":"2024-04-22T19:55:35.145445+0000","last_became_active":"2024-04-22T19:54:11.366362+0000","last_became_peered":"2024-04-22T19:54:11.366362+0000","last_unstale":"2024-04-22T19:55:35.145445+0000","last_undegraded":"2024-04-22T19:55:35.145445+0000","last_fullsized":"2024-04-22T19:55:35.145445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:55.770295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685739+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:55:34.685739+0000","last_peered":"2024-04-22T19:55:34.685739+0000","last_clean":"2024-04-22T19:55:34.685739+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:55:34.685739+0000","last_undegraded":"2024-04-22T19:55:34.685739+0000","last_fullsized":"2024-04-22T19:55:34.685739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147765+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:55:35.147765+0000","last_peered":"2024-04-22T19:55:35.147765+0000","last_clean":"2024-04-22T19:55:35.147765+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:55:35.147765+0000","last_undegraded":"2024-04-22T19:55:35.147765+0000","last_fullsized":"2024-04-22T19:55:35.147765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153061+0000","last_change":"2024-04-22T19:54:09.323744+0000","last_active":"2024-04-22T19:55:35.153061+0000","last_peered":"2024-04-22T19:55:35.153061+0000","last_clean":"2024-04-22T19:55:35.153061+0000","last_became_active":"2024-04-22T19:54:09.323397+0000","last_became_peered":"2024-04-22T19:54:09.323397+0000","last_unstale":"2024-04-22T19:55:35.153061+0000","last_undegraded":"2024-04-22T19:55:35.153061+0000","last_fullsized":"2024-04-22T19:55:35.153061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686759+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:55:34.686759+0000","last_peered":"2024-04-22T19:55:34.686759+0000","last_clean":"2024-04-22T19:55:34.686759+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:55:34.686759+0000","last_undegraded":"2024-04-22T19:55:34.686759+0000","last_fullsized":"2024-04-22T19:55:34.686759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688706+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:55:34.688706+0000","last_peered":"2024-04-22T19:55:34.688706+0000","last_clean":"2024-04-22T19:55:34.688706+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:55:34.688706+0000","last_undegraded":"2024-04-22T19:55:34.688706+0000","last_fullsized":"2024-04-22T19:55:34.688706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684288+0000","last_change":"2024-04-22T19:54:19.384172+0000","last_active":"2024-04-22T19:55:34.684288+0000","last_peered":"2024-04-22T19:55:34.684288+0000","last_clean":"2024-04-22T19:55:34.684288+0000","last_became_active":"2024-04-22T19:54:19.383327+0000","last_became_peered":"2024-04-22T19:54:19.383327+0000","last_unstale":"2024-04-22T19:55:34.684288+0000","last_undegraded":"2024-04-22T19:55:34.684288+0000","last_fullsized":"2024-04-22T19:55:34.684288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154241+0000","last_change":"2024-04-22T19:54:11.367608+0000","last_active":"2024-04-22T19:55:35.154241+0000","last_peered":"2024-04-22T19:55:35.154241+0000","last_clean":"2024-04-22T19:55:35.154241+0000","last_became_active":"2024-04-22T19:54:11.366912+0000","last_became_peered":"2024-04-22T19:54:11.366912+0000","last_unstale":"2024-04-22T19:55:35.154241+0000","last_undegraded":"2024-04-22T19:55:35.154241+0000","last_fullsized":"2024-04-22T19:55:35.154241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149489+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:55:35.149489+0000","last_peered":"2024-04-22T19:55:35.149489+0000","last_clean":"2024-04-22T19:55:35.149489+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:55:35.149489+0000","last_undegraded":"2024-04-22T19:55:35.149489+0000","last_fullsized":"2024-04-22T19:55:35.149489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147202+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:55:35.147202+0000","last_peered":"2024-04-22T19:55:35.147202+0000","last_clean":"2024-04-22T19:55:35.147202+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:55:35.147202+0000","last_undegraded":"2024-04-22T19:55:35.147202+0000","last_fullsized":"2024-04-22T19:55:35.147202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691899+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:55:34.691899+0000","last_peered":"2024-04-22T19:55:34.691899+0000","last_clean":"2024-04-22T19:55:34.691899+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:55:34.691899+0000","last_undegraded":"2024-04-22T19:55:34.691899+0000","last_fullsized":"2024-04-22T19:55:34.691899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149201+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:55:35.149201+0000","last_peered":"2024-04-22T19:55:35.149201+0000","last_clean":"2024-04-22T19:55:35.149201+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:55:35.149201+0000","last_undegraded":"2024-04-22T19:55:35.149201+0000","last_fullsized":"2024-04-22T19:55:35.149201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145513+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:55:35.145513+0000","last_peered":"2024-04-22T19:55:35.145513+0000","last_clean":"2024-04-22T19:55:35.145513+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:55:35.145513+0000","last_undegraded":"2024-04-22T19:55:35.145513+0000","last_fullsized":"2024-04-22T19:55:35.145513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147696+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:55:35.147696+0000","last_peered":"2024-04-22T19:55:35.147696+0000","last_clean":"2024-04-22T19:55:35.147696+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:55:35.147696+0000","last_undegraded":"2024-04-22T19:55:35.147696+0000","last_fullsized":"2024-04-22T19:55:35.147696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.695204+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:55:34.695204+0000","last_peered":"2024-04-22T19:55:34.695204+0000","last_clean":"2024-04-22T19:55:34.695204+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:55:34.695204+0000","last_undegraded":"2024-04-22T19:55:34.695204+0000","last_fullsized":"2024-04-22T19:55:34.695204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":79,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154078+0000","last_change":"2024-04-22T19:54:13.358928+0000","last_active":"2024-04-22T19:55:35.154078+0000","last_peered":"2024-04-22T19:55:35.154078+0000","last_clean":"2024-04-22T19:55:35.154078+0000","last_became_active":"2024-04-22T19:54:13.358215+0000","last_became_peered":"2024-04-22T19:54:13.358215+0000","last_unstale":"2024-04-22T19:55:35.154078+0000","last_undegraded":"2024-04-22T19:55:35.154078+0000","last_fullsized":"2024-04-22T19:55:35.154078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686822+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:55:34.686822+0000","last_peered":"2024-04-22T19:55:34.686822+0000","last_clean":"2024-04-22T19:55:34.686822+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:55:34.686822+0000","last_undegraded":"2024-04-22T19:55:34.686822+0000","last_fullsized":"2024-04-22T19:55:34.686822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686961+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:55:34.686961+0000","last_peered":"2024-04-22T19:55:34.686961+0000","last_clean":"2024-04-22T19:55:34.686961+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:55:34.686961+0000","last_undegraded":"2024-04-22T19:55:34.686961+0000","last_fullsized":"2024-04-22T19:55:34.686961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688489+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:55:34.688489+0000","last_peered":"2024-04-22T19:55:34.688489+0000","last_clean":"2024-04-22T19:55:34.688489+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:55:34.688489+0000","last_undegraded":"2024-04-22T19:55:34.688489+0000","last_fullsized":"2024-04-22T19:55:34.688489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692428+0000","last_change":"2024-04-22T19:54:11.344326+0000","last_active":"2024-04-22T19:55:34.692428+0000","last_peered":"2024-04-22T19:55:34.692428+0000","last_clean":"2024-04-22T19:55:34.692428+0000","last_became_active":"2024-04-22T19:54:11.343967+0000","last_became_peered":"2024-04-22T19:54:11.343967+0000","last_unstale":"2024-04-22T19:55:34.692428+0000","last_undegraded":"2024-04-22T19:55:34.692428+0000","last_fullsized":"2024-04-22T19:55:34.692428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147198+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:55:35.147198+0000","last_peered":"2024-04-22T19:55:35.147198+0000","last_clean":"2024-04-22T19:55:35.147198+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:55:35.147198+0000","last_undegraded":"2024-04-22T19:55:35.147198+0000","last_fullsized":"2024-04-22T19:55:35.147198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156972+0000","last_change":"2024-04-22T19:54:13.353567+0000","last_active":"2024-04-22T19:55:35.156972+0000","last_peered":"2024-04-22T19:55:35.156972+0000","last_clean":"2024-04-22T19:55:35.156972+0000","last_became_active":"2024-04-22T19:54:13.353104+0000","last_became_peered":"2024-04-22T19:54:13.353104+0000","last_unstale":"2024-04-22T19:55:35.156972+0000","last_undegraded":"2024-04-22T19:55:35.156972+0000","last_fullsized":"2024-04-22T19:55:35.156972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147592+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:55:35.147592+0000","last_peered":"2024-04-22T19:55:35.147592+0000","last_clean":"2024-04-22T19:55:35.147592+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:55:35.147592+0000","last_undegraded":"2024-04-22T19:55:35.147592+0000","last_fullsized":"2024-04-22T19:55:35.147592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149043+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:55:35.149043+0000","last_peered":"2024-04-22T19:55:35.149043+0000","last_clean":"2024-04-22T19:55:35.149043+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:55:35.149043+0000","last_undegraded":"2024-04-22T19:55:35.149043+0000","last_fullsized":"2024-04-22T19:55:35.149043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684952+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:55:34.684952+0000","last_peered":"2024-04-22T19:55:34.684952+0000","last_clean":"2024-04-22T19:55:34.684952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:55:34.684952+0000","last_undegraded":"2024-04-22T19:55:34.684952+0000","last_fullsized":"2024-04-22T19:55:34.684952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156570+0000","last_change":"2024-04-22T19:54:11.367430+0000","last_active":"2024-04-22T19:55:35.156570+0000","last_peered":"2024-04-22T19:55:35.156570+0000","last_clean":"2024-04-22T19:55:35.156570+0000","last_became_active":"2024-04-22T19:54:11.367019+0000","last_became_peered":"2024-04-22T19:54:11.367019+0000","last_unstale":"2024-04-22T19:55:35.156570+0000","last_undegraded":"2024-04-22T19:55:35.156570+0000","last_fullsized":"2024-04-22T19:55:35.156570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756819+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:55:34.756819+0000","last_peered":"2024-04-22T19:55:34.756819+0000","last_clean":"2024-04-22T19:55:34.756819+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:55:34.756819+0000","last_undegraded":"2024-04-22T19:55:34.756819+0000","last_fullsized":"2024-04-22T19:55:34.756819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146766+0000","last_change":"2024-04-22T19:54:13.373018+0000","last_active":"2024-04-22T19:55:35.146766+0000","last_peered":"2024-04-22T19:55:35.146766+0000","last_clean":"2024-04-22T19:55:35.146766+0000","last_became_active":"2024-04-22T19:54:13.372322+0000","last_became_peered":"2024-04-22T19:54:13.372322+0000","last_unstale":"2024-04-22T19:55:35.146766+0000","last_undegraded":"2024-04-22T19:55:35.146766+0000","last_fullsized":"2024-04-22T19:55:35.146766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149760+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:55:35.149760+0000","last_peered":"2024-04-22T19:55:35.149760+0000","last_clean":"2024-04-22T19:55:35.149760+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:55:35.149760+0000","last_undegraded":"2024-04-22T19:55:35.149760+0000","last_fullsized":"2024-04-22T19:55:35.149760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153865+0000","last_change":"2024-04-22T19:54:17.386681+0000","last_active":"2024-04-22T19:55:35.153865+0000","last_peered":"2024-04-22T19:55:35.153865+0000","last_clean":"2024-04-22T19:55:35.153865+0000","last_became_active":"2024-04-22T19:54:17.385957+0000","last_became_peered":"2024-04-22T19:54:17.385957+0000","last_unstale":"2024-04-22T19:55:35.153865+0000","last_undegraded":"2024-04-22T19:55:35.153865+0000","last_fullsized":"2024-04-22T19:55:35.153865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:20.429084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145934+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:55:35.145934+0000","last_peered":"2024-04-22T19:55:35.145934+0000","last_clean":"2024-04-22T19:55:35.145934+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:55:35.145934+0000","last_undegraded":"2024-04-22T19:55:35.145934+0000","last_fullsized":"2024-04-22T19:55:35.145934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149688+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:55:35.149688+0000","last_peered":"2024-04-22T19:55:35.149688+0000","last_clean":"2024-04-22T19:55:35.149688+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:55:35.149688+0000","last_undegraded":"2024-04-22T19:55:35.149688+0000","last_fullsized":"2024-04-22T19:55:35.149688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145943+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:55:35.145943+0000","last_peered":"2024-04-22T19:55:35.145943+0000","last_clean":"2024-04-22T19:55:35.145943+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:55:35.145943+0000","last_undegraded":"2024-04-22T19:55:35.145943+0000","last_fullsized":"2024-04-22T19:55:35.145943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145516+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:55:35.145516+0000","last_peered":"2024-04-22T19:55:35.145516+0000","last_clean":"2024-04-22T19:55:35.145516+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:55:35.145516+0000","last_undegraded":"2024-04-22T19:55:35.145516+0000","last_fullsized":"2024-04-22T19:55:35.145516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687928+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:55:34.687928+0000","last_peered":"2024-04-22T19:55:34.687928+0000","last_clean":"2024-04-22T19:55:34.687928+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:55:34.687928+0000","last_undegraded":"2024-04-22T19:55:34.687928+0000","last_fullsized":"2024-04-22T19:55:34.687928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146506+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:55:35.146506+0000","last_peered":"2024-04-22T19:55:35.146506+0000","last_clean":"2024-04-22T19:55:35.146506+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:55:35.146506+0000","last_undegraded":"2024-04-22T19:55:35.146506+0000","last_fullsized":"2024-04-22T19:55:35.146506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684833+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:55:34.684833+0000","last_peered":"2024-04-22T19:55:34.684833+0000","last_clean":"2024-04-22T19:55:34.684833+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:55:34.684833+0000","last_undegraded":"2024-04-22T19:55:34.684833+0000","last_fullsized":"2024-04-22T19:55:34.684833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149401+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:55:35.149401+0000","last_peered":"2024-04-22T19:55:35.149401+0000","last_clean":"2024-04-22T19:55:35.149401+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:55:35.149401+0000","last_undegraded":"2024-04-22T19:55:35.149401+0000","last_fullsized":"2024-04-22T19:55:35.149401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144481+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:55:35.144481+0000","last_peered":"2024-04-22T19:55:35.144481+0000","last_clean":"2024-04-22T19:55:35.144481+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:55:35.144481+0000","last_undegraded":"2024-04-22T19:55:35.144481+0000","last_fullsized":"2024-04-22T19:55:35.144481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153402+0000","last_change":"2024-04-22T19:54:15.368608+0000","last_active":"2024-04-22T19:55:35.153402+0000","last_peered":"2024-04-22T19:55:35.153402+0000","last_clean":"2024-04-22T19:55:35.153402+0000","last_became_active":"2024-04-22T19:54:15.367821+0000","last_became_peered":"2024-04-22T19:54:15.367821+0000","last_unstale":"2024-04-22T19:55:35.153402+0000","last_undegraded":"2024-04-22T19:55:35.153402+0000","last_fullsized":"2024-04-22T19:55:35.153402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151277+0000","last_change":"2024-04-22T19:54:17.387097+0000","last_active":"2024-04-22T19:55:35.151277+0000","last_peered":"2024-04-22T19:55:35.151277+0000","last_clean":"2024-04-22T19:55:35.151277+0000","last_became_active":"2024-04-22T19:54:17.386193+0000","last_became_peered":"2024-04-22T19:54:17.386193+0000","last_unstale":"2024-04-22T19:55:35.151277+0000","last_undegraded":"2024-04-22T19:55:35.151277+0000","last_fullsized":"2024-04-22T19:55:35.151277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:39.707399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757438+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:55:34.757438+0000","last_peered":"2024-04-22T19:55:34.757438+0000","last_clean":"2024-04-22T19:55:34.757438+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:55:34.757438+0000","last_undegraded":"2024-04-22T19:55:34.757438+0000","last_fullsized":"2024-04-22T19:55:34.757438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757521+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:55:34.757521+0000","last_peered":"2024-04-22T19:55:34.757521+0000","last_clean":"2024-04-22T19:55:34.757521+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:55:34.757521+0000","last_undegraded":"2024-04-22T19:55:34.757521+0000","last_fullsized":"2024-04-22T19:55:34.757521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150645+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:55:35.150645+0000","last_peered":"2024-04-22T19:55:35.150645+0000","last_clean":"2024-04-22T19:55:35.150645+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:55:35.150645+0000","last_undegraded":"2024-04-22T19:55:35.150645+0000","last_fullsized":"2024-04-22T19:55:35.150645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145659+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:55:35.145659+0000","last_peered":"2024-04-22T19:55:35.145659+0000","last_clean":"2024-04-22T19:55:35.145659+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:55:35.145659+0000","last_undegraded":"2024-04-22T19:55:35.145659+0000","last_fullsized":"2024-04-22T19:55:35.145659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145989+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:55:35.145989+0000","last_peered":"2024-04-22T19:55:35.145989+0000","last_clean":"2024-04-22T19:55:35.145989+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:55:35.145989+0000","last_undegraded":"2024-04-22T19:55:35.145989+0000","last_fullsized":"2024-04-22T19:55:35.145989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687911+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:55:34.687911+0000","last_peered":"2024-04-22T19:55:34.687911+0000","last_clean":"2024-04-22T19:55:34.687911+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:55:34.687911+0000","last_undegraded":"2024-04-22T19:55:34.687911+0000","last_fullsized":"2024-04-22T19:55:34.687911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691979+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:55:34.691979+0000","last_peered":"2024-04-22T19:55:34.691979+0000","last_clean":"2024-04-22T19:55:34.691979+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:55:34.691979+0000","last_undegraded":"2024-04-22T19:55:34.691979+0000","last_fullsized":"2024-04-22T19:55:34.691979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691597+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:55:34.691597+0000","last_peered":"2024-04-22T19:55:34.691597+0000","last_clean":"2024-04-22T19:55:34.691597+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:55:34.691597+0000","last_undegraded":"2024-04-22T19:55:34.691597+0000","last_fullsized":"2024-04-22T19:55:34.691597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150234+0000","last_change":"2024-04-22T19:54:09.334166+0000","last_active":"2024-04-22T19:55:35.150234+0000","last_peered":"2024-04-22T19:55:35.150234+0000","last_clean":"2024-04-22T19:55:35.150234+0000","last_became_active":"2024-04-22T19:54:09.333460+0000","last_became_peered":"2024-04-22T19:54:09.333460+0000","last_unstale":"2024-04-22T19:55:35.150234+0000","last_undegraded":"2024-04-22T19:55:35.150234+0000","last_fullsized":"2024-04-22T19:55:35.150234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145223+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:55:35.145223+0000","last_peered":"2024-04-22T19:55:35.145223+0000","last_clean":"2024-04-22T19:55:35.145223+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:55:35.145223+0000","last_undegraded":"2024-04-22T19:55:35.145223+0000","last_fullsized":"2024-04-22T19:55:35.145223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688158+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:55:34.688158+0000","last_peered":"2024-04-22T19:55:34.688158+0000","last_clean":"2024-04-22T19:55:34.688158+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:55:34.688158+0000","last_undegraded":"2024-04-22T19:55:34.688158+0000","last_fullsized":"2024-04-22T19:55:34.688158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144347+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:55:35.144347+0000","last_peered":"2024-04-22T19:55:35.144347+0000","last_clean":"2024-04-22T19:55:35.144347+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:55:35.144347+0000","last_undegraded":"2024-04-22T19:55:35.144347+0000","last_fullsized":"2024-04-22T19:55:35.144347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691263+0000","last_change":"2024-04-22T19:54:19.378028+0000","last_active":"2024-04-22T19:55:34.691263+0000","last_peered":"2024-04-22T19:55:34.691263+0000","last_clean":"2024-04-22T19:55:34.691263+0000","last_became_active":"2024-04-22T19:54:19.377273+0000","last_became_peered":"2024-04-22T19:54:19.377273+0000","last_unstale":"2024-04-22T19:55:34.691263+0000","last_undegraded":"2024-04-22T19:55:34.691263+0000","last_fullsized":"2024-04-22T19:55:34.691263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:00.036846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686133+0000","last_change":"2024-04-22T19:54:11.349479+0000","last_active":"2024-04-22T19:55:34.686133+0000","last_peered":"2024-04-22T19:55:34.686133+0000","last_clean":"2024-04-22T19:55:34.686133+0000","last_became_active":"2024-04-22T19:54:11.347357+0000","last_became_peered":"2024-04-22T19:54:11.347357+0000","last_unstale":"2024-04-22T19:55:34.686133+0000","last_undegraded":"2024-04-22T19:55:34.686133+0000","last_fullsized":"2024-04-22T19:55:34.686133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151378+0000","last_change":"2024-04-22T19:54:09.326454+0000","last_active":"2024-04-22T19:55:35.151378+0000","last_peered":"2024-04-22T19:55:35.151378+0000","last_clean":"2024-04-22T19:55:35.151378+0000","last_became_active":"2024-04-22T19:54:09.326120+0000","last_became_peered":"2024-04-22T19:54:09.326120+0000","last_unstale":"2024-04-22T19:55:35.151378+0000","last_undegraded":"2024-04-22T19:55:35.151378+0000","last_fullsized":"2024-04-22T19:55:35.151378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144240+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:55:35.144240+0000","last_peered":"2024-04-22T19:55:35.144240+0000","last_clean":"2024-04-22T19:55:35.144240+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:55:35.144240+0000","last_undegraded":"2024-04-22T19:55:35.144240+0000","last_fullsized":"2024-04-22T19:55:35.144240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686531+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:55:34.686531+0000","last_peered":"2024-04-22T19:55:34.686531+0000","last_clean":"2024-04-22T19:55:34.686531+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:55:34.686531+0000","last_undegraded":"2024-04-22T19:55:34.686531+0000","last_fullsized":"2024-04-22T19:55:34.686531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692770+0000","last_change":"2024-04-22T19:54:17.393342+0000","last_active":"2024-04-22T19:55:34.692770+0000","last_peered":"2024-04-22T19:55:34.692770+0000","last_clean":"2024-04-22T19:55:34.692770+0000","last_became_active":"2024-04-22T19:54:17.392114+0000","last_became_peered":"2024-04-22T19:54:17.392114+0000","last_unstale":"2024-04-22T19:55:34.692770+0000","last_undegraded":"2024-04-22T19:55:34.692770+0000","last_fullsized":"2024-04-22T19:55:34.692770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149043+0000","last_change":"2024-04-22T19:54:19.387476+0000","last_active":"2024-04-22T19:55:35.149043+0000","last_peered":"2024-04-22T19:55:35.149043+0000","last_clean":"2024-04-22T19:55:35.149043+0000","last_became_active":"2024-04-22T19:54:19.386778+0000","last_became_peered":"2024-04-22T19:54:19.386778+0000","last_unstale":"2024-04-22T19:55:35.149043+0000","last_undegraded":"2024-04-22T19:55:35.149043+0000","last_fullsized":"2024-04-22T19:55:35.149043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:46.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686999+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:55:34.686999+0000","last_peered":"2024-04-22T19:55:34.686999+0000","last_clean":"2024-04-22T19:55:34.686999+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:55:34.686999+0000","last_undegraded":"2024-04-22T19:55:34.686999+0000","last_fullsized":"2024-04-22T19:55:34.686999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757772+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:55:34.757772+0000","last_peered":"2024-04-22T19:55:34.757772+0000","last_clean":"2024-04-22T19:55:34.757772+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:55:34.757772+0000","last_undegraded":"2024-04-22T19:55:34.757772+0000","last_fullsized":"2024-04-22T19:55:34.757772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688141+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:55:34.688141+0000","last_peered":"2024-04-22T19:55:34.688141+0000","last_clean":"2024-04-22T19:55:34.688141+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:55:34.688141+0000","last_undegraded":"2024-04-22T19:55:34.688141+0000","last_fullsized":"2024-04-22T19:55:34.688141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148049+0000","last_change":"2024-04-22T19:54:15.358926+0000","last_active":"2024-04-22T19:55:35.148049+0000","last_peered":"2024-04-22T19:55:35.148049+0000","last_clean":"2024-04-22T19:55:35.148049+0000","last_became_active":"2024-04-22T19:54:15.358167+0000","last_became_peered":"2024-04-22T19:54:15.358167+0000","last_unstale":"2024-04-22T19:55:35.148049+0000","last_undegraded":"2024-04-22T19:55:35.148049+0000","last_fullsized":"2024-04-22T19:55:35.148049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:07.130557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144483+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:55:35.144483+0000","last_peered":"2024-04-22T19:55:35.144483+0000","last_clean":"2024-04-22T19:55:35.144483+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:55:35.144483+0000","last_undegraded":"2024-04-22T19:55:35.144483+0000","last_fullsized":"2024-04-22T19:55:35.144483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687180+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:55:34.687180+0000","last_peered":"2024-04-22T19:55:34.687180+0000","last_clean":"2024-04-22T19:55:34.687180+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:55:34.687180+0000","last_undegraded":"2024-04-22T19:55:34.687180+0000","last_fullsized":"2024-04-22T19:55:34.687180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687245+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:55:34.687245+0000","last_peered":"2024-04-22T19:55:34.687245+0000","last_clean":"2024-04-22T19:55:34.687245+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:55:34.687245+0000","last_undegraded":"2024-04-22T19:55:34.687245+0000","last_fullsized":"2024-04-22T19:55:34.687245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685574+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:55:34.685574+0000","last_peered":"2024-04-22T19:55:34.685574+0000","last_clean":"2024-04-22T19:55:34.685574+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:55:34.685574+0000","last_undegraded":"2024-04-22T19:55:34.685574+0000","last_fullsized":"2024-04-22T19:55:34.685574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146734+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:55:35.146734+0000","last_peered":"2024-04-22T19:55:35.146734+0000","last_clean":"2024-04-22T19:55:35.146734+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:55:35.146734+0000","last_undegraded":"2024-04-22T19:55:35.146734+0000","last_fullsized":"2024-04-22T19:55:35.146734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153950+0000","last_change":"2024-04-22T19:54:15.374924+0000","last_active":"2024-04-22T19:55:35.153950+0000","last_peered":"2024-04-22T19:55:35.153950+0000","last_clean":"2024-04-22T19:55:35.153950+0000","last_became_active":"2024-04-22T19:54:15.374027+0000","last_became_peered":"2024-04-22T19:54:15.374027+0000","last_unstale":"2024-04-22T19:55:35.153950+0000","last_undegraded":"2024-04-22T19:55:35.153950+0000","last_fullsized":"2024-04-22T19:55:35.153950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:16.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757878+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:55:34.757878+0000","last_peered":"2024-04-22T19:55:34.757878+0000","last_clean":"2024-04-22T19:55:34.757878+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:55:34.757878+0000","last_undegraded":"2024-04-22T19:55:34.757878+0000","last_fullsized":"2024-04-22T19:55:34.757878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685145+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:55:34.685145+0000","last_peered":"2024-04-22T19:55:34.685145+0000","last_clean":"2024-04-22T19:55:34.685145+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:55:34.685145+0000","last_undegraded":"2024-04-22T19:55:34.685145+0000","last_fullsized":"2024-04-22T19:55:34.685145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147267+0000","last_change":"2024-04-22T19:54:48.462442+0000","last_active":"2024-04-22T19:55:35.147267+0000","last_peered":"2024-04-22T19:55:35.147267+0000","last_clean":"2024-04-22T19:55:35.147267+0000","last_became_active":"2024-04-22T19:54:48.461838+0000","last_became_peered":"2024-04-22T19:54:48.461838+0000","last_unstale":"2024-04-22T19:55:35.147267+0000","last_undegraded":"2024-04-22T19:55:35.147267+0000","last_fullsized":"2024-04-22T19:55:35.147267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:55.872338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149626+0000","last_change":"2024-04-22T19:54:09.324349+0000","last_active":"2024-04-22T19:55:35.149626+0000","last_peered":"2024-04-22T19:55:35.149626+0000","last_clean":"2024-04-22T19:55:35.149626+0000","last_became_active":"2024-04-22T19:54:09.324055+0000","last_became_peered":"2024-04-22T19:54:09.324055+0000","last_unstale":"2024-04-22T19:55:35.149626+0000","last_undegraded":"2024-04-22T19:55:35.149626+0000","last_fullsized":"2024-04-22T19:55:35.149626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687011+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:55:34.687011+0000","last_peered":"2024-04-22T19:55:34.687011+0000","last_clean":"2024-04-22T19:55:34.687011+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:55:34.687011+0000","last_undegraded":"2024-04-22T19:55:34.687011+0000","last_fullsized":"2024-04-22T19:55:34.687011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":101,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146996+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:55:35.146996+0000","last_peered":"2024-04-22T19:55:35.146996+0000","last_clean":"2024-04-22T19:55:35.146996+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:55:35.146996+0000","last_undegraded":"2024-04-22T19:55:35.146996+0000","last_fullsized":"2024-04-22T19:55:35.146996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757341+0000","last_change":"2024-04-22T19:54:17.394078+0000","last_active":"2024-04-22T19:55:34.757341+0000","last_peered":"2024-04-22T19:55:34.757341+0000","last_clean":"2024-04-22T19:55:34.757341+0000","last_became_active":"2024-04-22T19:54:17.393405+0000","last_became_peered":"2024-04-22T19:54:17.393405+0000","last_unstale":"2024-04-22T19:55:34.757341+0000","last_undegraded":"2024-04-22T19:55:34.757341+0000","last_fullsized":"2024-04-22T19:55:34.757341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:18.989391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687845+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:55:34.687845+0000","last_peered":"2024-04-22T19:55:34.687845+0000","last_clean":"2024-04-22T19:55:34.687845+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:55:34.687845+0000","last_undegraded":"2024-04-22T19:55:34.687845+0000","last_fullsized":"2024-04-22T19:55:34.687845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758205+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:55:34.758205+0000","last_peered":"2024-04-22T19:55:34.758205+0000","last_clean":"2024-04-22T19:55:34.758205+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:55:34.758205+0000","last_undegraded":"2024-04-22T19:55:34.758205+0000","last_fullsized":"2024-04-22T19:55:34.758205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146108+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:55:35.146108+0000","last_peered":"2024-04-22T19:55:35.146108+0000","last_clean":"2024-04-22T19:55:35.146108+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:55:35.146108+0000","last_undegraded":"2024-04-22T19:55:35.146108+0000","last_fullsized":"2024-04-22T19:55:35.146108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146756+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:55:35.146756+0000","last_peered":"2024-04-22T19:55:35.146756+0000","last_clean":"2024-04-22T19:55:35.146756+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:55:35.146756+0000","last_undegraded":"2024-04-22T19:55:35.146756+0000","last_fullsized":"2024-04-22T19:55:35.146756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151544+0000","last_change":"2024-04-22T19:54:09.342243+0000","last_active":"2024-04-22T19:55:35.151544+0000","last_peered":"2024-04-22T19:55:35.151544+0000","last_clean":"2024-04-22T19:55:35.151544+0000","last_became_active":"2024-04-22T19:54:09.341757+0000","last_became_peered":"2024-04-22T19:54:09.341757+0000","last_unstale":"2024-04-22T19:55:35.151544+0000","last_undegraded":"2024-04-22T19:55:35.151544+0000","last_fullsized":"2024-04-22T19:55:35.151544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149451+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:55:35.149451+0000","last_peered":"2024-04-22T19:55:35.149451+0000","last_clean":"2024-04-22T19:55:35.149451+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:55:35.149451+0000","last_undegraded":"2024-04-22T19:55:35.149451+0000","last_fullsized":"2024-04-22T19:55:35.149451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147128+0000","last_change":"2024-04-22T19:54:15.374361+0000","last_active":"2024-04-22T19:55:35.147128+0000","last_peered":"2024-04-22T19:55:35.147128+0000","last_clean":"2024-04-22T19:55:35.147128+0000","last_became_active":"2024-04-22T19:54:15.373665+0000","last_became_peered":"2024-04-22T19:54:15.373665+0000","last_unstale":"2024-04-22T19:55:35.147128+0000","last_undegraded":"2024-04-22T19:55:35.147128+0000","last_fullsized":"2024-04-22T19:55:35.147128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692057+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:55:34.692057+0000","last_peered":"2024-04-22T19:55:34.692057+0000","last_clean":"2024-04-22T19:55:34.692057+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:55:34.692057+0000","last_undegraded":"2024-04-22T19:55:34.692057+0000","last_fullsized":"2024-04-22T19:55:34.692057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756539+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:55:34.756539+0000","last_peered":"2024-04-22T19:55:34.756539+0000","last_clean":"2024-04-22T19:55:34.756539+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:55:34.756539+0000","last_undegraded":"2024-04-22T19:55:34.756539+0000","last_fullsized":"2024-04-22T19:55:34.756539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692315+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:55:34.692315+0000","last_peered":"2024-04-22T19:55:34.692315+0000","last_clean":"2024-04-22T19:55:34.692315+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:55:34.692315+0000","last_undegraded":"2024-04-22T19:55:34.692315+0000","last_fullsized":"2024-04-22T19:55:34.692315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145690+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:55:35.145690+0000","last_peered":"2024-04-22T19:55:35.145690+0000","last_clean":"2024-04-22T19:55:35.145690+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:55:35.145690+0000","last_undegraded":"2024-04-22T19:55:35.145690+0000","last_fullsized":"2024-04-22T19:55:35.145690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688239+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:55:34.688239+0000","last_peered":"2024-04-22T19:55:34.688239+0000","last_clean":"2024-04-22T19:55:34.688239+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:55:34.688239+0000","last_undegraded":"2024-04-22T19:55:34.688239+0000","last_fullsized":"2024-04-22T19:55:34.688239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147609+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:55:35.147609+0000","last_peered":"2024-04-22T19:55:35.147609+0000","last_clean":"2024-04-22T19:55:35.147609+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:55:35.147609+0000","last_undegraded":"2024-04-22T19:55:35.147609+0000","last_fullsized":"2024-04-22T19:55:35.147609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":131,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688060+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:55:34.688060+0000","last_peered":"2024-04-22T19:55:34.688060+0000","last_clean":"2024-04-22T19:55:34.688060+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:55:34.688060+0000","last_undegraded":"2024-04-22T19:55:34.688060+0000","last_fullsized":"2024-04-22T19:55:34.688060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149158+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:55:35.149158+0000","last_peered":"2024-04-22T19:55:35.149158+0000","last_clean":"2024-04-22T19:55:35.149158+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:55:35.149158+0000","last_undegraded":"2024-04-22T19:55:35.149158+0000","last_fullsized":"2024-04-22T19:55:35.149158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687179+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:55:34.687179+0000","last_peered":"2024-04-22T19:55:34.687179+0000","last_clean":"2024-04-22T19:55:34.687179+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:55:34.687179+0000","last_undegraded":"2024-04-22T19:55:34.687179+0000","last_fullsized":"2024-04-22T19:55:34.687179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691519+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:55:34.691519+0000","last_peered":"2024-04-22T19:55:34.691519+0000","last_clean":"2024-04-22T19:55:34.691519+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:55:34.691519+0000","last_undegraded":"2024-04-22T19:55:34.691519+0000","last_fullsized":"2024-04-22T19:55:34.691519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144920+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:55:35.144920+0000","last_peered":"2024-04-22T19:55:35.144920+0000","last_clean":"2024-04-22T19:55:35.144920+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:55:35.144920+0000","last_undegraded":"2024-04-22T19:55:35.144920+0000","last_fullsized":"2024-04-22T19:55:35.144920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686943+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:55:34.686943+0000","last_peered":"2024-04-22T19:55:34.686943+0000","last_clean":"2024-04-22T19:55:34.686943+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:55:34.686943+0000","last_undegraded":"2024-04-22T19:55:34.686943+0000","last_fullsized":"2024-04-22T19:55:34.686943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144665+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:55:35.144665+0000","last_peered":"2024-04-22T19:55:35.144665+0000","last_clean":"2024-04-22T19:55:35.144665+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:55:35.144665+0000","last_undegraded":"2024-04-22T19:55:35.144665+0000","last_fullsized":"2024-04-22T19:55:35.144665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150241+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:55:35.150241+0000","last_peered":"2024-04-22T19:55:35.150241+0000","last_clean":"2024-04-22T19:55:35.150241+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:55:35.150241+0000","last_undegraded":"2024-04-22T19:55:35.150241+0000","last_fullsized":"2024-04-22T19:55:35.150241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693212+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:55:34.693212+0000","last_peered":"2024-04-22T19:55:34.693212+0000","last_clean":"2024-04-22T19:55:34.693212+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:55:34.693212+0000","last_undegraded":"2024-04-22T19:55:34.693212+0000","last_fullsized":"2024-04-22T19:55:34.693212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153207+0000","last_change":"2024-04-22T19:54:19.383707+0000","last_active":"2024-04-22T19:55:35.153207+0000","last_peered":"2024-04-22T19:55:35.153207+0000","last_clean":"2024-04-22T19:55:35.153207+0000","last_became_active":"2024-04-22T19:54:19.383071+0000","last_became_peered":"2024-04-22T19:54:19.383071+0000","last_unstale":"2024-04-22T19:55:35.153207+0000","last_undegraded":"2024-04-22T19:55:35.153207+0000","last_fullsized":"2024-04-22T19:55:35.153207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:25:04.464367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688295+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:55:34.688295+0000","last_peered":"2024-04-22T19:55:34.688295+0000","last_clean":"2024-04-22T19:55:34.688295+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:55:34.688295+0000","last_undegraded":"2024-04-22T19:55:34.688295+0000","last_fullsized":"2024-04-22T19:55:34.688295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149624+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:55:35.149624+0000","last_peered":"2024-04-22T19:55:35.149624+0000","last_clean":"2024-04-22T19:55:35.149624+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:55:35.149624+0000","last_undegraded":"2024-04-22T19:55:35.149624+0000","last_fullsized":"2024-04-22T19:55:35.149624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686090+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:55:34.686090+0000","last_peered":"2024-04-22T19:55:34.686090+0000","last_clean":"2024-04-22T19:55:34.686090+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:55:34.686090+0000","last_undegraded":"2024-04-22T19:55:34.686090+0000","last_fullsized":"2024-04-22T19:55:34.686090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690506+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:55:34.690506+0000","last_peered":"2024-04-22T19:55:34.690506+0000","last_clean":"2024-04-22T19:55:34.690506+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:55:34.690506+0000","last_undegraded":"2024-04-22T19:55:34.690506+0000","last_fullsized":"2024-04-22T19:55:34.690506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156392+0000","last_change":"2024-04-22T19:54:15.366419+0000","last_active":"2024-04-22T19:55:35.156392+0000","last_peered":"2024-04-22T19:55:35.156392+0000","last_clean":"2024-04-22T19:55:35.156392+0000","last_became_active":"2024-04-22T19:54:15.365688+0000","last_became_peered":"2024-04-22T19:54:15.365688+0000","last_unstale":"2024-04-22T19:55:35.156392+0000","last_undegraded":"2024-04-22T19:55:35.156392+0000","last_fullsized":"2024-04-22T19:55:35.156392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758426+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:55:34.758426+0000","last_peered":"2024-04-22T19:55:34.758426+0000","last_clean":"2024-04-22T19:55:34.758426+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:55:34.758426+0000","last_undegraded":"2024-04-22T19:55:34.758426+0000","last_fullsized":"2024-04-22T19:55:34.758426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145123+0000","last_change":"2024-04-22T19:54:19.386206+0000","last_active":"2024-04-22T19:55:35.145123+0000","last_peered":"2024-04-22T19:55:35.145123+0000","last_clean":"2024-04-22T19:55:35.145123+0000","last_became_active":"2024-04-22T19:54:19.383699+0000","last_became_peered":"2024-04-22T19:54:19.383699+0000","last_unstale":"2024-04-22T19:55:35.145123+0000","last_undegraded":"2024-04-22T19:55:35.145123+0000","last_fullsized":"2024-04-22T19:55:35.145123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.713155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687494+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:55:34.687494+0000","last_peered":"2024-04-22T19:55:34.687494+0000","last_clean":"2024-04-22T19:55:34.687494+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:55:34.687494+0000","last_undegraded":"2024-04-22T19:55:34.687494+0000","last_fullsized":"2024-04-22T19:55:34.687494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147941+0000","last_change":"2024-04-22T19:54:09.337813+0000","last_active":"2024-04-22T19:55:35.147941+0000","last_peered":"2024-04-22T19:55:35.147941+0000","last_clean":"2024-04-22T19:55:35.147941+0000","last_became_active":"2024-04-22T19:54:09.336677+0000","last_became_peered":"2024-04-22T19:54:09.336677+0000","last_unstale":"2024-04-22T19:55:35.147941+0000","last_undegraded":"2024-04-22T19:55:35.147941+0000","last_fullsized":"2024-04-22T19:55:35.147941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:51.697234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691985+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:55:34.691985+0000","last_peered":"2024-04-22T19:55:34.691985+0000","last_clean":"2024-04-22T19:55:34.691985+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:55:34.691985+0000","last_undegraded":"2024-04-22T19:55:34.691985+0000","last_fullsized":"2024-04-22T19:55:34.691985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691196+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:55:34.691196+0000","last_peered":"2024-04-22T19:55:34.691196+0000","last_clean":"2024-04-22T19:55:34.691196+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:55:34.691196+0000","last_undegraded":"2024-04-22T19:55:34.691196+0000","last_fullsized":"2024-04-22T19:55:34.691196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":106,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687567+0000","last_change":"2024-04-22T19:54:15.373085+0000","last_active":"2024-04-22T19:55:34.687567+0000","last_peered":"2024-04-22T19:55:34.687567+0000","last_clean":"2024-04-22T19:55:34.687567+0000","last_became_active":"2024-04-22T19:54:15.372367+0000","last_became_peered":"2024-04-22T19:54:15.372367+0000","last_unstale":"2024-04-22T19:55:34.687567+0000","last_undegraded":"2024-04-22T19:55:34.687567+0000","last_fullsized":"2024-04-22T19:55:34.687567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684510+0000","last_change":"2024-04-22T19:54:17.388656+0000","last_active":"2024-04-22T19:55:34.684510+0000","last_peered":"2024-04-22T19:55:34.684510+0000","last_clean":"2024-04-22T19:55:34.684510+0000","last_became_active":"2024-04-22T19:54:17.387837+0000","last_became_peered":"2024-04-22T19:54:17.387837+0000","last_unstale":"2024-04-22T19:55:34.684510+0000","last_undegraded":"2024-04-22T19:55:34.684510+0000","last_fullsized":"2024-04-22T19:55:34.684510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691773+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:55:34.691773+0000","last_peered":"2024-04-22T19:55:34.691773+0000","last_clean":"2024-04-22T19:55:34.691773+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:55:34.691773+0000","last_undegraded":"2024-04-22T19:55:34.691773+0000","last_fullsized":"2024-04-22T19:55:34.691773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691519+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:55:34.691519+0000","last_peered":"2024-04-22T19:55:34.691519+0000","last_clean":"2024-04-22T19:55:34.691519+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:55:34.691519+0000","last_undegraded":"2024-04-22T19:55:34.691519+0000","last_fullsized":"2024-04-22T19:55:34.691519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688365+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:55:34.688365+0000","last_peered":"2024-04-22T19:55:34.688365+0000","last_clean":"2024-04-22T19:55:34.688365+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:55:34.688365+0000","last_undegraded":"2024-04-22T19:55:34.688365+0000","last_fullsized":"2024-04-22T19:55:34.688365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150966+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:55:35.150966+0000","last_peered":"2024-04-22T19:55:35.150966+0000","last_clean":"2024-04-22T19:55:35.150966+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:55:35.150966+0000","last_undegraded":"2024-04-22T19:55:35.150966+0000","last_fullsized":"2024-04-22T19:55:35.150966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757048+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:55:34.757048+0000","last_peered":"2024-04-22T19:55:34.757048+0000","last_clean":"2024-04-22T19:55:34.757048+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:55:34.757048+0000","last_undegraded":"2024-04-22T19:55:34.757048+0000","last_fullsized":"2024-04-22T19:55:34.757048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686898+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:55:34.686898+0000","last_peered":"2024-04-22T19:55:34.686898+0000","last_clean":"2024-04-22T19:55:34.686898+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:55:34.686898+0000","last_undegraded":"2024-04-22T19:55:34.686898+0000","last_fullsized":"2024-04-22T19:55:34.686898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145574+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:55:35.145574+0000","last_peered":"2024-04-22T19:55:35.145574+0000","last_clean":"2024-04-22T19:55:35.145574+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:55:35.145574+0000","last_undegraded":"2024-04-22T19:55:35.145574+0000","last_fullsized":"2024-04-22T19:55:35.145574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156853+0000","last_change":"2024-04-22T19:54:19.959246+0000","last_active":"2024-04-22T19:55:35.156853+0000","last_peered":"2024-04-22T19:55:35.156853+0000","last_clean":"2024-04-22T19:55:35.156853+0000","last_became_active":"2024-04-22T19:54:19.958416+0000","last_became_peered":"2024-04-22T19:54:19.958416+0000","last_unstale":"2024-04-22T19:55:35.156853+0000","last_undegraded":"2024-04-22T19:55:35.156853+0000","last_fullsized":"2024-04-22T19:55:35.156853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:36.008379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149366+0000","last_change":"2024-04-22T19:54:11.361967+0000","last_active":"2024-04-22T19:55:35.149366+0000","last_peered":"2024-04-22T19:55:35.149366+0000","last_clean":"2024-04-22T19:55:35.149366+0000","last_became_active":"2024-04-22T19:54:11.361431+0000","last_became_peered":"2024-04-22T19:54:11.361431+0000","last_unstale":"2024-04-22T19:55:35.149366+0000","last_undegraded":"2024-04-22T19:55:35.149366+0000","last_fullsized":"2024-04-22T19:55:35.149366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156462+0000","last_change":"2024-04-22T19:54:09.338528+0000","last_active":"2024-04-22T19:55:35.156462+0000","last_peered":"2024-04-22T19:55:35.156462+0000","last_clean":"2024-04-22T19:55:35.156462+0000","last_became_active":"2024-04-22T19:54:09.338299+0000","last_became_peered":"2024-04-22T19:54:09.338299+0000","last_unstale":"2024-04-22T19:55:35.156462+0000","last_undegraded":"2024-04-22T19:55:35.156462+0000","last_fullsized":"2024-04-22T19:55:35.156462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691928+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:55:34.691928+0000","last_peered":"2024-04-22T19:55:34.691928+0000","last_clean":"2024-04-22T19:55:34.691928+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:55:34.691928+0000","last_undegraded":"2024-04-22T19:55:34.691928+0000","last_fullsized":"2024-04-22T19:55:34.691928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684752+0000","last_change":"2024-04-22T19:54:13.347158+0000","last_active":"2024-04-22T19:55:34.684752+0000","last_peered":"2024-04-22T19:55:34.684752+0000","last_clean":"2024-04-22T19:55:34.684752+0000","last_became_active":"2024-04-22T19:54:13.346353+0000","last_became_peered":"2024-04-22T19:54:13.346353+0000","last_unstale":"2024-04-22T19:55:34.684752+0000","last_undegraded":"2024-04-22T19:55:34.684752+0000","last_fullsized":"2024-04-22T19:55:34.684752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685410+0000","last_change":"2024-04-22T19:54:15.361224+0000","last_active":"2024-04-22T19:55:34.685410+0000","last_peered":"2024-04-22T19:55:34.685410+0000","last_clean":"2024-04-22T19:55:34.685410+0000","last_became_active":"2024-04-22T19:54:15.359915+0000","last_became_peered":"2024-04-22T19:54:15.359915+0000","last_unstale":"2024-04-22T19:55:34.685410+0000","last_undegraded":"2024-04-22T19:55:34.685410+0000","last_fullsized":"2024-04-22T19:55:34.685410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153691+0000","last_change":"2024-04-22T19:54:17.386494+0000","last_active":"2024-04-22T19:55:35.153691+0000","last_peered":"2024-04-22T19:55:35.153691+0000","last_clean":"2024-04-22T19:55:35.153691+0000","last_became_active":"2024-04-22T19:54:17.385851+0000","last_became_peered":"2024-04-22T19:54:17.385851+0000","last_unstale":"2024-04-22T19:55:35.153691+0000","last_undegraded":"2024-04-22T19:55:35.153691+0000","last_fullsized":"2024-04-22T19:55:35.153691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:09.967672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693285+0000","last_change":"2024-04-22T19:54:19.376787+0000","last_active":"2024-04-22T19:55:34.693285+0000","last_peered":"2024-04-22T19:55:34.693285+0000","last_clean":"2024-04-22T19:55:34.693285+0000","last_became_active":"2024-04-22T19:54:19.375982+0000","last_became_peered":"2024-04-22T19:54:19.375982+0000","last_unstale":"2024-04-22T19:55:34.693285+0000","last_undegraded":"2024-04-22T19:55:34.693285+0000","last_fullsized":"2024-04-22T19:55:34.693285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:56:39.975385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684998+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:55:34.684998+0000","last_peered":"2024-04-22T19:55:34.684998+0000","last_clean":"2024-04-22T19:55:34.684998+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:55:34.684998+0000","last_undegraded":"2024-04-22T19:55:34.684998+0000","last_fullsized":"2024-04-22T19:55:34.684998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692501+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:55:34.692501+0000","last_peered":"2024-04-22T19:55:34.692501+0000","last_clean":"2024-04-22T19:55:34.692501+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:55:34.692501+0000","last_undegraded":"2024-04-22T19:55:34.692501+0000","last_fullsized":"2024-04-22T19:55:34.692501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758914+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:55:34.758914+0000","last_peered":"2024-04-22T19:55:34.758914+0000","last_clean":"2024-04-22T19:55:34.758914+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:55:34.758914+0000","last_undegraded":"2024-04-22T19:55:34.758914+0000","last_fullsized":"2024-04-22T19:55:34.758914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149252+0000","last_change":"2024-04-22T19:54:13.351579+0000","last_active":"2024-04-22T19:55:35.149252+0000","last_peered":"2024-04-22T19:55:35.149252+0000","last_clean":"2024-04-22T19:55:35.149252+0000","last_became_active":"2024-04-22T19:54:13.350953+0000","last_became_peered":"2024-04-22T19:54:13.350953+0000","last_unstale":"2024-04-22T19:55:35.149252+0000","last_undegraded":"2024-04-22T19:55:35.149252+0000","last_fullsized":"2024-04-22T19:55:35.149252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:33.938710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148458+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:55:35.148458+0000","last_peered":"2024-04-22T19:55:35.148458+0000","last_clean":"2024-04-22T19:55:35.148458+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:55:35.148458+0000","last_undegraded":"2024-04-22T19:55:35.148458+0000","last_fullsized":"2024-04-22T19:55:35.148458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151315+0000","last_change":"2024-04-22T19:54:17.374439+0000","last_active":"2024-04-22T19:55:35.151315+0000","last_peered":"2024-04-22T19:55:35.151315+0000","last_clean":"2024-04-22T19:55:35.151315+0000","last_became_active":"2024-04-22T19:54:17.373658+0000","last_became_peered":"2024-04-22T19:54:17.373658+0000","last_unstale":"2024-04-22T19:55:35.151315+0000","last_undegraded":"2024-04-22T19:55:35.151315+0000","last_fullsized":"2024-04-22T19:55:35.151315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:33.579486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146920+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:55:35.146920+0000","last_peered":"2024-04-22T19:55:35.146920+0000","last_clean":"2024-04-22T19:55:35.146920+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:55:35.146920+0000","last_undegraded":"2024-04-22T19:55:35.146920+0000","last_fullsized":"2024-04-22T19:55:35.146920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692647+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:55:34.692647+0000","last_peered":"2024-04-22T19:55:34.692647+0000","last_clean":"2024-04-22T19:55:34.692647+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:55:34.692647+0000","last_undegraded":"2024-04-22T19:55:34.692647+0000","last_fullsized":"2024-04-22T19:55:34.692647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686058+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:55:34.686058+0000","last_peered":"2024-04-22T19:55:34.686058+0000","last_clean":"2024-04-22T19:55:34.686058+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:55:34.686058+0000","last_undegraded":"2024-04-22T19:55:34.686058+0000","last_fullsized":"2024-04-22T19:55:34.686058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685471+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:55:34.685471+0000","last_peered":"2024-04-22T19:55:34.685471+0000","last_clean":"2024-04-22T19:55:34.685471+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:55:34.685471+0000","last_undegraded":"2024-04-22T19:55:34.685471+0000","last_fullsized":"2024-04-22T19:55:34.685471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687623+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:55:34.687623+0000","last_peered":"2024-04-22T19:55:34.687623+0000","last_clean":"2024-04-22T19:55:34.687623+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:55:34.687623+0000","last_undegraded":"2024-04-22T19:55:34.687623+0000","last_fullsized":"2024-04-22T19:55:34.687623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148937+0000","last_change":"2024-04-22T19:54:15.364296+0000","last_active":"2024-04-22T19:55:35.148937+0000","last_peered":"2024-04-22T19:55:35.148937+0000","last_clean":"2024-04-22T19:55:35.148937+0000","last_became_active":"2024-04-22T19:54:15.363550+0000","last_became_peered":"2024-04-22T19:54:15.363550+0000","last_unstale":"2024-04-22T19:55:35.148937+0000","last_undegraded":"2024-04-22T19:55:35.148937+0000","last_fullsized":"2024-04-22T19:55:35.148937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149125+0000","last_change":"2024-04-22T19:54:17.387336+0000","last_active":"2024-04-22T19:55:35.149125+0000","last_peered":"2024-04-22T19:55:35.149125+0000","last_clean":"2024-04-22T19:55:35.149125+0000","last_became_active":"2024-04-22T19:54:17.386601+0000","last_became_peered":"2024-04-22T19:54:17.386601+0000","last_unstale":"2024-04-22T19:55:35.149125+0000","last_undegraded":"2024-04-22T19:55:35.149125+0000","last_fullsized":"2024-04-22T19:55:35.149125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:50.780788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156164+0000","last_change":"2024-04-22T19:54:19.389080+0000","last_active":"2024-04-22T19:55:35.156164+0000","last_peered":"2024-04-22T19:55:35.156164+0000","last_clean":"2024-04-22T19:55:35.156164+0000","last_became_active":"2024-04-22T19:54:19.388263+0000","last_became_peered":"2024-04-22T19:54:19.388263+0000","last_unstale":"2024-04-22T19:55:35.156164+0000","last_undegraded":"2024-04-22T19:55:35.156164+0000","last_fullsized":"2024-04-22T19:55:35.156164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:13:06.973763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687416+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:55:34.687416+0000","last_peered":"2024-04-22T19:55:34.687416+0000","last_clean":"2024-04-22T19:55:34.687416+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:55:34.687416+0000","last_undegraded":"2024-04-22T19:55:34.687416+0000","last_fullsized":"2024-04-22T19:55:34.687416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150597+0000","last_change":"2024-04-22T19:54:09.358724+0000","last_active":"2024-04-22T19:55:35.150597+0000","last_peered":"2024-04-22T19:55:35.150597+0000","last_clean":"2024-04-22T19:55:35.150597+0000","last_became_active":"2024-04-22T19:54:09.357161+0000","last_became_peered":"2024-04-22T19:54:09.357161+0000","last_unstale":"2024-04-22T19:55:35.150597+0000","last_undegraded":"2024-04-22T19:55:35.150597+0000","last_fullsized":"2024-04-22T19:55:35.150597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153134+0000","last_change":"2024-04-22T19:54:13.346921+0000","last_active":"2024-04-22T19:55:35.153134+0000","last_peered":"2024-04-22T19:55:35.153134+0000","last_clean":"2024-04-22T19:55:35.153134+0000","last_became_active":"2024-04-22T19:54:13.346460+0000","last_became_peered":"2024-04-22T19:54:13.346460+0000","last_unstale":"2024-04-22T19:55:35.153134+0000","last_undegraded":"2024-04-22T19:55:35.153134+0000","last_fullsized":"2024-04-22T19:55:35.153134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"41'5","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687437+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:55:34.687437+0000","last_peered":"2024-04-22T19:55:34.687437+0000","last_clean":"2024-04-22T19:55:34.687437+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:55:34.687437+0000","last_undegraded":"2024-04-22T19:55:34.687437+0000","last_fullsized":"2024-04-22T19:55:34.687437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146293+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:55:35.146293+0000","last_peered":"2024-04-22T19:55:35.146293+0000","last_clean":"2024-04-22T19:55:35.146293+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:55:35.146293+0000","last_undegraded":"2024-04-22T19:55:35.146293+0000","last_fullsized":"2024-04-22T19:55:35.146293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690417+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:55:34.690417+0000","last_peered":"2024-04-22T19:55:34.690417+0000","last_clean":"2024-04-22T19:55:34.690417+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:55:34.690417+0000","last_undegraded":"2024-04-22T19:55:34.690417+0000","last_fullsized":"2024-04-22T19:55:34.690417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151822+0000","last_change":"2024-04-22T19:54:11.367199+0000","last_active":"2024-04-22T19:55:35.151822+0000","last_peered":"2024-04-22T19:55:35.151822+0000","last_clean":"2024-04-22T19:55:35.151822+0000","last_became_active":"2024-04-22T19:54:11.366927+0000","last_became_peered":"2024-04-22T19:54:11.366927+0000","last_unstale":"2024-04-22T19:55:35.151822+0000","last_undegraded":"2024-04-22T19:55:35.151822+0000","last_fullsized":"2024-04-22T19:55:35.151822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148284+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:55:35.148284+0000","last_peered":"2024-04-22T19:55:35.148284+0000","last_clean":"2024-04-22T19:55:35.148284+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:55:35.148284+0000","last_undegraded":"2024-04-22T19:55:35.148284+0000","last_fullsized":"2024-04-22T19:55:35.148284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145246+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:55:35.145246+0000","last_peered":"2024-04-22T19:55:35.145246+0000","last_clean":"2024-04-22T19:55:35.145246+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:55:35.145246+0000","last_undegraded":"2024-04-22T19:55:35.145246+0000","last_fullsized":"2024-04-22T19:55:35.145246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.152975+0000","last_change":"2024-04-22T19:54:15.366428+0000","last_active":"2024-04-22T19:55:35.152975+0000","last_peered":"2024-04-22T19:55:35.152975+0000","last_clean":"2024-04-22T19:55:35.152975+0000","last_became_active":"2024-04-22T19:54:15.363037+0000","last_became_peered":"2024-04-22T19:54:15.363037+0000","last_unstale":"2024-04-22T19:55:35.152975+0000","last_undegraded":"2024-04-22T19:55:35.152975+0000","last_fullsized":"2024-04-22T19:55:35.152975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:57.305820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757032+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:55:34.757032+0000","last_peered":"2024-04-22T19:55:34.757032+0000","last_clean":"2024-04-22T19:55:34.757032+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:55:34.757032+0000","last_undegraded":"2024-04-22T19:55:34.757032+0000","last_fullsized":"2024-04-22T19:55:34.757032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146238+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:55:35.146238+0000","last_peered":"2024-04-22T19:55:35.146238+0000","last_clean":"2024-04-22T19:55:35.146238+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:55:35.146238+0000","last_undegraded":"2024-04-22T19:55:35.146238+0000","last_fullsized":"2024-04-22T19:55:35.146238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149478+0000","last_change":"2024-04-22T19:54:11.365937+0000","last_active":"2024-04-22T19:55:35.149478+0000","last_peered":"2024-04-22T19:55:35.149478+0000","last_clean":"2024-04-22T19:55:35.149478+0000","last_became_active":"2024-04-22T19:54:11.365569+0000","last_became_peered":"2024-04-22T19:54:11.365569+0000","last_unstale":"2024-04-22T19:55:35.149478+0000","last_undegraded":"2024-04-22T19:55:35.149478+0000","last_fullsized":"2024-04-22T19:55:35.149478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693072+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:55:34.693072+0000","last_peered":"2024-04-22T19:55:34.693072+0000","last_clean":"2024-04-22T19:55:34.693072+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:55:34.693072+0000","last_undegraded":"2024-04-22T19:55:34.693072+0000","last_fullsized":"2024-04-22T19:55:34.693072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757204+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:55:34.757204+0000","last_peered":"2024-04-22T19:55:34.757204+0000","last_clean":"2024-04-22T19:55:34.757204+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:55:34.757204+0000","last_undegraded":"2024-04-22T19:55:34.757204+0000","last_fullsized":"2024-04-22T19:55:34.757204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147658+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:55:35.147658+0000","last_peered":"2024-04-22T19:55:35.147658+0000","last_clean":"2024-04-22T19:55:35.147658+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:55:35.147658+0000","last_undegraded":"2024-04-22T19:55:35.147658+0000","last_fullsized":"2024-04-22T19:55:35.147658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690904+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:55:34.690904+0000","last_peered":"2024-04-22T19:55:34.690904+0000","last_clean":"2024-04-22T19:55:34.690904+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:55:34.690904+0000","last_undegraded":"2024-04-22T19:55:34.690904+0000","last_fullsized":"2024-04-22T19:55:34.690904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758731+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:55:34.758731+0000","last_peered":"2024-04-22T19:55:34.758731+0000","last_clean":"2024-04-22T19:55:34.758731+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:55:34.758731+0000","last_undegraded":"2024-04-22T19:55:34.758731+0000","last_fullsized":"2024-04-22T19:55:34.758731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149551+0000","last_change":"2024-04-22T19:54:09.326439+0000","last_active":"2024-04-22T19:55:35.149551+0000","last_peered":"2024-04-22T19:55:35.149551+0000","last_clean":"2024-04-22T19:55:35.149551+0000","last_became_active":"2024-04-22T19:54:09.326162+0000","last_became_peered":"2024-04-22T19:54:09.326162+0000","last_unstale":"2024-04-22T19:55:35.149551+0000","last_undegraded":"2024-04-22T19:55:35.149551+0000","last_fullsized":"2024-04-22T19:55:35.149551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692128+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:55:34.692128+0000","last_peered":"2024-04-22T19:55:34.692128+0000","last_clean":"2024-04-22T19:55:34.692128+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:55:34.692128+0000","last_undegraded":"2024-04-22T19:55:34.692128+0000","last_fullsized":"2024-04-22T19:55:34.692128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688668+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:55:34.688668+0000","last_peered":"2024-04-22T19:55:34.688668+0000","last_clean":"2024-04-22T19:55:34.688668+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:55:34.688668+0000","last_undegraded":"2024-04-22T19:55:34.688668+0000","last_fullsized":"2024-04-22T19:55:34.688668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146754+0000","last_change":"2024-04-22T19:54:17.398926+0000","last_active":"2024-04-22T19:55:35.146754+0000","last_peered":"2024-04-22T19:55:35.146754+0000","last_clean":"2024-04-22T19:55:35.146754+0000","last_became_active":"2024-04-22T19:54:17.398270+0000","last_became_peered":"2024-04-22T19:54:17.398270+0000","last_unstale":"2024-04-22T19:55:35.146754+0000","last_undegraded":"2024-04-22T19:55:35.146754+0000","last_fullsized":"2024-04-22T19:55:35.146754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151277+0000","last_change":"2024-04-22T19:54:19.958725+0000","last_active":"2024-04-22T19:55:35.151277+0000","last_peered":"2024-04-22T19:55:35.151277+0000","last_clean":"2024-04-22T19:55:35.151277+0000","last_became_active":"2024-04-22T19:54:19.957923+0000","last_became_peered":"2024-04-22T19:54:19.957923+0000","last_unstale":"2024-04-22T19:55:35.151277+0000","last_undegraded":"2024-04-22T19:55:35.151277+0000","last_fullsized":"2024-04-22T19:55:35.151277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:06:47.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692244+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:55:34.692244+0000","last_peered":"2024-04-22T19:55:34.692244+0000","last_clean":"2024-04-22T19:55:34.692244+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:55:34.692244+0000","last_undegraded":"2024-04-22T19:55:34.692244+0000","last_fullsized":"2024-04-22T19:55:34.692244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687431+0000","last_change":"2024-04-22T19:54:09.323111+0000","last_active":"2024-04-22T19:55:34.687431+0000","last_peered":"2024-04-22T19:55:34.687431+0000","last_clean":"2024-04-22T19:55:34.687431+0000","last_became_active":"2024-04-22T19:54:09.322781+0000","last_became_peered":"2024-04-22T19:54:09.322781+0000","last_unstale":"2024-04-22T19:55:34.687431+0000","last_undegraded":"2024-04-22T19:55:34.687431+0000","last_fullsized":"2024-04-22T19:55:34.687431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758518+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:55:34.758518+0000","last_peered":"2024-04-22T19:55:34.758518+0000","last_clean":"2024-04-22T19:55:34.758518+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:55:34.758518+0000","last_undegraded":"2024-04-22T19:55:34.758518+0000","last_fullsized":"2024-04-22T19:55:34.758518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148498+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:55:35.148498+0000","last_peered":"2024-04-22T19:55:35.148498+0000","last_clean":"2024-04-22T19:55:35.148498+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:55:35.148498+0000","last_undegraded":"2024-04-22T19:55:35.148498+0000","last_fullsized":"2024-04-22T19:55:35.148498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688836+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:55:34.688836+0000","last_peered":"2024-04-22T19:55:34.688836+0000","last_clean":"2024-04-22T19:55:34.688836+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:55:34.688836+0000","last_undegraded":"2024-04-22T19:55:34.688836+0000","last_fullsized":"2024-04-22T19:55:34.688836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756759+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:55:34.756759+0000","last_peered":"2024-04-22T19:55:34.756759+0000","last_clean":"2024-04-22T19:55:34.756759+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:55:34.756759+0000","last_undegraded":"2024-04-22T19:55:34.756759+0000","last_fullsized":"2024-04-22T19:55:34.756759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156160+0000","last_change":"2024-04-22T19:54:11.366363+0000","last_active":"2024-04-22T19:55:35.156160+0000","last_peered":"2024-04-22T19:55:35.156160+0000","last_clean":"2024-04-22T19:55:35.156160+0000","last_became_active":"2024-04-22T19:54:11.365682+0000","last_became_peered":"2024-04-22T19:54:11.365682+0000","last_unstale":"2024-04-22T19:55:35.156160+0000","last_undegraded":"2024-04-22T19:55:35.156160+0000","last_fullsized":"2024-04-22T19:55:35.156160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685827+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:55:34.685827+0000","last_peered":"2024-04-22T19:55:34.685827+0000","last_clean":"2024-04-22T19:55:34.685827+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:55:34.685827+0000","last_undegraded":"2024-04-22T19:55:34.685827+0000","last_fullsized":"2024-04-22T19:55:34.685827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686563+0000","last_change":"2024-04-22T19:54:13.347115+0000","last_active":"2024-04-22T19:55:34.686563+0000","last_peered":"2024-04-22T19:55:34.686563+0000","last_clean":"2024-04-22T19:55:34.686563+0000","last_became_active":"2024-04-22T19:54:13.346214+0000","last_became_peered":"2024-04-22T19:54:13.346214+0000","last_unstale":"2024-04-22T19:55:34.686563+0000","last_undegraded":"2024-04-22T19:55:34.686563+0000","last_fullsized":"2024-04-22T19:55:34.686563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156700+0000","last_change":"2024-04-22T19:54:15.375428+0000","last_active":"2024-04-22T19:55:35.156700+0000","last_peered":"2024-04-22T19:55:35.156700+0000","last_clean":"2024-04-22T19:55:35.156700+0000","last_became_active":"2024-04-22T19:54:15.374863+0000","last_became_peered":"2024-04-22T19:54:15.374863+0000","last_unstale":"2024-04-22T19:55:35.156700+0000","last_undegraded":"2024-04-22T19:55:35.156700+0000","last_fullsized":"2024-04-22T19:55:35.156700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:56.025191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691693+0000","last_change":"2024-04-22T19:54:17.392924+0000","last_active":"2024-04-22T19:55:34.691693+0000","last_peered":"2024-04-22T19:55:34.691693+0000","last_clean":"2024-04-22T19:55:34.691693+0000","last_became_active":"2024-04-22T19:54:17.391991+0000","last_became_peered":"2024-04-22T19:54:17.391991+0000","last_unstale":"2024-04-22T19:55:34.691693+0000","last_undegraded":"2024-04-22T19:55:34.691693+0000","last_fullsized":"2024-04-22T19:55:34.691693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:47.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145522+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:55:35.145522+0000","last_peered":"2024-04-22T19:55:35.145522+0000","last_clean":"2024-04-22T19:55:35.145522+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:55:35.145522+0000","last_undegraded":"2024-04-22T19:55:35.145522+0000","last_fullsized":"2024-04-22T19:55:35.145522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147837+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:55:35.147837+0000","last_peered":"2024-04-22T19:55:35.147837+0000","last_clean":"2024-04-22T19:55:35.147837+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:55:35.147837+0000","last_undegraded":"2024-04-22T19:55:35.147837+0000","last_fullsized":"2024-04-22T19:55:35.147837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690977+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:55:34.690977+0000","last_peered":"2024-04-22T19:55:34.690977+0000","last_clean":"2024-04-22T19:55:34.690977+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:55:34.690977+0000","last_undegraded":"2024-04-22T19:55:34.690977+0000","last_fullsized":"2024-04-22T19:55:34.690977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688997+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:55:34.688997+0000","last_peered":"2024-04-22T19:55:34.688997+0000","last_clean":"2024-04-22T19:55:34.688997+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:55:34.688997+0000","last_undegraded":"2024-04-22T19:55:34.688997+0000","last_fullsized":"2024-04-22T19:55:34.688997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686785+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:55:34.686785+0000","last_peered":"2024-04-22T19:55:34.686785+0000","last_clean":"2024-04-22T19:55:34.686785+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:55:34.686785+0000","last_undegraded":"2024-04-22T19:55:34.686785+0000","last_fullsized":"2024-04-22T19:55:34.686785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758256+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:55:34.758256+0000","last_peered":"2024-04-22T19:55:34.758256+0000","last_clean":"2024-04-22T19:55:34.758256+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:55:34.758256+0000","last_undegraded":"2024-04-22T19:55:34.758256+0000","last_fullsized":"2024-04-22T19:55:34.758256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145050+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:55:35.145050+0000","last_peered":"2024-04-22T19:55:35.145050+0000","last_clean":"2024-04-22T19:55:35.145050+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:55:35.145050+0000","last_undegraded":"2024-04-22T19:55:35.145050+0000","last_fullsized":"2024-04-22T19:55:35.145050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685470+0000","last_change":"2024-04-22T19:54:11.345501+0000","last_active":"2024-04-22T19:55:34.685470+0000","last_peered":"2024-04-22T19:55:34.685470+0000","last_clean":"2024-04-22T19:55:34.685470+0000","last_became_active":"2024-04-22T19:54:11.342684+0000","last_became_peered":"2024-04-22T19:54:11.342684+0000","last_unstale":"2024-04-22T19:55:34.685470+0000","last_undegraded":"2024-04-22T19:55:34.685470+0000","last_fullsized":"2024-04-22T19:55:34.685470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149860+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:55:35.149860+0000","last_peered":"2024-04-22T19:55:35.149860+0000","last_clean":"2024-04-22T19:55:35.149860+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:55:35.149860+0000","last_undegraded":"2024-04-22T19:55:35.149860+0000","last_fullsized":"2024-04-22T19:55:35.149860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148017+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:55:35.148017+0000","last_peered":"2024-04-22T19:55:35.148017+0000","last_clean":"2024-04-22T19:55:35.148017+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:55:35.148017+0000","last_undegraded":"2024-04-22T19:55:35.148017+0000","last_fullsized":"2024-04-22T19:55:35.148017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145822+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:55:35.145822+0000","last_peered":"2024-04-22T19:55:35.145822+0000","last_clean":"2024-04-22T19:55:35.145822+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:55:35.145822+0000","last_undegraded":"2024-04-22T19:55:35.145822+0000","last_fullsized":"2024-04-22T19:55:35.145822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687173+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:55:34.687173+0000","last_peered":"2024-04-22T19:55:34.687173+0000","last_clean":"2024-04-22T19:55:34.687173+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:55:34.687173+0000","last_undegraded":"2024-04-22T19:55:34.687173+0000","last_fullsized":"2024-04-22T19:55:34.687173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149912+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:55:35.149912+0000","last_peered":"2024-04-22T19:55:35.149912+0000","last_clean":"2024-04-22T19:55:35.149912+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:55:35.149912+0000","last_undegraded":"2024-04-22T19:55:35.149912+0000","last_fullsized":"2024-04-22T19:55:35.149912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685564+0000","last_change":"2024-04-22T19:54:11.349313+0000","last_active":"2024-04-22T19:55:34.685564+0000","last_peered":"2024-04-22T19:55:34.685564+0000","last_clean":"2024-04-22T19:55:34.685564+0000","last_became_active":"2024-04-22T19:54:11.346733+0000","last_became_peered":"2024-04-22T19:54:11.346733+0000","last_unstale":"2024-04-22T19:55:34.685564+0000","last_undegraded":"2024-04-22T19:55:34.685564+0000","last_fullsized":"2024-04-22T19:55:34.685564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147774+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:55:35.147774+0000","last_peered":"2024-04-22T19:55:35.147774+0000","last_clean":"2024-04-22T19:55:35.147774+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:55:35.147774+0000","last_undegraded":"2024-04-22T19:55:35.147774+0000","last_fullsized":"2024-04-22T19:55:35.147774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146454+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:55:35.146454+0000","last_peered":"2024-04-22T19:55:35.146454+0000","last_clean":"2024-04-22T19:55:35.146454+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:55:35.146454+0000","last_undegraded":"2024-04-22T19:55:35.146454+0000","last_fullsized":"2024-04-22T19:55:35.146454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687266+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:55:34.687266+0000","last_peered":"2024-04-22T19:55:34.687266+0000","last_clean":"2024-04-22T19:55:34.687266+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:55:34.687266+0000","last_undegraded":"2024-04-22T19:55:34.687266+0000","last_fullsized":"2024-04-22T19:55:34.687266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756778+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:55:34.756778+0000","last_peered":"2024-04-22T19:55:34.756778+0000","last_clean":"2024-04-22T19:55:34.756778+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:55:34.756778+0000","last_undegraded":"2024-04-22T19:55:34.756778+0000","last_fullsized":"2024-04-22T19:55:34.756778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156259+0000","last_change":"2024-04-22T19:54:19.962442+0000","last_active":"2024-04-22T19:55:35.156259+0000","last_peered":"2024-04-22T19:55:35.156259+0000","last_clean":"2024-04-22T19:55:35.156259+0000","last_became_active":"2024-04-22T19:54:19.960324+0000","last_became_peered":"2024-04-22T19:54:19.960324+0000","last_unstale":"2024-04-22T19:55:35.156259+0000","last_undegraded":"2024-04-22T19:55:35.156259+0000","last_fullsized":"2024-04-22T19:55:35.156259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:28:38.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151935+0000","last_change":"2024-04-22T19:54:11.349398+0000","last_active":"2024-04-22T19:55:35.151935+0000","last_peered":"2024-04-22T19:55:35.151935+0000","last_clean":"2024-04-22T19:55:35.151935+0000","last_became_active":"2024-04-22T19:54:11.348383+0000","last_became_peered":"2024-04-22T19:54:11.348383+0000","last_unstale":"2024-04-22T19:55:35.151935+0000","last_undegraded":"2024-04-22T19:55:35.151935+0000","last_fullsized":"2024-04-22T19:55:35.151935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156573+0000","last_change":"2024-04-22T19:54:09.327427+0000","last_active":"2024-04-22T19:55:35.156573+0000","last_peered":"2024-04-22T19:55:35.156573+0000","last_clean":"2024-04-22T19:55:35.156573+0000","last_became_active":"2024-04-22T19:54:09.327146+0000","last_became_peered":"2024-04-22T19:54:09.327146+0000","last_unstale":"2024-04-22T19:55:35.156573+0000","last_undegraded":"2024-04-22T19:55:35.156573+0000","last_fullsized":"2024-04-22T19:55:35.156573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684331+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:55:34.684331+0000","last_peered":"2024-04-22T19:55:34.684331+0000","last_clean":"2024-04-22T19:55:34.684331+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:55:34.684331+0000","last_undegraded":"2024-04-22T19:55:34.684331+0000","last_fullsized":"2024-04-22T19:55:34.684331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153608+0000","last_change":"2024-04-22T19:54:15.367002+0000","last_active":"2024-04-22T19:55:35.153608+0000","last_peered":"2024-04-22T19:55:35.153608+0000","last_clean":"2024-04-22T19:55:35.153608+0000","last_became_active":"2024-04-22T19:54:15.363979+0000","last_became_peered":"2024-04-22T19:54:15.363979+0000","last_unstale":"2024-04-22T19:55:35.153608+0000","last_undegraded":"2024-04-22T19:55:35.153608+0000","last_fullsized":"2024-04-22T19:55:35.153608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684727+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:55:34.684727+0000","last_peered":"2024-04-22T19:55:34.684727+0000","last_clean":"2024-04-22T19:55:34.684727+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:55:34.684727+0000","last_undegraded":"2024-04-22T19:55:34.684727+0000","last_fullsized":"2024-04-22T19:55:34.684727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150011+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:55:35.150011+0000","last_peered":"2024-04-22T19:55:35.150011+0000","last_clean":"2024-04-22T19:55:35.150011+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:55:35.150011+0000","last_undegraded":"2024-04-22T19:55:35.150011+0000","last_fullsized":"2024-04-22T19:55:35.150011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684951+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:55:34.684951+0000","last_peered":"2024-04-22T19:55:34.684951+0000","last_clean":"2024-04-22T19:55:34.684951+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:55:34.684951+0000","last_undegraded":"2024-04-22T19:55:34.684951+0000","last_fullsized":"2024-04-22T19:55:34.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692997+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:55:34.692997+0000","last_peered":"2024-04-22T19:55:34.692997+0000","last_clean":"2024-04-22T19:55:34.692997+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:55:34.692997+0000","last_undegraded":"2024-04-22T19:55:34.692997+0000","last_fullsized":"2024-04-22T19:55:34.692997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":79,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686996+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:55:34.686996+0000","last_peered":"2024-04-22T19:55:34.686996+0000","last_clean":"2024-04-22T19:55:34.686996+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:55:34.686996+0000","last_undegraded":"2024-04-22T19:55:34.686996+0000","last_fullsized":"2024-04-22T19:55:34.686996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685020+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:55:34.685020+0000","last_peered":"2024-04-22T19:55:34.685020+0000","last_clean":"2024-04-22T19:55:34.685020+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:55:34.685020+0000","last_undegraded":"2024-04-22T19:55:34.685020+0000","last_fullsized":"2024-04-22T19:55:34.685020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690825+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:55:34.690825+0000","last_peered":"2024-04-22T19:55:34.690825+0000","last_clean":"2024-04-22T19:55:34.690825+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:55:34.690825+0000","last_undegraded":"2024-04-22T19:55:34.690825+0000","last_fullsized":"2024-04-22T19:55:34.690825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686573+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:55:34.686573+0000","last_peered":"2024-04-22T19:55:34.686573+0000","last_clean":"2024-04-22T19:55:34.686573+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:55:34.686573+0000","last_undegraded":"2024-04-22T19:55:34.686573+0000","last_fullsized":"2024-04-22T19:55:34.686573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691448+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:55:34.691448+0000","last_peered":"2024-04-22T19:55:34.691448+0000","last_clean":"2024-04-22T19:55:34.691448+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:55:34.691448+0000","last_undegraded":"2024-04-22T19:55:34.691448+0000","last_fullsized":"2024-04-22T19:55:34.691448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756614+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:55:34.756614+0000","last_peered":"2024-04-22T19:55:34.756614+0000","last_clean":"2024-04-22T19:55:34.756614+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:55:34.756614+0000","last_undegraded":"2024-04-22T19:55:34.756614+0000","last_fullsized":"2024-04-22T19:55:34.756614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691771+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:55:34.691771+0000","last_peered":"2024-04-22T19:55:34.691771+0000","last_clean":"2024-04-22T19:55:34.691771+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:55:34.691771+0000","last_undegraded":"2024-04-22T19:55:34.691771+0000","last_fullsized":"2024-04-22T19:55:34.691771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144796+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:55:35.144796+0000","last_peered":"2024-04-22T19:55:35.144796+0000","last_clean":"2024-04-22T19:55:35.144796+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:55:35.144796+0000","last_undegraded":"2024-04-22T19:55:35.144796+0000","last_fullsized":"2024-04-22T19:55:35.144796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147260+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:55:35.147260+0000","last_peered":"2024-04-22T19:55:35.147260+0000","last_clean":"2024-04-22T19:55:35.147260+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:55:35.147260+0000","last_undegraded":"2024-04-22T19:55:35.147260+0000","last_fullsized":"2024-04-22T19:55:35.147260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148074+0000","last_change":"2024-04-22T19:54:09.327430+0000","last_active":"2024-04-22T19:55:35.148074+0000","last_peered":"2024-04-22T19:55:35.148074+0000","last_clean":"2024-04-22T19:55:35.148074+0000","last_became_active":"2024-04-22T19:54:09.326527+0000","last_became_peered":"2024-04-22T19:54:09.326527+0000","last_unstale":"2024-04-22T19:55:35.148074+0000","last_undegraded":"2024-04-22T19:55:35.148074+0000","last_fullsized":"2024-04-22T19:55:35.148074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688440+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:55:34.688440+0000","last_peered":"2024-04-22T19:55:34.688440+0000","last_clean":"2024-04-22T19:55:34.688440+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:55:34.688440+0000","last_undegraded":"2024-04-22T19:55:34.688440+0000","last_fullsized":"2024-04-22T19:55:34.688440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691123+0000","last_change":"2024-04-22T19:54:09.326400+0000","last_active":"2024-04-22T19:55:34.691123+0000","last_peered":"2024-04-22T19:55:34.691123+0000","last_clean":"2024-04-22T19:55:34.691123+0000","last_became_active":"2024-04-22T19:54:09.326073+0000","last_became_peered":"2024-04-22T19:54:09.326073+0000","last_unstale":"2024-04-22T19:55:34.691123+0000","last_undegraded":"2024-04-22T19:55:34.691123+0000","last_fullsized":"2024-04-22T19:55:34.691123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153328+0000","last_change":"2024-04-22T19:54:11.376169+0000","last_active":"2024-04-22T19:55:35.153328+0000","last_peered":"2024-04-22T19:55:35.153328+0000","last_clean":"2024-04-22T19:55:35.153328+0000","last_became_active":"2024-04-22T19:54:11.367472+0000","last_became_peered":"2024-04-22T19:54:11.367472+0000","last_unstale":"2024-04-22T19:55:35.153328+0000","last_undegraded":"2024-04-22T19:55:35.153328+0000","last_fullsized":"2024-04-22T19:55:35.153328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154438+0000","last_change":"2024-04-22T19:54:09.348783+0000","last_active":"2024-04-22T19:55:35.154438+0000","last_peered":"2024-04-22T19:55:35.154438+0000","last_clean":"2024-04-22T19:55:35.154438+0000","last_became_active":"2024-04-22T19:54:09.348404+0000","last_became_peered":"2024-04-22T19:54:09.348404+0000","last_unstale":"2024-04-22T19:55:35.154438+0000","last_undegraded":"2024-04-22T19:55:35.154438+0000","last_fullsized":"2024-04-22T19:55:35.154438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685831+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:55:34.685831+0000","last_peered":"2024-04-22T19:55:34.685831+0000","last_clean":"2024-04-22T19:55:34.685831+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:55:34.685831+0000","last_undegraded":"2024-04-22T19:55:34.685831+0000","last_fullsized":"2024-04-22T19:55:34.685831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691624+0000","last_change":"2024-04-22T19:54:09.323462+0000","last_active":"2024-04-22T19:55:34.691624+0000","last_peered":"2024-04-22T19:55:34.691624+0000","last_clean":"2024-04-22T19:55:34.691624+0000","last_became_active":"2024-04-22T19:54:09.323039+0000","last_became_peered":"2024-04-22T19:54:09.323039+0000","last_unstale":"2024-04-22T19:55:34.691624+0000","last_undegraded":"2024-04-22T19:55:34.691624+0000","last_fullsized":"2024-04-22T19:55:34.691624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151752+0000","last_change":"2024-04-22T19:54:11.361345+0000","last_active":"2024-04-22T19:55:35.151752+0000","last_peered":"2024-04-22T19:55:35.151752+0000","last_clean":"2024-04-22T19:55:35.151752+0000","last_became_active":"2024-04-22T19:54:11.360452+0000","last_became_peered":"2024-04-22T19:54:11.360452+0000","last_unstale":"2024-04-22T19:55:35.151752+0000","last_undegraded":"2024-04-22T19:55:35.151752+0000","last_fullsized":"2024-04-22T19:55:35.151752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758154+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:55:34.758154+0000","last_peered":"2024-04-22T19:55:34.758154+0000","last_clean":"2024-04-22T19:55:34.758154+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:55:34.758154+0000","last_undegraded":"2024-04-22T19:55:34.758154+0000","last_fullsized":"2024-04-22T19:55:34.758154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756528+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:55:34.756528+0000","last_peered":"2024-04-22T19:55:34.756528+0000","last_clean":"2024-04-22T19:55:34.756528+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:55:34.756528+0000","last_undegraded":"2024-04-22T19:55:34.756528+0000","last_fullsized":"2024-04-22T19:55:34.756528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156781+0000","last_change":"2024-04-22T19:54:09.347666+0000","last_active":"2024-04-22T19:55:35.156781+0000","last_peered":"2024-04-22T19:55:35.156781+0000","last_clean":"2024-04-22T19:55:35.156781+0000","last_became_active":"2024-04-22T19:54:09.347242+0000","last_became_peered":"2024-04-22T19:54:09.347242+0000","last_unstale":"2024-04-22T19:55:35.156781+0000","last_undegraded":"2024-04-22T19:55:35.156781+0000","last_fullsized":"2024-04-22T19:55:35.156781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692920+0000","last_change":"2024-04-22T19:54:48.937383+0000","last_active":"2024-04-22T19:55:34.692920+0000","last_peered":"2024-04-22T19:55:34.692920+0000","last_clean":"2024-04-22T19:55:34.692920+0000","last_became_active":"2024-04-22T19:54:48.936500+0000","last_became_peered":"2024-04-22T19:54:48.936500+0000","last_unstale":"2024-04-22T19:55:34.692920+0000","last_undegraded":"2024-04-22T19:55:34.692920+0000","last_fullsized":"2024-04-22T19:55:34.692920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:44:26.714736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146169+0000","last_change":"2024-04-22T19:54:09.337457+0000","last_active":"2024-04-22T19:55:35.146169+0000","last_peered":"2024-04-22T19:55:35.146169+0000","last_clean":"2024-04-22T19:55:35.146169+0000","last_became_active":"2024-04-22T19:54:09.336663+0000","last_became_peered":"2024-04-22T19:54:09.336663+0000","last_unstale":"2024-04-22T19:55:35.146169+0000","last_undegraded":"2024-04-22T19:55:35.146169+0000","last_fullsized":"2024-04-22T19:55:35.146169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687198+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:55:34.687198+0000","last_peered":"2024-04-22T19:55:34.687198+0000","last_clean":"2024-04-22T19:55:34.687198+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:55:34.687198+0000","last_undegraded":"2024-04-22T19:55:34.687198+0000","last_fullsized":"2024-04-22T19:55:34.687198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.152005+0000","last_change":"2024-04-22T19:54:09.347792+0000","last_active":"2024-04-22T19:55:35.152005+0000","last_peered":"2024-04-22T19:55:35.152005+0000","last_clean":"2024-04-22T19:55:35.152005+0000","last_became_active":"2024-04-22T19:54:09.347359+0000","last_became_peered":"2024-04-22T19:54:09.347359+0000","last_unstale":"2024-04-22T19:55:35.152005+0000","last_undegraded":"2024-04-22T19:55:35.152005+0000","last_fullsized":"2024-04-22T19:55:35.152005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147105+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:55:35.147105+0000","last_peered":"2024-04-22T19:55:35.147105+0000","last_clean":"2024-04-22T19:55:35.147105+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:55:35.147105+0000","last_undegraded":"2024-04-22T19:55:35.147105+0000","last_fullsized":"2024-04-22T19:55:35.147105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147971+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:55:35.147971+0000","last_peered":"2024-04-22T19:55:35.147971+0000","last_clean":"2024-04-22T19:55:35.147971+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:55:35.147971+0000","last_undegraded":"2024-04-22T19:55:35.147971+0000","last_fullsized":"2024-04-22T19:55:35.147971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686313+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:55:34.686313+0000","last_peered":"2024-04-22T19:55:34.686313+0000","last_clean":"2024-04-22T19:55:34.686313+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:55:34.686313+0000","last_undegraded":"2024-04-22T19:55:34.686313+0000","last_fullsized":"2024-04-22T19:55:34.686313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691269+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:55:34.691269+0000","last_peered":"2024-04-22T19:55:34.691269+0000","last_clean":"2024-04-22T19:55:34.691269+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:55:34.691269+0000","last_undegraded":"2024-04-22T19:55:34.691269+0000","last_fullsized":"2024-04-22T19:55:34.691269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148781+0000","last_change":"2024-04-22T19:54:11.386080+0000","last_active":"2024-04-22T19:55:35.148781+0000","last_peered":"2024-04-22T19:55:35.148781+0000","last_clean":"2024-04-22T19:55:35.148781+0000","last_became_active":"2024-04-22T19:54:11.385436+0000","last_became_peered":"2024-04-22T19:54:11.385436+0000","last_unstale":"2024-04-22T19:55:35.148781+0000","last_undegraded":"2024-04-22T19:55:35.148781+0000","last_fullsized":"2024-04-22T19:55:35.148781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757856+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:55:34.757856+0000","last_peered":"2024-04-22T19:55:34.757856+0000","last_clean":"2024-04-22T19:55:34.757856+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:55:34.757856+0000","last_undegraded":"2024-04-22T19:55:34.757856+0000","last_fullsized":"2024-04-22T19:55:34.757856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688415+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:55:34.688415+0000","last_peered":"2024-04-22T19:55:34.688415+0000","last_clean":"2024-04-22T19:55:34.688415+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:55:34.688415+0000","last_undegraded":"2024-04-22T19:55:34.688415+0000","last_fullsized":"2024-04-22T19:55:34.688415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150867+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:55:35.150867+0000","last_peered":"2024-04-22T19:55:35.150867+0000","last_clean":"2024-04-22T19:55:35.150867+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:55:35.150867+0000","last_undegraded":"2024-04-22T19:55:35.150867+0000","last_fullsized":"2024-04-22T19:55:35.150867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151678+0000","last_change":"2024-04-22T19:54:11.347140+0000","last_active":"2024-04-22T19:55:35.151678+0000","last_peered":"2024-04-22T19:55:35.151678+0000","last_clean":"2024-04-22T19:55:35.151678+0000","last_became_active":"2024-04-22T19:54:11.345540+0000","last_became_peered":"2024-04-22T19:54:11.345540+0000","last_unstale":"2024-04-22T19:55:35.151678+0000","last_undegraded":"2024-04-22T19:55:35.151678+0000","last_fullsized":"2024-04-22T19:55:35.151678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144882+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:55:35.144882+0000","last_peered":"2024-04-22T19:55:35.144882+0000","last_clean":"2024-04-22T19:55:35.144882+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:55:35.144882+0000","last_undegraded":"2024-04-22T19:55:35.144882+0000","last_fullsized":"2024-04-22T19:55:35.144882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145746+0000","last_change":"2024-04-22T19:54:11.384243+0000","last_active":"2024-04-22T19:55:35.145746+0000","last_peered":"2024-04-22T19:55:35.145746+0000","last_clean":"2024-04-22T19:55:35.145746+0000","last_became_active":"2024-04-22T19:54:11.383676+0000","last_became_peered":"2024-04-22T19:54:11.383676+0000","last_unstale":"2024-04-22T19:55:35.145746+0000","last_undegraded":"2024-04-22T19:55:35.145746+0000","last_fullsized":"2024-04-22T19:55:35.145746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147050+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:55:35.147050+0000","last_peered":"2024-04-22T19:55:35.147050+0000","last_clean":"2024-04-22T19:55:35.147050+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:55:35.147050+0000","last_undegraded":"2024-04-22T19:55:35.147050+0000","last_fullsized":"2024-04-22T19:55:35.147050+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145981+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:55:35.145981+0000","last_peered":"2024-04-22T19:55:35.145981+0000","last_clean":"2024-04-22T19:55:35.145981+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:55:35.145981+0000","last_undegraded":"2024-04-22T19:55:35.145981+0000","last_fullsized":"2024-04-22T19:55:35.145981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692846+0000","last_change":"2024-04-22T19:54:11.341482+0000","last_active":"2024-04-22T19:55:34.692846+0000","last_peered":"2024-04-22T19:55:34.692846+0000","last_clean":"2024-04-22T19:55:34.692846+0000","last_became_active":"2024-04-22T19:54:11.341075+0000","last_became_peered":"2024-04-22T19:54:11.341075+0000","last_unstale":"2024-04-22T19:55:34.692846+0000","last_undegraded":"2024-04-22T19:55:34.692846+0000","last_fullsized":"2024-04-22T19:55:34.692846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687307+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:55:34.687307+0000","last_peered":"2024-04-22T19:55:34.687307+0000","last_clean":"2024-04-22T19:55:34.687307+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:55:34.687307+0000","last_undegraded":"2024-04-22T19:55:34.687307+0000","last_fullsized":"2024-04-22T19:55:34.687307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147973+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:55:35.147973+0000","last_peered":"2024-04-22T19:55:35.147973+0000","last_clean":"2024-04-22T19:55:35.147973+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:55:35.147973+0000","last_undegraded":"2024-04-22T19:55:35.147973+0000","last_fullsized":"2024-04-22T19:55:35.147973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1335296,"data_stored":960042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":360762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":370399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":368076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":361594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":369133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":368828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":959012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:55:38.377 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:55:38.377 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:38.363+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:38.378 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:38.471 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:38.471+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:38.563 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:38.563+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.244202552999994, 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:38.593 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:38.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.205328061000003, 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:38.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.200250750999999, 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:38.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:38.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:38.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.199592512999999, 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.192815546000006, 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.610 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:38.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:38.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.098137050999995, 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.614 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:38.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:38.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.619 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.213654563000006, 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:38.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.194495630999995, 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.168386346000005, 2024-04-22T19:55:38.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.149666119000003, 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.641 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.116447590000007, 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:38.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:38.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.088405554999994, 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.648 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:38.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:38.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.072896903, 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:38.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.659 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.062547113999997, 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:38.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.028972289999999, 2024-04-22T19:55:38.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:38.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.737756168000004, 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.675 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.651008386000001, 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:38.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:38.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.589992393000003, 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.436301713999995, 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:38.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.370165365000005, 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:38.693 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:38.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:38.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:38.699 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:38.700 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:38.701 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:38.695+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:38.743 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:55:38.801 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:38.799+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:38.902 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:38.899+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:38.916 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:38.917 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:38.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:38.952 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:55:38.960 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:55:38.980 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-04-22T19:55:38.738157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231300,"kb_used_data":6800,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743420,"statfs":{"total":773094113280,"available":772857262080,"internally_reserved":0,"allocated":6963200,"data_stored":4117846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149808+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:55:35.149808+0000","last_peered":"2024-04-22T19:55:35.149808+0000","last_clean":"2024-04-22T19:55:35.149808+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:55:35.149808+0000","last_undegraded":"2024-04-22T19:55:35.149808+0000","last_fullsized":"2024-04-22T19:55:35.149808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145464+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:55:35.145464+0000","last_peered":"2024-04-22T19:55:35.145464+0000","last_clean":"2024-04-22T19:55:35.145464+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:55:35.145464+0000","last_undegraded":"2024-04-22T19:55:35.145464+0000","last_fullsized":"2024-04-22T19:55:35.145464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691846+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:55:34.691846+0000","last_peered":"2024-04-22T19:55:34.691846+0000","last_clean":"2024-04-22T19:55:34.691846+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:55:34.691846+0000","last_undegraded":"2024-04-22T19:55:34.691846+0000","last_fullsized":"2024-04-22T19:55:34.691846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146503+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:55:35.146503+0000","last_peered":"2024-04-22T19:55:35.146503+0000","last_clean":"2024-04-22T19:55:35.146503+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:55:35.146503+0000","last_undegraded":"2024-04-22T19:55:35.146503+0000","last_fullsized":"2024-04-22T19:55:35.146503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690624+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:55:34.690624+0000","last_peered":"2024-04-22T19:55:34.690624+0000","last_clean":"2024-04-22T19:55:34.690624+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:55:34.690624+0000","last_undegraded":"2024-04-22T19:55:34.690624+0000","last_fullsized":"2024-04-22T19:55:34.690624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685306+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:55:34.685306+0000","last_peered":"2024-04-22T19:55:34.685306+0000","last_clean":"2024-04-22T19:55:34.685306+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:55:34.685306+0000","last_undegraded":"2024-04-22T19:55:34.685306+0000","last_fullsized":"2024-04-22T19:55:34.685306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149586+0000","last_change":"2024-04-22T19:54:09.335968+0000","last_active":"2024-04-22T19:55:35.149586+0000","last_peered":"2024-04-22T19:55:35.149586+0000","last_clean":"2024-04-22T19:55:35.149586+0000","last_became_active":"2024-04-22T19:54:09.335354+0000","last_became_peered":"2024-04-22T19:54:09.335354+0000","last_unstale":"2024-04-22T19:55:35.149586+0000","last_undegraded":"2024-04-22T19:55:35.149586+0000","last_fullsized":"2024-04-22T19:55:35.149586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691049+0000","last_change":"2024-04-22T19:54:11.352164+0000","last_active":"2024-04-22T19:55:34.691049+0000","last_peered":"2024-04-22T19:55:34.691049+0000","last_clean":"2024-04-22T19:55:34.691049+0000","last_became_active":"2024-04-22T19:54:11.351808+0000","last_became_peered":"2024-04-22T19:54:11.351808+0000","last_unstale":"2024-04-22T19:55:34.691049+0000","last_undegraded":"2024-04-22T19:55:34.691049+0000","last_fullsized":"2024-04-22T19:55:34.691049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149279+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:55:35.149279+0000","last_peered":"2024-04-22T19:55:35.149279+0000","last_clean":"2024-04-22T19:55:35.149279+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:55:35.149279+0000","last_undegraded":"2024-04-22T19:55:35.149279+0000","last_fullsized":"2024-04-22T19:55:35.149279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757585+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:55:34.757585+0000","last_peered":"2024-04-22T19:55:34.757585+0000","last_clean":"2024-04-22T19:55:34.757585+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:55:34.757585+0000","last_undegraded":"2024-04-22T19:55:34.757585+0000","last_fullsized":"2024-04-22T19:55:34.757585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147330+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:55:35.147330+0000","last_peered":"2024-04-22T19:55:35.147330+0000","last_clean":"2024-04-22T19:55:35.147330+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:55:35.147330+0000","last_undegraded":"2024-04-22T19:55:35.147330+0000","last_fullsized":"2024-04-22T19:55:35.147330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686543+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:55:34.686543+0000","last_peered":"2024-04-22T19:55:34.686543+0000","last_clean":"2024-04-22T19:55:34.686543+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:55:34.686543+0000","last_undegraded":"2024-04-22T19:55:34.686543+0000","last_fullsized":"2024-04-22T19:55:34.686543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146964+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:55:35.146964+0000","last_peered":"2024-04-22T19:55:35.146964+0000","last_clean":"2024-04-22T19:55:35.146964+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:55:35.146964+0000","last_undegraded":"2024-04-22T19:55:35.146964+0000","last_fullsized":"2024-04-22T19:55:35.146964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147518+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:55:35.147518+0000","last_peered":"2024-04-22T19:55:35.147518+0000","last_clean":"2024-04-22T19:55:35.147518+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:55:35.147518+0000","last_undegraded":"2024-04-22T19:55:35.147518+0000","last_fullsized":"2024-04-22T19:55:35.147518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144240+0000","last_change":"2024-04-22T19:54:48.937027+0000","last_active":"2024-04-22T19:55:35.144240+0000","last_peered":"2024-04-22T19:55:35.144240+0000","last_clean":"2024-04-22T19:55:35.144240+0000","last_became_active":"2024-04-22T19:54:48.936273+0000","last_became_peered":"2024-04-22T19:54:48.936273+0000","last_unstale":"2024-04-22T19:55:35.144240+0000","last_undegraded":"2024-04-22T19:55:35.144240+0000","last_fullsized":"2024-04-22T19:55:35.144240+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:15.579075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148178+0000","last_change":"2024-04-22T19:54:11.366719+0000","last_active":"2024-04-22T19:55:35.148178+0000","last_peered":"2024-04-22T19:55:35.148178+0000","last_clean":"2024-04-22T19:55:35.148178+0000","last_became_active":"2024-04-22T19:54:11.366430+0000","last_became_peered":"2024-04-22T19:54:11.366430+0000","last_unstale":"2024-04-22T19:55:35.148178+0000","last_undegraded":"2024-04-22T19:55:35.148178+0000","last_fullsized":"2024-04-22T19:55:35.148178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:20.853206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684835+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:55:34.684835+0000","last_peered":"2024-04-22T19:55:34.684835+0000","last_clean":"2024-04-22T19:55:34.684835+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:55:34.684835+0000","last_undegraded":"2024-04-22T19:55:34.684835+0000","last_fullsized":"2024-04-22T19:55:34.684835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147178+0000","last_change":"2024-04-22T19:54:48.940408+0000","last_active":"2024-04-22T19:55:35.147178+0000","last_peered":"2024-04-22T19:55:35.147178+0000","last_clean":"2024-04-22T19:55:35.147178+0000","last_became_active":"2024-04-22T19:54:48.938505+0000","last_became_peered":"2024-04-22T19:54:48.938505+0000","last_unstale":"2024-04-22T19:55:35.147178+0000","last_undegraded":"2024-04-22T19:55:35.147178+0000","last_fullsized":"2024-04-22T19:55:35.147178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:33.852890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146716+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:55:35.146716+0000","last_peered":"2024-04-22T19:55:35.146716+0000","last_clean":"2024-04-22T19:55:35.146716+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:55:35.146716+0000","last_undegraded":"2024-04-22T19:55:35.146716+0000","last_fullsized":"2024-04-22T19:55:35.146716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757949+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:55:34.757949+0000","last_peered":"2024-04-22T19:55:34.757949+0000","last_clean":"2024-04-22T19:55:34.757949+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:55:34.757949+0000","last_undegraded":"2024-04-22T19:55:34.757949+0000","last_fullsized":"2024-04-22T19:55:34.757949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147729+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:55:35.147729+0000","last_peered":"2024-04-22T19:55:35.147729+0000","last_clean":"2024-04-22T19:55:35.147729+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:55:35.147729+0000","last_undegraded":"2024-04-22T19:55:35.147729+0000","last_fullsized":"2024-04-22T19:55:35.147729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758413+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:55:34.758413+0000","last_peered":"2024-04-22T19:55:34.758413+0000","last_clean":"2024-04-22T19:55:34.758413+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:55:34.758413+0000","last_undegraded":"2024-04-22T19:55:34.758413+0000","last_fullsized":"2024-04-22T19:55:34.758413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145445+0000","last_change":"2024-04-22T19:54:11.366667+0000","last_active":"2024-04-22T19:55:35.145445+0000","last_peered":"2024-04-22T19:55:35.145445+0000","last_clean":"2024-04-22T19:55:35.145445+0000","last_became_active":"2024-04-22T19:54:11.366362+0000","last_became_peered":"2024-04-22T19:54:11.366362+0000","last_unstale":"2024-04-22T19:55:35.145445+0000","last_undegraded":"2024-04-22T19:55:35.145445+0000","last_fullsized":"2024-04-22T19:55:35.145445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:55.770295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685739+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:55:34.685739+0000","last_peered":"2024-04-22T19:55:34.685739+0000","last_clean":"2024-04-22T19:55:34.685739+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:55:34.685739+0000","last_undegraded":"2024-04-22T19:55:34.685739+0000","last_fullsized":"2024-04-22T19:55:34.685739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147765+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:55:35.147765+0000","last_peered":"2024-04-22T19:55:35.147765+0000","last_clean":"2024-04-22T19:55:35.147765+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:55:35.147765+0000","last_undegraded":"2024-04-22T19:55:35.147765+0000","last_fullsized":"2024-04-22T19:55:35.147765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153061+0000","last_change":"2024-04-22T19:54:09.323744+0000","last_active":"2024-04-22T19:55:35.153061+0000","last_peered":"2024-04-22T19:55:35.153061+0000","last_clean":"2024-04-22T19:55:35.153061+0000","last_became_active":"2024-04-22T19:54:09.323397+0000","last_became_peered":"2024-04-22T19:54:09.323397+0000","last_unstale":"2024-04-22T19:55:35.153061+0000","last_undegraded":"2024-04-22T19:55:35.153061+0000","last_fullsized":"2024-04-22T19:55:35.153061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686759+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:55:34.686759+0000","last_peered":"2024-04-22T19:55:34.686759+0000","last_clean":"2024-04-22T19:55:34.686759+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:55:34.686759+0000","last_undegraded":"2024-04-22T19:55:34.686759+0000","last_fullsized":"2024-04-22T19:55:34.686759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688706+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:55:34.688706+0000","last_peered":"2024-04-22T19:55:34.688706+0000","last_clean":"2024-04-22T19:55:34.688706+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:55:34.688706+0000","last_undegraded":"2024-04-22T19:55:34.688706+0000","last_fullsized":"2024-04-22T19:55:34.688706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684288+0000","last_change":"2024-04-22T19:54:19.384172+0000","last_active":"2024-04-22T19:55:34.684288+0000","last_peered":"2024-04-22T19:55:34.684288+0000","last_clean":"2024-04-22T19:55:34.684288+0000","last_became_active":"2024-04-22T19:54:19.383327+0000","last_became_peered":"2024-04-22T19:54:19.383327+0000","last_unstale":"2024-04-22T19:55:34.684288+0000","last_undegraded":"2024-04-22T19:55:34.684288+0000","last_fullsized":"2024-04-22T19:55:34.684288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154241+0000","last_change":"2024-04-22T19:54:11.367608+0000","last_active":"2024-04-22T19:55:35.154241+0000","last_peered":"2024-04-22T19:55:35.154241+0000","last_clean":"2024-04-22T19:55:35.154241+0000","last_became_active":"2024-04-22T19:54:11.366912+0000","last_became_peered":"2024-04-22T19:54:11.366912+0000","last_unstale":"2024-04-22T19:55:35.154241+0000","last_undegraded":"2024-04-22T19:55:35.154241+0000","last_fullsized":"2024-04-22T19:55:35.154241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149489+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:55:35.149489+0000","last_peered":"2024-04-22T19:55:35.149489+0000","last_clean":"2024-04-22T19:55:35.149489+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:55:35.149489+0000","last_undegraded":"2024-04-22T19:55:35.149489+0000","last_fullsized":"2024-04-22T19:55:35.149489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147202+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:55:35.147202+0000","last_peered":"2024-04-22T19:55:35.147202+0000","last_clean":"2024-04-22T19:55:35.147202+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:55:35.147202+0000","last_undegraded":"2024-04-22T19:55:35.147202+0000","last_fullsized":"2024-04-22T19:55:35.147202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691899+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:55:34.691899+0000","last_peered":"2024-04-22T19:55:34.691899+0000","last_clean":"2024-04-22T19:55:34.691899+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:55:34.691899+0000","last_undegraded":"2024-04-22T19:55:34.691899+0000","last_fullsized":"2024-04-22T19:55:34.691899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149201+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:55:35.149201+0000","last_peered":"2024-04-22T19:55:35.149201+0000","last_clean":"2024-04-22T19:55:35.149201+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:55:35.149201+0000","last_undegraded":"2024-04-22T19:55:35.149201+0000","last_fullsized":"2024-04-22T19:55:35.149201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145513+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:55:35.145513+0000","last_peered":"2024-04-22T19:55:35.145513+0000","last_clean":"2024-04-22T19:55:35.145513+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:55:35.145513+0000","last_undegraded":"2024-04-22T19:55:35.145513+0000","last_fullsized":"2024-04-22T19:55:35.145513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147696+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:55:35.147696+0000","last_peered":"2024-04-22T19:55:35.147696+0000","last_clean":"2024-04-22T19:55:35.147696+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:55:35.147696+0000","last_undegraded":"2024-04-22T19:55:35.147696+0000","last_fullsized":"2024-04-22T19:55:35.147696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.695204+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:55:34.695204+0000","last_peered":"2024-04-22T19:55:34.695204+0000","last_clean":"2024-04-22T19:55:34.695204+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:55:34.695204+0000","last_undegraded":"2024-04-22T19:55:34.695204+0000","last_fullsized":"2024-04-22T19:55:34.695204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":79,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154078+0000","last_change":"2024-04-22T19:54:13.358928+0000","last_active":"2024-04-22T19:55:35.154078+0000","last_peered":"2024-04-22T19:55:35.154078+0000","last_clean":"2024-04-22T19:55:35.154078+0000","last_became_active":"2024-04-22T19:54:13.358215+0000","last_became_peered":"2024-04-22T19:54:13.358215+0000","last_unstale":"2024-04-22T19:55:35.154078+0000","last_undegraded":"2024-04-22T19:55:35.154078+0000","last_fullsized":"2024-04-22T19:55:35.154078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686822+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:55:34.686822+0000","last_peered":"2024-04-22T19:55:34.686822+0000","last_clean":"2024-04-22T19:55:34.686822+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:55:34.686822+0000","last_undegraded":"2024-04-22T19:55:34.686822+0000","last_fullsized":"2024-04-22T19:55:34.686822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686961+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:55:34.686961+0000","last_peered":"2024-04-22T19:55:34.686961+0000","last_clean":"2024-04-22T19:55:34.686961+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:55:34.686961+0000","last_undegraded":"2024-04-22T19:55:34.686961+0000","last_fullsized":"2024-04-22T19:55:34.686961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688489+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:55:34.688489+0000","last_peered":"2024-04-22T19:55:34.688489+0000","last_clean":"2024-04-22T19:55:34.688489+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:55:34.688489+0000","last_undegraded":"2024-04-22T19:55:34.688489+0000","last_fullsized":"2024-04-22T19:55:34.688489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692428+0000","last_change":"2024-04-22T19:54:11.344326+0000","last_active":"2024-04-22T19:55:34.692428+0000","last_peered":"2024-04-22T19:55:34.692428+0000","last_clean":"2024-04-22T19:55:34.692428+0000","last_became_active":"2024-04-22T19:54:11.343967+0000","last_became_peered":"2024-04-22T19:54:11.343967+0000","last_unstale":"2024-04-22T19:55:34.692428+0000","last_undegraded":"2024-04-22T19:55:34.692428+0000","last_fullsized":"2024-04-22T19:55:34.692428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147198+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:55:35.147198+0000","last_peered":"2024-04-22T19:55:35.147198+0000","last_clean":"2024-04-22T19:55:35.147198+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:55:35.147198+0000","last_undegraded":"2024-04-22T19:55:35.147198+0000","last_fullsized":"2024-04-22T19:55:35.147198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156972+0000","last_change":"2024-04-22T19:54:13.353567+0000","last_active":"2024-04-22T19:55:35.156972+0000","last_peered":"2024-04-22T19:55:35.156972+0000","last_clean":"2024-04-22T19:55:35.156972+0000","last_became_active":"2024-04-22T19:54:13.353104+0000","last_became_peered":"2024-04-22T19:54:13.353104+0000","last_unstale":"2024-04-22T19:55:35.156972+0000","last_undegraded":"2024-04-22T19:55:35.156972+0000","last_fullsized":"2024-04-22T19:55:35.156972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147592+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:55:35.147592+0000","last_peered":"2024-04-22T19:55:35.147592+0000","last_clean":"2024-04-22T19:55:35.147592+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:55:35.147592+0000","last_undegraded":"2024-04-22T19:55:35.147592+0000","last_fullsized":"2024-04-22T19:55:35.147592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149043+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:55:35.149043+0000","last_peered":"2024-04-22T19:55:35.149043+0000","last_clean":"2024-04-22T19:55:35.149043+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:55:35.149043+0000","last_undegraded":"2024-04-22T19:55:35.149043+0000","last_fullsized":"2024-04-22T19:55:35.149043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684952+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:55:34.684952+0000","last_peered":"2024-04-22T19:55:34.684952+0000","last_clean":"2024-04-22T19:55:34.684952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:55:34.684952+0000","last_undegraded":"2024-04-22T19:55:34.684952+0000","last_fullsized":"2024-04-22T19:55:34.684952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156570+0000","last_change":"2024-04-22T19:54:11.367430+0000","last_active":"2024-04-22T19:55:35.156570+0000","last_peered":"2024-04-22T19:55:35.156570+0000","last_clean":"2024-04-22T19:55:35.156570+0000","last_became_active":"2024-04-22T19:54:11.367019+0000","last_became_peered":"2024-04-22T19:54:11.367019+0000","last_unstale":"2024-04-22T19:55:35.156570+0000","last_undegraded":"2024-04-22T19:55:35.156570+0000","last_fullsized":"2024-04-22T19:55:35.156570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756819+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:55:34.756819+0000","last_peered":"2024-04-22T19:55:34.756819+0000","last_clean":"2024-04-22T19:55:34.756819+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:55:34.756819+0000","last_undegraded":"2024-04-22T19:55:34.756819+0000","last_fullsized":"2024-04-22T19:55:34.756819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146766+0000","last_change":"2024-04-22T19:54:13.373018+0000","last_active":"2024-04-22T19:55:35.146766+0000","last_peered":"2024-04-22T19:55:35.146766+0000","last_clean":"2024-04-22T19:55:35.146766+0000","last_became_active":"2024-04-22T19:54:13.372322+0000","last_became_peered":"2024-04-22T19:54:13.372322+0000","last_unstale":"2024-04-22T19:55:35.146766+0000","last_undegraded":"2024-04-22T19:55:35.146766+0000","last_fullsized":"2024-04-22T19:55:35.146766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149760+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:55:35.149760+0000","last_peered":"2024-04-22T19:55:35.149760+0000","last_clean":"2024-04-22T19:55:35.149760+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:55:35.149760+0000","last_undegraded":"2024-04-22T19:55:35.149760+0000","last_fullsized":"2024-04-22T19:55:35.149760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153865+0000","last_change":"2024-04-22T19:54:17.386681+0000","last_active":"2024-04-22T19:55:35.153865+0000","last_peered":"2024-04-22T19:55:35.153865+0000","last_clean":"2024-04-22T19:55:35.153865+0000","last_became_active":"2024-04-22T19:54:17.385957+0000","last_became_peered":"2024-04-22T19:54:17.385957+0000","last_unstale":"2024-04-22T19:55:35.153865+0000","last_undegraded":"2024-04-22T19:55:35.153865+0000","last_fullsized":"2024-04-22T19:55:35.153865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:20.429084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145934+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:55:35.145934+0000","last_peered":"2024-04-22T19:55:35.145934+0000","last_clean":"2024-04-22T19:55:35.145934+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:55:35.145934+0000","last_undegraded":"2024-04-22T19:55:35.145934+0000","last_fullsized":"2024-04-22T19:55:35.145934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149688+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:55:35.149688+0000","last_peered":"2024-04-22T19:55:35.149688+0000","last_clean":"2024-04-22T19:55:35.149688+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:55:35.149688+0000","last_undegraded":"2024-04-22T19:55:35.149688+0000","last_fullsized":"2024-04-22T19:55:35.149688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145943+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:55:35.145943+0000","last_peered":"2024-04-22T19:55:35.145943+0000","last_clean":"2024-04-22T19:55:35.145943+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:55:35.145943+0000","last_undegraded":"2024-04-22T19:55:35.145943+0000","last_fullsized":"2024-04-22T19:55:35.145943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145516+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:55:35.145516+0000","last_peered":"2024-04-22T19:55:35.145516+0000","last_clean":"2024-04-22T19:55:35.145516+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:55:35.145516+0000","last_undegraded":"2024-04-22T19:55:35.145516+0000","last_fullsized":"2024-04-22T19:55:35.145516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687928+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:55:34.687928+0000","last_peered":"2024-04-22T19:55:34.687928+0000","last_clean":"2024-04-22T19:55:34.687928+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:55:34.687928+0000","last_undegraded":"2024-04-22T19:55:34.687928+0000","last_fullsized":"2024-04-22T19:55:34.687928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146506+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:55:35.146506+0000","last_peered":"2024-04-22T19:55:35.146506+0000","last_clean":"2024-04-22T19:55:35.146506+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:55:35.146506+0000","last_undegraded":"2024-04-22T19:55:35.146506+0000","last_fullsized":"2024-04-22T19:55:35.146506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684833+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:55:34.684833+0000","last_peered":"2024-04-22T19:55:34.684833+0000","last_clean":"2024-04-22T19:55:34.684833+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:55:34.684833+0000","last_undegraded":"2024-04-22T19:55:34.684833+0000","last_fullsized":"2024-04-22T19:55:34.684833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149401+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:55:35.149401+0000","last_peered":"2024-04-22T19:55:35.149401+0000","last_clean":"2024-04-22T19:55:35.149401+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:55:35.149401+0000","last_undegraded":"2024-04-22T19:55:35.149401+0000","last_fullsized":"2024-04-22T19:55:35.149401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144481+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:55:35.144481+0000","last_peered":"2024-04-22T19:55:35.144481+0000","last_clean":"2024-04-22T19:55:35.144481+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:55:35.144481+0000","last_undegraded":"2024-04-22T19:55:35.144481+0000","last_fullsized":"2024-04-22T19:55:35.144481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153402+0000","last_change":"2024-04-22T19:54:15.368608+0000","last_active":"2024-04-22T19:55:35.153402+0000","last_peered":"2024-04-22T19:55:35.153402+0000","last_clean":"2024-04-22T19:55:35.153402+0000","last_became_active":"2024-04-22T19:54:15.367821+0000","last_became_peered":"2024-04-22T19:54:15.367821+0000","last_unstale":"2024-04-22T19:55:35.153402+0000","last_undegraded":"2024-04-22T19:55:35.153402+0000","last_fullsized":"2024-04-22T19:55:35.153402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151277+0000","last_change":"2024-04-22T19:54:17.387097+0000","last_active":"2024-04-22T19:55:35.151277+0000","last_peered":"2024-04-22T19:55:35.151277+0000","last_clean":"2024-04-22T19:55:35.151277+0000","last_became_active":"2024-04-22T19:54:17.386193+0000","last_became_peered":"2024-04-22T19:54:17.386193+0000","last_unstale":"2024-04-22T19:55:35.151277+0000","last_undegraded":"2024-04-22T19:55:35.151277+0000","last_fullsized":"2024-04-22T19:55:35.151277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:39.707399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757438+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:55:34.757438+0000","last_peered":"2024-04-22T19:55:34.757438+0000","last_clean":"2024-04-22T19:55:34.757438+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:55:34.757438+0000","last_undegraded":"2024-04-22T19:55:34.757438+0000","last_fullsized":"2024-04-22T19:55:34.757438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757521+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:55:34.757521+0000","last_peered":"2024-04-22T19:55:34.757521+0000","last_clean":"2024-04-22T19:55:34.757521+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:55:34.757521+0000","last_undegraded":"2024-04-22T19:55:34.757521+0000","last_fullsized":"2024-04-22T19:55:34.757521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150645+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:55:35.150645+0000","last_peered":"2024-04-22T19:55:35.150645+0000","last_clean":"2024-04-22T19:55:35.150645+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:55:35.150645+0000","last_undegraded":"2024-04-22T19:55:35.150645+0000","last_fullsized":"2024-04-22T19:55:35.150645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145659+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:55:35.145659+0000","last_peered":"2024-04-22T19:55:35.145659+0000","last_clean":"2024-04-22T19:55:35.145659+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:55:35.145659+0000","last_undegraded":"2024-04-22T19:55:35.145659+0000","last_fullsized":"2024-04-22T19:55:35.145659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145989+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:55:35.145989+0000","last_peered":"2024-04-22T19:55:35.145989+0000","last_clean":"2024-04-22T19:55:35.145989+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:55:35.145989+0000","last_undegraded":"2024-04-22T19:55:35.145989+0000","last_fullsized":"2024-04-22T19:55:35.145989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687911+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:55:34.687911+0000","last_peered":"2024-04-22T19:55:34.687911+0000","last_clean":"2024-04-22T19:55:34.687911+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:55:34.687911+0000","last_undegraded":"2024-04-22T19:55:34.687911+0000","last_fullsized":"2024-04-22T19:55:34.687911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691979+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:55:34.691979+0000","last_peered":"2024-04-22T19:55:34.691979+0000","last_clean":"2024-04-22T19:55:34.691979+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:55:34.691979+0000","last_undegraded":"2024-04-22T19:55:34.691979+0000","last_fullsized":"2024-04-22T19:55:34.691979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691597+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:55:34.691597+0000","last_peered":"2024-04-22T19:55:34.691597+0000","last_clean":"2024-04-22T19:55:34.691597+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:55:34.691597+0000","last_undegraded":"2024-04-22T19:55:34.691597+0000","last_fullsized":"2024-04-22T19:55:34.691597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150234+0000","last_change":"2024-04-22T19:54:09.334166+0000","last_active":"2024-04-22T19:55:35.150234+0000","last_peered":"2024-04-22T19:55:35.150234+0000","last_clean":"2024-04-22T19:55:35.150234+0000","last_became_active":"2024-04-22T19:54:09.333460+0000","last_became_peered":"2024-04-22T19:54:09.333460+0000","last_unstale":"2024-04-22T19:55:35.150234+0000","last_undegraded":"2024-04-22T19:55:35.150234+0000","last_fullsized":"2024-04-22T19:55:35.150234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:49.534755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145223+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:55:35.145223+0000","last_peered":"2024-04-22T19:55:35.145223+0000","last_clean":"2024-04-22T19:55:35.145223+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:55:35.145223+0000","last_undegraded":"2024-04-22T19:55:35.145223+0000","last_fullsized":"2024-04-22T19:55:35.145223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688158+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:55:34.688158+0000","last_peered":"2024-04-22T19:55:34.688158+0000","last_clean":"2024-04-22T19:55:34.688158+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:55:34.688158+0000","last_undegraded":"2024-04-22T19:55:34.688158+0000","last_fullsized":"2024-04-22T19:55:34.688158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144347+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:55:35.144347+0000","last_peered":"2024-04-22T19:55:35.144347+0000","last_clean":"2024-04-22T19:55:35.144347+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:55:35.144347+0000","last_undegraded":"2024-04-22T19:55:35.144347+0000","last_fullsized":"2024-04-22T19:55:35.144347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691263+0000","last_change":"2024-04-22T19:54:19.378028+0000","last_active":"2024-04-22T19:55:34.691263+0000","last_peered":"2024-04-22T19:55:34.691263+0000","last_clean":"2024-04-22T19:55:34.691263+0000","last_became_active":"2024-04-22T19:54:19.377273+0000","last_became_peered":"2024-04-22T19:54:19.377273+0000","last_unstale":"2024-04-22T19:55:34.691263+0000","last_undegraded":"2024-04-22T19:55:34.691263+0000","last_fullsized":"2024-04-22T19:55:34.691263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:00.036846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686133+0000","last_change":"2024-04-22T19:54:11.349479+0000","last_active":"2024-04-22T19:55:34.686133+0000","last_peered":"2024-04-22T19:55:34.686133+0000","last_clean":"2024-04-22T19:55:34.686133+0000","last_became_active":"2024-04-22T19:54:11.347357+0000","last_became_peered":"2024-04-22T19:54:11.347357+0000","last_unstale":"2024-04-22T19:55:34.686133+0000","last_undegraded":"2024-04-22T19:55:34.686133+0000","last_fullsized":"2024-04-22T19:55:34.686133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151378+0000","last_change":"2024-04-22T19:54:09.326454+0000","last_active":"2024-04-22T19:55:35.151378+0000","last_peered":"2024-04-22T19:55:35.151378+0000","last_clean":"2024-04-22T19:55:35.151378+0000","last_became_active":"2024-04-22T19:54:09.326120+0000","last_became_peered":"2024-04-22T19:54:09.326120+0000","last_unstale":"2024-04-22T19:55:35.151378+0000","last_undegraded":"2024-04-22T19:55:35.151378+0000","last_fullsized":"2024-04-22T19:55:35.151378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144240+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:55:35.144240+0000","last_peered":"2024-04-22T19:55:35.144240+0000","last_clean":"2024-04-22T19:55:35.144240+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:55:35.144240+0000","last_undegraded":"2024-04-22T19:55:35.144240+0000","last_fullsized":"2024-04-22T19:55:35.144240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686531+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:55:34.686531+0000","last_peered":"2024-04-22T19:55:34.686531+0000","last_clean":"2024-04-22T19:55:34.686531+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:55:34.686531+0000","last_undegraded":"2024-04-22T19:55:34.686531+0000","last_fullsized":"2024-04-22T19:55:34.686531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692770+0000","last_change":"2024-04-22T19:54:17.393342+0000","last_active":"2024-04-22T19:55:34.692770+0000","last_peered":"2024-04-22T19:55:34.692770+0000","last_clean":"2024-04-22T19:55:34.692770+0000","last_became_active":"2024-04-22T19:54:17.392114+0000","last_became_peered":"2024-04-22T19:54:17.392114+0000","last_unstale":"2024-04-22T19:55:34.692770+0000","last_undegraded":"2024-04-22T19:55:34.692770+0000","last_fullsized":"2024-04-22T19:55:34.692770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149043+0000","last_change":"2024-04-22T19:54:19.387476+0000","last_active":"2024-04-22T19:55:35.149043+0000","last_peered":"2024-04-22T19:55:35.149043+0000","last_clean":"2024-04-22T19:55:35.149043+0000","last_became_active":"2024-04-22T19:54:19.386778+0000","last_became_peered":"2024-04-22T19:54:19.386778+0000","last_unstale":"2024-04-22T19:55:35.149043+0000","last_undegraded":"2024-04-22T19:55:35.149043+0000","last_fullsized":"2024-04-22T19:55:35.149043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:46.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686999+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:55:34.686999+0000","last_peered":"2024-04-22T19:55:34.686999+0000","last_clean":"2024-04-22T19:55:34.686999+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:55:34.686999+0000","last_undegraded":"2024-04-22T19:55:34.686999+0000","last_fullsized":"2024-04-22T19:55:34.686999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757772+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:55:34.757772+0000","last_peered":"2024-04-22T19:55:34.757772+0000","last_clean":"2024-04-22T19:55:34.757772+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:55:34.757772+0000","last_undegraded":"2024-04-22T19:55:34.757772+0000","last_fullsized":"2024-04-22T19:55:34.757772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688141+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:55:34.688141+0000","last_peered":"2024-04-22T19:55:34.688141+0000","last_clean":"2024-04-22T19:55:34.688141+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:55:34.688141+0000","last_undegraded":"2024-04-22T19:55:34.688141+0000","last_fullsized":"2024-04-22T19:55:34.688141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148049+0000","last_change":"2024-04-22T19:54:15.358926+0000","last_active":"2024-04-22T19:55:35.148049+0000","last_peered":"2024-04-22T19:55:35.148049+0000","last_clean":"2024-04-22T19:55:35.148049+0000","last_became_active":"2024-04-22T19:54:15.358167+0000","last_became_peered":"2024-04-22T19:54:15.358167+0000","last_unstale":"2024-04-22T19:55:35.148049+0000","last_undegraded":"2024-04-22T19:55:35.148049+0000","last_fullsized":"2024-04-22T19:55:35.148049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:07.130557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144483+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:55:35.144483+0000","last_peered":"2024-04-22T19:55:35.144483+0000","last_clean":"2024-04-22T19:55:35.144483+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:55:35.144483+0000","last_undegraded":"2024-04-22T19:55:35.144483+0000","last_fullsized":"2024-04-22T19:55:35.144483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687180+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:55:34.687180+0000","last_peered":"2024-04-22T19:55:34.687180+0000","last_clean":"2024-04-22T19:55:34.687180+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:55:34.687180+0000","last_undegraded":"2024-04-22T19:55:34.687180+0000","last_fullsized":"2024-04-22T19:55:34.687180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687245+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:55:34.687245+0000","last_peered":"2024-04-22T19:55:34.687245+0000","last_clean":"2024-04-22T19:55:34.687245+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:55:34.687245+0000","last_undegraded":"2024-04-22T19:55:34.687245+0000","last_fullsized":"2024-04-22T19:55:34.687245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685574+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:55:34.685574+0000","last_peered":"2024-04-22T19:55:34.685574+0000","last_clean":"2024-04-22T19:55:34.685574+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:55:34.685574+0000","last_undegraded":"2024-04-22T19:55:34.685574+0000","last_fullsized":"2024-04-22T19:55:34.685574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146734+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:55:35.146734+0000","last_peered":"2024-04-22T19:55:35.146734+0000","last_clean":"2024-04-22T19:55:35.146734+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:55:35.146734+0000","last_undegraded":"2024-04-22T19:55:35.146734+0000","last_fullsized":"2024-04-22T19:55:35.146734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153950+0000","last_change":"2024-04-22T19:54:15.374924+0000","last_active":"2024-04-22T19:55:35.153950+0000","last_peered":"2024-04-22T19:55:35.153950+0000","last_clean":"2024-04-22T19:55:35.153950+0000","last_became_active":"2024-04-22T19:54:15.374027+0000","last_became_peered":"2024-04-22T19:54:15.374027+0000","last_unstale":"2024-04-22T19:55:35.153950+0000","last_undegraded":"2024-04-22T19:55:35.153950+0000","last_fullsized":"2024-04-22T19:55:35.153950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:16.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757878+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:55:34.757878+0000","last_peered":"2024-04-22T19:55:34.757878+0000","last_clean":"2024-04-22T19:55:34.757878+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:55:34.757878+0000","last_undegraded":"2024-04-22T19:55:34.757878+0000","last_fullsized":"2024-04-22T19:55:34.757878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685145+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:55:34.685145+0000","last_peered":"2024-04-22T19:55:34.685145+0000","last_clean":"2024-04-22T19:55:34.685145+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:55:34.685145+0000","last_undegraded":"2024-04-22T19:55:34.685145+0000","last_fullsized":"2024-04-22T19:55:34.685145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147267+0000","last_change":"2024-04-22T19:54:48.462442+0000","last_active":"2024-04-22T19:55:35.147267+0000","last_peered":"2024-04-22T19:55:35.147267+0000","last_clean":"2024-04-22T19:55:35.147267+0000","last_became_active":"2024-04-22T19:54:48.461838+0000","last_became_peered":"2024-04-22T19:54:48.461838+0000","last_unstale":"2024-04-22T19:55:35.147267+0000","last_undegraded":"2024-04-22T19:55:35.147267+0000","last_fullsized":"2024-04-22T19:55:35.147267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:55.872338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149626+0000","last_change":"2024-04-22T19:54:09.324349+0000","last_active":"2024-04-22T19:55:35.149626+0000","last_peered":"2024-04-22T19:55:35.149626+0000","last_clean":"2024-04-22T19:55:35.149626+0000","last_became_active":"2024-04-22T19:54:09.324055+0000","last_became_peered":"2024-04-22T19:54:09.324055+0000","last_unstale":"2024-04-22T19:55:35.149626+0000","last_undegraded":"2024-04-22T19:55:35.149626+0000","last_fullsized":"2024-04-22T19:55:35.149626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687011+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:55:34.687011+0000","last_peered":"2024-04-22T19:55:34.687011+0000","last_clean":"2024-04-22T19:55:34.687011+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:55:34.687011+0000","last_undegraded":"2024-04-22T19:55:34.687011+0000","last_fullsized":"2024-04-22T19:55:34.687011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":101,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146996+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:55:35.146996+0000","last_peered":"2024-04-22T19:55:35.146996+0000","last_clean":"2024-04-22T19:55:35.146996+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:55:35.146996+0000","last_undegraded":"2024-04-22T19:55:35.146996+0000","last_fullsized":"2024-04-22T19:55:35.146996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757341+0000","last_change":"2024-04-22T19:54:17.394078+0000","last_active":"2024-04-22T19:55:34.757341+0000","last_peered":"2024-04-22T19:55:34.757341+0000","last_clean":"2024-04-22T19:55:34.757341+0000","last_became_active":"2024-04-22T19:54:17.393405+0000","last_became_peered":"2024-04-22T19:54:17.393405+0000","last_unstale":"2024-04-22T19:55:34.757341+0000","last_undegraded":"2024-04-22T19:55:34.757341+0000","last_fullsized":"2024-04-22T19:55:34.757341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:18.989391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687845+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:55:34.687845+0000","last_peered":"2024-04-22T19:55:34.687845+0000","last_clean":"2024-04-22T19:55:34.687845+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:55:34.687845+0000","last_undegraded":"2024-04-22T19:55:34.687845+0000","last_fullsized":"2024-04-22T19:55:34.687845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758205+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:55:34.758205+0000","last_peered":"2024-04-22T19:55:34.758205+0000","last_clean":"2024-04-22T19:55:34.758205+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:55:34.758205+0000","last_undegraded":"2024-04-22T19:55:34.758205+0000","last_fullsized":"2024-04-22T19:55:34.758205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146108+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:55:35.146108+0000","last_peered":"2024-04-22T19:55:35.146108+0000","last_clean":"2024-04-22T19:55:35.146108+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:55:35.146108+0000","last_undegraded":"2024-04-22T19:55:35.146108+0000","last_fullsized":"2024-04-22T19:55:35.146108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146756+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:55:35.146756+0000","last_peered":"2024-04-22T19:55:35.146756+0000","last_clean":"2024-04-22T19:55:35.146756+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:55:35.146756+0000","last_undegraded":"2024-04-22T19:55:35.146756+0000","last_fullsized":"2024-04-22T19:55:35.146756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151544+0000","last_change":"2024-04-22T19:54:09.342243+0000","last_active":"2024-04-22T19:55:35.151544+0000","last_peered":"2024-04-22T19:55:35.151544+0000","last_clean":"2024-04-22T19:55:35.151544+0000","last_became_active":"2024-04-22T19:54:09.341757+0000","last_became_peered":"2024-04-22T19:54:09.341757+0000","last_unstale":"2024-04-22T19:55:35.151544+0000","last_undegraded":"2024-04-22T19:55:35.151544+0000","last_fullsized":"2024-04-22T19:55:35.151544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149451+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:55:35.149451+0000","last_peered":"2024-04-22T19:55:35.149451+0000","last_clean":"2024-04-22T19:55:35.149451+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:55:35.149451+0000","last_undegraded":"2024-04-22T19:55:35.149451+0000","last_fullsized":"2024-04-22T19:55:35.149451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147128+0000","last_change":"2024-04-22T19:54:15.374361+0000","last_active":"2024-04-22T19:55:35.147128+0000","last_peered":"2024-04-22T19:55:35.147128+0000","last_clean":"2024-04-22T19:55:35.147128+0000","last_became_active":"2024-04-22T19:54:15.373665+0000","last_became_peered":"2024-04-22T19:54:15.373665+0000","last_unstale":"2024-04-22T19:55:35.147128+0000","last_undegraded":"2024-04-22T19:55:35.147128+0000","last_fullsized":"2024-04-22T19:55:35.147128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692057+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:55:34.692057+0000","last_peered":"2024-04-22T19:55:34.692057+0000","last_clean":"2024-04-22T19:55:34.692057+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:55:34.692057+0000","last_undegraded":"2024-04-22T19:55:34.692057+0000","last_fullsized":"2024-04-22T19:55:34.692057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756539+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:55:34.756539+0000","last_peered":"2024-04-22T19:55:34.756539+0000","last_clean":"2024-04-22T19:55:34.756539+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:55:34.756539+0000","last_undegraded":"2024-04-22T19:55:34.756539+0000","last_fullsized":"2024-04-22T19:55:34.756539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692315+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:55:34.692315+0000","last_peered":"2024-04-22T19:55:34.692315+0000","last_clean":"2024-04-22T19:55:34.692315+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:55:34.692315+0000","last_undegraded":"2024-04-22T19:55:34.692315+0000","last_fullsized":"2024-04-22T19:55:34.692315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145690+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:55:35.145690+0000","last_peered":"2024-04-22T19:55:35.145690+0000","last_clean":"2024-04-22T19:55:35.145690+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:55:35.145690+0000","last_undegraded":"2024-04-22T19:55:35.145690+0000","last_fullsized":"2024-04-22T19:55:35.145690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688239+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:55:34.688239+0000","last_peered":"2024-04-22T19:55:34.688239+0000","last_clean":"2024-04-22T19:55:34.688239+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:55:34.688239+0000","last_undegraded":"2024-04-22T19:55:34.688239+0000","last_fullsized":"2024-04-22T19:55:34.688239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147609+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:55:35.147609+0000","last_peered":"2024-04-22T19:55:35.147609+0000","last_clean":"2024-04-22T19:55:35.147609+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:55:35.147609+0000","last_undegraded":"2024-04-22T19:55:35.147609+0000","last_fullsized":"2024-04-22T19:55:35.147609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":131,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688060+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:55:34.688060+0000","last_peered":"2024-04-22T19:55:34.688060+0000","last_clean":"2024-04-22T19:55:34.688060+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:55:34.688060+0000","last_undegraded":"2024-04-22T19:55:34.688060+0000","last_fullsized":"2024-04-22T19:55:34.688060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149158+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:55:35.149158+0000","last_peered":"2024-04-22T19:55:35.149158+0000","last_clean":"2024-04-22T19:55:35.149158+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:55:35.149158+0000","last_undegraded":"2024-04-22T19:55:35.149158+0000","last_fullsized":"2024-04-22T19:55:35.149158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687179+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:55:34.687179+0000","last_peered":"2024-04-22T19:55:34.687179+0000","last_clean":"2024-04-22T19:55:34.687179+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:55:34.687179+0000","last_undegraded":"2024-04-22T19:55:34.687179+0000","last_fullsized":"2024-04-22T19:55:34.687179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691519+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:55:34.691519+0000","last_peered":"2024-04-22T19:55:34.691519+0000","last_clean":"2024-04-22T19:55:34.691519+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:55:34.691519+0000","last_undegraded":"2024-04-22T19:55:34.691519+0000","last_fullsized":"2024-04-22T19:55:34.691519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144920+0000","last_change":"2024-04-22T19:54:03.533639+0000","last_active":"2024-04-22T19:55:35.144920+0000","last_peered":"2024-04-22T19:55:35.144920+0000","last_clean":"2024-04-22T19:55:35.144920+0000","last_became_active":"2024-04-22T19:54:03.533297+0000","last_became_peered":"2024-04-22T19:54:03.533297+0000","last_unstale":"2024-04-22T19:55:35.144920+0000","last_undegraded":"2024-04-22T19:55:35.144920+0000","last_fullsized":"2024-04-22T19:55:35.144920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:40.486665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686943+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:55:34.686943+0000","last_peered":"2024-04-22T19:55:34.686943+0000","last_clean":"2024-04-22T19:55:34.686943+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:55:34.686943+0000","last_undegraded":"2024-04-22T19:55:34.686943+0000","last_fullsized":"2024-04-22T19:55:34.686943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144665+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:55:35.144665+0000","last_peered":"2024-04-22T19:55:35.144665+0000","last_clean":"2024-04-22T19:55:35.144665+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:55:35.144665+0000","last_undegraded":"2024-04-22T19:55:35.144665+0000","last_fullsized":"2024-04-22T19:55:35.144665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150241+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:55:35.150241+0000","last_peered":"2024-04-22T19:55:35.150241+0000","last_clean":"2024-04-22T19:55:35.150241+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:55:35.150241+0000","last_undegraded":"2024-04-22T19:55:35.150241+0000","last_fullsized":"2024-04-22T19:55:35.150241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693212+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:55:34.693212+0000","last_peered":"2024-04-22T19:55:34.693212+0000","last_clean":"2024-04-22T19:55:34.693212+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:55:34.693212+0000","last_undegraded":"2024-04-22T19:55:34.693212+0000","last_fullsized":"2024-04-22T19:55:34.693212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153207+0000","last_change":"2024-04-22T19:54:19.383707+0000","last_active":"2024-04-22T19:55:35.153207+0000","last_peered":"2024-04-22T19:55:35.153207+0000","last_clean":"2024-04-22T19:55:35.153207+0000","last_became_active":"2024-04-22T19:54:19.383071+0000","last_became_peered":"2024-04-22T19:54:19.383071+0000","last_unstale":"2024-04-22T19:55:35.153207+0000","last_undegraded":"2024-04-22T19:55:35.153207+0000","last_fullsized":"2024-04-22T19:55:35.153207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:25:04.464367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688295+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:55:34.688295+0000","last_peered":"2024-04-22T19:55:34.688295+0000","last_clean":"2024-04-22T19:55:34.688295+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:55:34.688295+0000","last_undegraded":"2024-04-22T19:55:34.688295+0000","last_fullsized":"2024-04-22T19:55:34.688295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149624+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:55:35.149624+0000","last_peered":"2024-04-22T19:55:35.149624+0000","last_clean":"2024-04-22T19:55:35.149624+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:55:35.149624+0000","last_undegraded":"2024-04-22T19:55:35.149624+0000","last_fullsized":"2024-04-22T19:55:35.149624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686090+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:55:34.686090+0000","last_peered":"2024-04-22T19:55:34.686090+0000","last_clean":"2024-04-22T19:55:34.686090+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:55:34.686090+0000","last_undegraded":"2024-04-22T19:55:34.686090+0000","last_fullsized":"2024-04-22T19:55:34.686090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690506+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:55:34.690506+0000","last_peered":"2024-04-22T19:55:34.690506+0000","last_clean":"2024-04-22T19:55:34.690506+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:55:34.690506+0000","last_undegraded":"2024-04-22T19:55:34.690506+0000","last_fullsized":"2024-04-22T19:55:34.690506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156392+0000","last_change":"2024-04-22T19:54:15.366419+0000","last_active":"2024-04-22T19:55:35.156392+0000","last_peered":"2024-04-22T19:55:35.156392+0000","last_clean":"2024-04-22T19:55:35.156392+0000","last_became_active":"2024-04-22T19:54:15.365688+0000","last_became_peered":"2024-04-22T19:54:15.365688+0000","last_unstale":"2024-04-22T19:55:35.156392+0000","last_undegraded":"2024-04-22T19:55:35.156392+0000","last_fullsized":"2024-04-22T19:55:35.156392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758426+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:55:34.758426+0000","last_peered":"2024-04-22T19:55:34.758426+0000","last_clean":"2024-04-22T19:55:34.758426+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:55:34.758426+0000","last_undegraded":"2024-04-22T19:55:34.758426+0000","last_fullsized":"2024-04-22T19:55:34.758426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145123+0000","last_change":"2024-04-22T19:54:19.386206+0000","last_active":"2024-04-22T19:55:35.145123+0000","last_peered":"2024-04-22T19:55:35.145123+0000","last_clean":"2024-04-22T19:55:35.145123+0000","last_became_active":"2024-04-22T19:54:19.383699+0000","last_became_peered":"2024-04-22T19:54:19.383699+0000","last_unstale":"2024-04-22T19:55:35.145123+0000","last_undegraded":"2024-04-22T19:55:35.145123+0000","last_fullsized":"2024-04-22T19:55:35.145123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.713155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687494+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:55:34.687494+0000","last_peered":"2024-04-22T19:55:34.687494+0000","last_clean":"2024-04-22T19:55:34.687494+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:55:34.687494+0000","last_undegraded":"2024-04-22T19:55:34.687494+0000","last_fullsized":"2024-04-22T19:55:34.687494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147941+0000","last_change":"2024-04-22T19:54:09.337813+0000","last_active":"2024-04-22T19:55:35.147941+0000","last_peered":"2024-04-22T19:55:35.147941+0000","last_clean":"2024-04-22T19:55:35.147941+0000","last_became_active":"2024-04-22T19:54:09.336677+0000","last_became_peered":"2024-04-22T19:54:09.336677+0000","last_unstale":"2024-04-22T19:55:35.147941+0000","last_undegraded":"2024-04-22T19:55:35.147941+0000","last_fullsized":"2024-04-22T19:55:35.147941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:51.697234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691985+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:55:34.691985+0000","last_peered":"2024-04-22T19:55:34.691985+0000","last_clean":"2024-04-22T19:55:34.691985+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:55:34.691985+0000","last_undegraded":"2024-04-22T19:55:34.691985+0000","last_fullsized":"2024-04-22T19:55:34.691985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691196+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:55:34.691196+0000","last_peered":"2024-04-22T19:55:34.691196+0000","last_clean":"2024-04-22T19:55:34.691196+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:55:34.691196+0000","last_undegraded":"2024-04-22T19:55:34.691196+0000","last_fullsized":"2024-04-22T19:55:34.691196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":106,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687567+0000","last_change":"2024-04-22T19:54:15.373085+0000","last_active":"2024-04-22T19:55:34.687567+0000","last_peered":"2024-04-22T19:55:34.687567+0000","last_clean":"2024-04-22T19:55:34.687567+0000","last_became_active":"2024-04-22T19:54:15.372367+0000","last_became_peered":"2024-04-22T19:54:15.372367+0000","last_unstale":"2024-04-22T19:55:34.687567+0000","last_undegraded":"2024-04-22T19:55:34.687567+0000","last_fullsized":"2024-04-22T19:55:34.687567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684510+0000","last_change":"2024-04-22T19:54:17.388656+0000","last_active":"2024-04-22T19:55:34.684510+0000","last_peered":"2024-04-22T19:55:34.684510+0000","last_clean":"2024-04-22T19:55:34.684510+0000","last_became_active":"2024-04-22T19:54:17.387837+0000","last_became_peered":"2024-04-22T19:54:17.387837+0000","last_unstale":"2024-04-22T19:55:34.684510+0000","last_undegraded":"2024-04-22T19:55:34.684510+0000","last_fullsized":"2024-04-22T19:55:34.684510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691773+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:55:34.691773+0000","last_peered":"2024-04-22T19:55:34.691773+0000","last_clean":"2024-04-22T19:55:34.691773+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:55:34.691773+0000","last_undegraded":"2024-04-22T19:55:34.691773+0000","last_fullsized":"2024-04-22T19:55:34.691773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691519+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:55:34.691519+0000","last_peered":"2024-04-22T19:55:34.691519+0000","last_clean":"2024-04-22T19:55:34.691519+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:55:34.691519+0000","last_undegraded":"2024-04-22T19:55:34.691519+0000","last_fullsized":"2024-04-22T19:55:34.691519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688365+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:55:34.688365+0000","last_peered":"2024-04-22T19:55:34.688365+0000","last_clean":"2024-04-22T19:55:34.688365+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:55:34.688365+0000","last_undegraded":"2024-04-22T19:55:34.688365+0000","last_fullsized":"2024-04-22T19:55:34.688365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150966+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:55:35.150966+0000","last_peered":"2024-04-22T19:55:35.150966+0000","last_clean":"2024-04-22T19:55:35.150966+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:55:35.150966+0000","last_undegraded":"2024-04-22T19:55:35.150966+0000","last_fullsized":"2024-04-22T19:55:35.150966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757048+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:55:34.757048+0000","last_peered":"2024-04-22T19:55:34.757048+0000","last_clean":"2024-04-22T19:55:34.757048+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:55:34.757048+0000","last_undegraded":"2024-04-22T19:55:34.757048+0000","last_fullsized":"2024-04-22T19:55:34.757048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686898+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:55:34.686898+0000","last_peered":"2024-04-22T19:55:34.686898+0000","last_clean":"2024-04-22T19:55:34.686898+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:55:34.686898+0000","last_undegraded":"2024-04-22T19:55:34.686898+0000","last_fullsized":"2024-04-22T19:55:34.686898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145574+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:55:35.145574+0000","last_peered":"2024-04-22T19:55:35.145574+0000","last_clean":"2024-04-22T19:55:35.145574+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:55:35.145574+0000","last_undegraded":"2024-04-22T19:55:35.145574+0000","last_fullsized":"2024-04-22T19:55:35.145574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156853+0000","last_change":"2024-04-22T19:54:19.959246+0000","last_active":"2024-04-22T19:55:35.156853+0000","last_peered":"2024-04-22T19:55:35.156853+0000","last_clean":"2024-04-22T19:55:35.156853+0000","last_became_active":"2024-04-22T19:54:19.958416+0000","last_became_peered":"2024-04-22T19:54:19.958416+0000","last_unstale":"2024-04-22T19:55:35.156853+0000","last_undegraded":"2024-04-22T19:55:35.156853+0000","last_fullsized":"2024-04-22T19:55:35.156853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:36.008379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149366+0000","last_change":"2024-04-22T19:54:11.361967+0000","last_active":"2024-04-22T19:55:35.149366+0000","last_peered":"2024-04-22T19:55:35.149366+0000","last_clean":"2024-04-22T19:55:35.149366+0000","last_became_active":"2024-04-22T19:54:11.361431+0000","last_became_peered":"2024-04-22T19:54:11.361431+0000","last_unstale":"2024-04-22T19:55:35.149366+0000","last_undegraded":"2024-04-22T19:55:35.149366+0000","last_fullsized":"2024-04-22T19:55:35.149366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156462+0000","last_change":"2024-04-22T19:54:09.338528+0000","last_active":"2024-04-22T19:55:35.156462+0000","last_peered":"2024-04-22T19:55:35.156462+0000","last_clean":"2024-04-22T19:55:35.156462+0000","last_became_active":"2024-04-22T19:54:09.338299+0000","last_became_peered":"2024-04-22T19:54:09.338299+0000","last_unstale":"2024-04-22T19:55:35.156462+0000","last_undegraded":"2024-04-22T19:55:35.156462+0000","last_fullsized":"2024-04-22T19:55:35.156462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691928+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:55:34.691928+0000","last_peered":"2024-04-22T19:55:34.691928+0000","last_clean":"2024-04-22T19:55:34.691928+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:55:34.691928+0000","last_undegraded":"2024-04-22T19:55:34.691928+0000","last_fullsized":"2024-04-22T19:55:34.691928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684752+0000","last_change":"2024-04-22T19:54:13.347158+0000","last_active":"2024-04-22T19:55:34.684752+0000","last_peered":"2024-04-22T19:55:34.684752+0000","last_clean":"2024-04-22T19:55:34.684752+0000","last_became_active":"2024-04-22T19:54:13.346353+0000","last_became_peered":"2024-04-22T19:54:13.346353+0000","last_unstale":"2024-04-22T19:55:34.684752+0000","last_undegraded":"2024-04-22T19:55:34.684752+0000","last_fullsized":"2024-04-22T19:55:34.684752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685410+0000","last_change":"2024-04-22T19:54:15.361224+0000","last_active":"2024-04-22T19:55:34.685410+0000","last_peered":"2024-04-22T19:55:34.685410+0000","last_clean":"2024-04-22T19:55:34.685410+0000","last_became_active":"2024-04-22T19:54:15.359915+0000","last_became_peered":"2024-04-22T19:54:15.359915+0000","last_unstale":"2024-04-22T19:55:34.685410+0000","last_undegraded":"2024-04-22T19:55:34.685410+0000","last_fullsized":"2024-04-22T19:55:34.685410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153691+0000","last_change":"2024-04-22T19:54:17.386494+0000","last_active":"2024-04-22T19:55:35.153691+0000","last_peered":"2024-04-22T19:55:35.153691+0000","last_clean":"2024-04-22T19:55:35.153691+0000","last_became_active":"2024-04-22T19:54:17.385851+0000","last_became_peered":"2024-04-22T19:54:17.385851+0000","last_unstale":"2024-04-22T19:55:35.153691+0000","last_undegraded":"2024-04-22T19:55:35.153691+0000","last_fullsized":"2024-04-22T19:55:35.153691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:09.967672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693285+0000","last_change":"2024-04-22T19:54:19.376787+0000","last_active":"2024-04-22T19:55:34.693285+0000","last_peered":"2024-04-22T19:55:34.693285+0000","last_clean":"2024-04-22T19:55:34.693285+0000","last_became_active":"2024-04-22T19:54:19.375982+0000","last_became_peered":"2024-04-22T19:54:19.375982+0000","last_unstale":"2024-04-22T19:55:34.693285+0000","last_undegraded":"2024-04-22T19:55:34.693285+0000","last_fullsized":"2024-04-22T19:55:34.693285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:56:39.975385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684998+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:55:34.684998+0000","last_peered":"2024-04-22T19:55:34.684998+0000","last_clean":"2024-04-22T19:55:34.684998+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:55:34.684998+0000","last_undegraded":"2024-04-22T19:55:34.684998+0000","last_fullsized":"2024-04-22T19:55:34.684998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692501+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:55:34.692501+0000","last_peered":"2024-04-22T19:55:34.692501+0000","last_clean":"2024-04-22T19:55:34.692501+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:55:34.692501+0000","last_undegraded":"2024-04-22T19:55:34.692501+0000","last_fullsized":"2024-04-22T19:55:34.692501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758914+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:55:34.758914+0000","last_peered":"2024-04-22T19:55:34.758914+0000","last_clean":"2024-04-22T19:55:34.758914+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:55:34.758914+0000","last_undegraded":"2024-04-22T19:55:34.758914+0000","last_fullsized":"2024-04-22T19:55:34.758914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149252+0000","last_change":"2024-04-22T19:54:13.351579+0000","last_active":"2024-04-22T19:55:35.149252+0000","last_peered":"2024-04-22T19:55:35.149252+0000","last_clean":"2024-04-22T19:55:35.149252+0000","last_became_active":"2024-04-22T19:54:13.350953+0000","last_became_peered":"2024-04-22T19:54:13.350953+0000","last_unstale":"2024-04-22T19:55:35.149252+0000","last_undegraded":"2024-04-22T19:55:35.149252+0000","last_fullsized":"2024-04-22T19:55:35.149252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:33.938710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148458+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:55:35.148458+0000","last_peered":"2024-04-22T19:55:35.148458+0000","last_clean":"2024-04-22T19:55:35.148458+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:55:35.148458+0000","last_undegraded":"2024-04-22T19:55:35.148458+0000","last_fullsized":"2024-04-22T19:55:35.148458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151315+0000","last_change":"2024-04-22T19:54:17.374439+0000","last_active":"2024-04-22T19:55:35.151315+0000","last_peered":"2024-04-22T19:55:35.151315+0000","last_clean":"2024-04-22T19:55:35.151315+0000","last_became_active":"2024-04-22T19:54:17.373658+0000","last_became_peered":"2024-04-22T19:54:17.373658+0000","last_unstale":"2024-04-22T19:55:35.151315+0000","last_undegraded":"2024-04-22T19:55:35.151315+0000","last_fullsized":"2024-04-22T19:55:35.151315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:33.579486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146920+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:55:35.146920+0000","last_peered":"2024-04-22T19:55:35.146920+0000","last_clean":"2024-04-22T19:55:35.146920+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:55:35.146920+0000","last_undegraded":"2024-04-22T19:55:35.146920+0000","last_fullsized":"2024-04-22T19:55:35.146920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692647+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:55:34.692647+0000","last_peered":"2024-04-22T19:55:34.692647+0000","last_clean":"2024-04-22T19:55:34.692647+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:55:34.692647+0000","last_undegraded":"2024-04-22T19:55:34.692647+0000","last_fullsized":"2024-04-22T19:55:34.692647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686058+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:55:34.686058+0000","last_peered":"2024-04-22T19:55:34.686058+0000","last_clean":"2024-04-22T19:55:34.686058+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:55:34.686058+0000","last_undegraded":"2024-04-22T19:55:34.686058+0000","last_fullsized":"2024-04-22T19:55:34.686058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685471+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:55:34.685471+0000","last_peered":"2024-04-22T19:55:34.685471+0000","last_clean":"2024-04-22T19:55:34.685471+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:55:34.685471+0000","last_undegraded":"2024-04-22T19:55:34.685471+0000","last_fullsized":"2024-04-22T19:55:34.685471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687623+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:55:34.687623+0000","last_peered":"2024-04-22T19:55:34.687623+0000","last_clean":"2024-04-22T19:55:34.687623+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:55:34.687623+0000","last_undegraded":"2024-04-22T19:55:34.687623+0000","last_fullsized":"2024-04-22T19:55:34.687623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148937+0000","last_change":"2024-04-22T19:54:15.364296+0000","last_active":"2024-04-22T19:55:35.148937+0000","last_peered":"2024-04-22T19:55:35.148937+0000","last_clean":"2024-04-22T19:55:35.148937+0000","last_became_active":"2024-04-22T19:54:15.363550+0000","last_became_peered":"2024-04-22T19:54:15.363550+0000","last_unstale":"2024-04-22T19:55:35.148937+0000","last_undegraded":"2024-04-22T19:55:35.148937+0000","last_fullsized":"2024-04-22T19:55:35.148937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149125+0000","last_change":"2024-04-22T19:54:17.387336+0000","last_active":"2024-04-22T19:55:35.149125+0000","last_peered":"2024-04-22T19:55:35.149125+0000","last_clean":"2024-04-22T19:55:35.149125+0000","last_became_active":"2024-04-22T19:54:17.386601+0000","last_became_peered":"2024-04-22T19:54:17.386601+0000","last_unstale":"2024-04-22T19:55:35.149125+0000","last_undegraded":"2024-04-22T19:55:35.149125+0000","last_fullsized":"2024-04-22T19:55:35.149125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:50.780788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156164+0000","last_change":"2024-04-22T19:54:19.389080+0000","last_active":"2024-04-22T19:55:35.156164+0000","last_peered":"2024-04-22T19:55:35.156164+0000","last_clean":"2024-04-22T19:55:35.156164+0000","last_became_active":"2024-04-22T19:54:19.388263+0000","last_became_peered":"2024-04-22T19:54:19.388263+0000","last_unstale":"2024-04-22T19:55:35.156164+0000","last_undegraded":"2024-04-22T19:55:35.156164+0000","last_fullsized":"2024-04-22T19:55:35.156164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:13:06.973763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687416+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:55:34.687416+0000","last_peered":"2024-04-22T19:55:34.687416+0000","last_clean":"2024-04-22T19:55:34.687416+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:55:34.687416+0000","last_undegraded":"2024-04-22T19:55:34.687416+0000","last_fullsized":"2024-04-22T19:55:34.687416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150597+0000","last_change":"2024-04-22T19:54:09.358724+0000","last_active":"2024-04-22T19:55:35.150597+0000","last_peered":"2024-04-22T19:55:35.150597+0000","last_clean":"2024-04-22T19:55:35.150597+0000","last_became_active":"2024-04-22T19:54:09.357161+0000","last_became_peered":"2024-04-22T19:54:09.357161+0000","last_unstale":"2024-04-22T19:55:35.150597+0000","last_undegraded":"2024-04-22T19:55:35.150597+0000","last_fullsized":"2024-04-22T19:55:35.150597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153134+0000","last_change":"2024-04-22T19:54:13.346921+0000","last_active":"2024-04-22T19:55:35.153134+0000","last_peered":"2024-04-22T19:55:35.153134+0000","last_clean":"2024-04-22T19:55:35.153134+0000","last_became_active":"2024-04-22T19:54:13.346460+0000","last_became_peered":"2024-04-22T19:54:13.346460+0000","last_unstale":"2024-04-22T19:55:35.153134+0000","last_undegraded":"2024-04-22T19:55:35.153134+0000","last_fullsized":"2024-04-22T19:55:35.153134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"41'5","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687437+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:55:34.687437+0000","last_peered":"2024-04-22T19:55:34.687437+0000","last_clean":"2024-04-22T19:55:34.687437+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:55:34.687437+0000","last_undegraded":"2024-04-22T19:55:34.687437+0000","last_fullsized":"2024-04-22T19:55:34.687437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146293+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:55:35.146293+0000","last_peered":"2024-04-22T19:55:35.146293+0000","last_clean":"2024-04-22T19:55:35.146293+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:55:35.146293+0000","last_undegraded":"2024-04-22T19:55:35.146293+0000","last_fullsized":"2024-04-22T19:55:35.146293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690417+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:55:34.690417+0000","last_peered":"2024-04-22T19:55:34.690417+0000","last_clean":"2024-04-22T19:55:34.690417+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:55:34.690417+0000","last_undegraded":"2024-04-22T19:55:34.690417+0000","last_fullsized":"2024-04-22T19:55:34.690417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151822+0000","last_change":"2024-04-22T19:54:11.367199+0000","last_active":"2024-04-22T19:55:35.151822+0000","last_peered":"2024-04-22T19:55:35.151822+0000","last_clean":"2024-04-22T19:55:35.151822+0000","last_became_active":"2024-04-22T19:54:11.366927+0000","last_became_peered":"2024-04-22T19:54:11.366927+0000","last_unstale":"2024-04-22T19:55:35.151822+0000","last_undegraded":"2024-04-22T19:55:35.151822+0000","last_fullsized":"2024-04-22T19:55:35.151822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148284+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:55:35.148284+0000","last_peered":"2024-04-22T19:55:35.148284+0000","last_clean":"2024-04-22T19:55:35.148284+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:55:35.148284+0000","last_undegraded":"2024-04-22T19:55:35.148284+0000","last_fullsized":"2024-04-22T19:55:35.148284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145246+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:55:35.145246+0000","last_peered":"2024-04-22T19:55:35.145246+0000","last_clean":"2024-04-22T19:55:35.145246+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:55:35.145246+0000","last_undegraded":"2024-04-22T19:55:35.145246+0000","last_fullsized":"2024-04-22T19:55:35.145246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.152975+0000","last_change":"2024-04-22T19:54:15.366428+0000","last_active":"2024-04-22T19:55:35.152975+0000","last_peered":"2024-04-22T19:55:35.152975+0000","last_clean":"2024-04-22T19:55:35.152975+0000","last_became_active":"2024-04-22T19:54:15.363037+0000","last_became_peered":"2024-04-22T19:54:15.363037+0000","last_unstale":"2024-04-22T19:55:35.152975+0000","last_undegraded":"2024-04-22T19:55:35.152975+0000","last_fullsized":"2024-04-22T19:55:35.152975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:57.305820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757032+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:55:34.757032+0000","last_peered":"2024-04-22T19:55:34.757032+0000","last_clean":"2024-04-22T19:55:34.757032+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:55:34.757032+0000","last_undegraded":"2024-04-22T19:55:34.757032+0000","last_fullsized":"2024-04-22T19:55:34.757032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146238+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:55:35.146238+0000","last_peered":"2024-04-22T19:55:35.146238+0000","last_clean":"2024-04-22T19:55:35.146238+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:55:35.146238+0000","last_undegraded":"2024-04-22T19:55:35.146238+0000","last_fullsized":"2024-04-22T19:55:35.146238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149478+0000","last_change":"2024-04-22T19:54:11.365937+0000","last_active":"2024-04-22T19:55:35.149478+0000","last_peered":"2024-04-22T19:55:35.149478+0000","last_clean":"2024-04-22T19:55:35.149478+0000","last_became_active":"2024-04-22T19:54:11.365569+0000","last_became_peered":"2024-04-22T19:54:11.365569+0000","last_unstale":"2024-04-22T19:55:35.149478+0000","last_undegraded":"2024-04-22T19:55:35.149478+0000","last_fullsized":"2024-04-22T19:55:35.149478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.693072+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:55:34.693072+0000","last_peered":"2024-04-22T19:55:34.693072+0000","last_clean":"2024-04-22T19:55:34.693072+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:55:34.693072+0000","last_undegraded":"2024-04-22T19:55:34.693072+0000","last_fullsized":"2024-04-22T19:55:34.693072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757204+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:55:34.757204+0000","last_peered":"2024-04-22T19:55:34.757204+0000","last_clean":"2024-04-22T19:55:34.757204+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:55:34.757204+0000","last_undegraded":"2024-04-22T19:55:34.757204+0000","last_fullsized":"2024-04-22T19:55:34.757204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147658+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:55:35.147658+0000","last_peered":"2024-04-22T19:55:35.147658+0000","last_clean":"2024-04-22T19:55:35.147658+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:55:35.147658+0000","last_undegraded":"2024-04-22T19:55:35.147658+0000","last_fullsized":"2024-04-22T19:55:35.147658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690904+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:55:34.690904+0000","last_peered":"2024-04-22T19:55:34.690904+0000","last_clean":"2024-04-22T19:55:34.690904+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:55:34.690904+0000","last_undegraded":"2024-04-22T19:55:34.690904+0000","last_fullsized":"2024-04-22T19:55:34.690904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758731+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:55:34.758731+0000","last_peered":"2024-04-22T19:55:34.758731+0000","last_clean":"2024-04-22T19:55:34.758731+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:55:34.758731+0000","last_undegraded":"2024-04-22T19:55:34.758731+0000","last_fullsized":"2024-04-22T19:55:34.758731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149551+0000","last_change":"2024-04-22T19:54:09.326439+0000","last_active":"2024-04-22T19:55:35.149551+0000","last_peered":"2024-04-22T19:55:35.149551+0000","last_clean":"2024-04-22T19:55:35.149551+0000","last_became_active":"2024-04-22T19:54:09.326162+0000","last_became_peered":"2024-04-22T19:54:09.326162+0000","last_unstale":"2024-04-22T19:55:35.149551+0000","last_undegraded":"2024-04-22T19:55:35.149551+0000","last_fullsized":"2024-04-22T19:55:35.149551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692128+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:55:34.692128+0000","last_peered":"2024-04-22T19:55:34.692128+0000","last_clean":"2024-04-22T19:55:34.692128+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:55:34.692128+0000","last_undegraded":"2024-04-22T19:55:34.692128+0000","last_fullsized":"2024-04-22T19:55:34.692128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688668+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:55:34.688668+0000","last_peered":"2024-04-22T19:55:34.688668+0000","last_clean":"2024-04-22T19:55:34.688668+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:55:34.688668+0000","last_undegraded":"2024-04-22T19:55:34.688668+0000","last_fullsized":"2024-04-22T19:55:34.688668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":69,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146754+0000","last_change":"2024-04-22T19:54:17.398926+0000","last_active":"2024-04-22T19:55:35.146754+0000","last_peered":"2024-04-22T19:55:35.146754+0000","last_clean":"2024-04-22T19:55:35.146754+0000","last_became_active":"2024-04-22T19:54:17.398270+0000","last_became_peered":"2024-04-22T19:54:17.398270+0000","last_unstale":"2024-04-22T19:55:35.146754+0000","last_undegraded":"2024-04-22T19:55:35.146754+0000","last_fullsized":"2024-04-22T19:55:35.146754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151277+0000","last_change":"2024-04-22T19:54:19.958725+0000","last_active":"2024-04-22T19:55:35.151277+0000","last_peered":"2024-04-22T19:55:35.151277+0000","last_clean":"2024-04-22T19:55:35.151277+0000","last_became_active":"2024-04-22T19:54:19.957923+0000","last_became_peered":"2024-04-22T19:54:19.957923+0000","last_unstale":"2024-04-22T19:55:35.151277+0000","last_undegraded":"2024-04-22T19:55:35.151277+0000","last_fullsized":"2024-04-22T19:55:35.151277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:06:47.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692244+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:55:34.692244+0000","last_peered":"2024-04-22T19:55:34.692244+0000","last_clean":"2024-04-22T19:55:34.692244+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:55:34.692244+0000","last_undegraded":"2024-04-22T19:55:34.692244+0000","last_fullsized":"2024-04-22T19:55:34.692244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687431+0000","last_change":"2024-04-22T19:54:09.323111+0000","last_active":"2024-04-22T19:55:34.687431+0000","last_peered":"2024-04-22T19:55:34.687431+0000","last_clean":"2024-04-22T19:55:34.687431+0000","last_became_active":"2024-04-22T19:54:09.322781+0000","last_became_peered":"2024-04-22T19:54:09.322781+0000","last_unstale":"2024-04-22T19:55:34.687431+0000","last_undegraded":"2024-04-22T19:55:34.687431+0000","last_fullsized":"2024-04-22T19:55:34.687431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758518+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:55:34.758518+0000","last_peered":"2024-04-22T19:55:34.758518+0000","last_clean":"2024-04-22T19:55:34.758518+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:55:34.758518+0000","last_undegraded":"2024-04-22T19:55:34.758518+0000","last_fullsized":"2024-04-22T19:55:34.758518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148498+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:55:35.148498+0000","last_peered":"2024-04-22T19:55:35.148498+0000","last_clean":"2024-04-22T19:55:35.148498+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:55:35.148498+0000","last_undegraded":"2024-04-22T19:55:35.148498+0000","last_fullsized":"2024-04-22T19:55:35.148498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688836+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:55:34.688836+0000","last_peered":"2024-04-22T19:55:34.688836+0000","last_clean":"2024-04-22T19:55:34.688836+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:55:34.688836+0000","last_undegraded":"2024-04-22T19:55:34.688836+0000","last_fullsized":"2024-04-22T19:55:34.688836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756759+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:55:34.756759+0000","last_peered":"2024-04-22T19:55:34.756759+0000","last_clean":"2024-04-22T19:55:34.756759+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:55:34.756759+0000","last_undegraded":"2024-04-22T19:55:34.756759+0000","last_fullsized":"2024-04-22T19:55:34.756759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156160+0000","last_change":"2024-04-22T19:54:11.366363+0000","last_active":"2024-04-22T19:55:35.156160+0000","last_peered":"2024-04-22T19:55:35.156160+0000","last_clean":"2024-04-22T19:55:35.156160+0000","last_became_active":"2024-04-22T19:54:11.365682+0000","last_became_peered":"2024-04-22T19:54:11.365682+0000","last_unstale":"2024-04-22T19:55:35.156160+0000","last_undegraded":"2024-04-22T19:55:35.156160+0000","last_fullsized":"2024-04-22T19:55:35.156160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685827+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:55:34.685827+0000","last_peered":"2024-04-22T19:55:34.685827+0000","last_clean":"2024-04-22T19:55:34.685827+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:55:34.685827+0000","last_undegraded":"2024-04-22T19:55:34.685827+0000","last_fullsized":"2024-04-22T19:55:34.685827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686563+0000","last_change":"2024-04-22T19:54:13.347115+0000","last_active":"2024-04-22T19:55:34.686563+0000","last_peered":"2024-04-22T19:55:34.686563+0000","last_clean":"2024-04-22T19:55:34.686563+0000","last_became_active":"2024-04-22T19:54:13.346214+0000","last_became_peered":"2024-04-22T19:54:13.346214+0000","last_unstale":"2024-04-22T19:55:34.686563+0000","last_undegraded":"2024-04-22T19:55:34.686563+0000","last_fullsized":"2024-04-22T19:55:34.686563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:58.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156700+0000","last_change":"2024-04-22T19:54:15.375428+0000","last_active":"2024-04-22T19:55:35.156700+0000","last_peered":"2024-04-22T19:55:35.156700+0000","last_clean":"2024-04-22T19:55:35.156700+0000","last_became_active":"2024-04-22T19:54:15.374863+0000","last_became_peered":"2024-04-22T19:54:15.374863+0000","last_unstale":"2024-04-22T19:55:35.156700+0000","last_undegraded":"2024-04-22T19:55:35.156700+0000","last_fullsized":"2024-04-22T19:55:35.156700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:56.025191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691693+0000","last_change":"2024-04-22T19:54:17.392924+0000","last_active":"2024-04-22T19:55:34.691693+0000","last_peered":"2024-04-22T19:55:34.691693+0000","last_clean":"2024-04-22T19:55:34.691693+0000","last_became_active":"2024-04-22T19:54:17.391991+0000","last_became_peered":"2024-04-22T19:54:17.391991+0000","last_unstale":"2024-04-22T19:55:34.691693+0000","last_undegraded":"2024-04-22T19:55:34.691693+0000","last_fullsized":"2024-04-22T19:55:34.691693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:47.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145522+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:55:35.145522+0000","last_peered":"2024-04-22T19:55:35.145522+0000","last_clean":"2024-04-22T19:55:35.145522+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:55:35.145522+0000","last_undegraded":"2024-04-22T19:55:35.145522+0000","last_fullsized":"2024-04-22T19:55:35.145522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147837+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:55:35.147837+0000","last_peered":"2024-04-22T19:55:35.147837+0000","last_clean":"2024-04-22T19:55:35.147837+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:55:35.147837+0000","last_undegraded":"2024-04-22T19:55:35.147837+0000","last_fullsized":"2024-04-22T19:55:35.147837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690977+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:55:34.690977+0000","last_peered":"2024-04-22T19:55:34.690977+0000","last_clean":"2024-04-22T19:55:34.690977+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:55:34.690977+0000","last_undegraded":"2024-04-22T19:55:34.690977+0000","last_fullsized":"2024-04-22T19:55:34.690977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688997+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:55:34.688997+0000","last_peered":"2024-04-22T19:55:34.688997+0000","last_clean":"2024-04-22T19:55:34.688997+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:55:34.688997+0000","last_undegraded":"2024-04-22T19:55:34.688997+0000","last_fullsized":"2024-04-22T19:55:34.688997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686785+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:55:34.686785+0000","last_peered":"2024-04-22T19:55:34.686785+0000","last_clean":"2024-04-22T19:55:34.686785+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:55:34.686785+0000","last_undegraded":"2024-04-22T19:55:34.686785+0000","last_fullsized":"2024-04-22T19:55:34.686785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758256+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:55:34.758256+0000","last_peered":"2024-04-22T19:55:34.758256+0000","last_clean":"2024-04-22T19:55:34.758256+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:55:34.758256+0000","last_undegraded":"2024-04-22T19:55:34.758256+0000","last_fullsized":"2024-04-22T19:55:34.758256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145050+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:55:35.145050+0000","last_peered":"2024-04-22T19:55:35.145050+0000","last_clean":"2024-04-22T19:55:35.145050+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:55:35.145050+0000","last_undegraded":"2024-04-22T19:55:35.145050+0000","last_fullsized":"2024-04-22T19:55:35.145050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685470+0000","last_change":"2024-04-22T19:54:11.345501+0000","last_active":"2024-04-22T19:55:34.685470+0000","last_peered":"2024-04-22T19:55:34.685470+0000","last_clean":"2024-04-22T19:55:34.685470+0000","last_became_active":"2024-04-22T19:54:11.342684+0000","last_became_peered":"2024-04-22T19:54:11.342684+0000","last_unstale":"2024-04-22T19:55:34.685470+0000","last_undegraded":"2024-04-22T19:55:34.685470+0000","last_fullsized":"2024-04-22T19:55:34.685470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149860+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:55:35.149860+0000","last_peered":"2024-04-22T19:55:35.149860+0000","last_clean":"2024-04-22T19:55:35.149860+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:55:35.149860+0000","last_undegraded":"2024-04-22T19:55:35.149860+0000","last_fullsized":"2024-04-22T19:55:35.149860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148017+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:55:35.148017+0000","last_peered":"2024-04-22T19:55:35.148017+0000","last_clean":"2024-04-22T19:55:35.148017+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:55:35.148017+0000","last_undegraded":"2024-04-22T19:55:35.148017+0000","last_fullsized":"2024-04-22T19:55:35.148017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145822+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:55:35.145822+0000","last_peered":"2024-04-22T19:55:35.145822+0000","last_clean":"2024-04-22T19:55:35.145822+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:55:35.145822+0000","last_undegraded":"2024-04-22T19:55:35.145822+0000","last_fullsized":"2024-04-22T19:55:35.145822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687173+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:55:34.687173+0000","last_peered":"2024-04-22T19:55:34.687173+0000","last_clean":"2024-04-22T19:55:34.687173+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:55:34.687173+0000","last_undegraded":"2024-04-22T19:55:34.687173+0000","last_fullsized":"2024-04-22T19:55:34.687173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.149912+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:55:35.149912+0000","last_peered":"2024-04-22T19:55:35.149912+0000","last_clean":"2024-04-22T19:55:35.149912+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:55:35.149912+0000","last_undegraded":"2024-04-22T19:55:35.149912+0000","last_fullsized":"2024-04-22T19:55:35.149912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685564+0000","last_change":"2024-04-22T19:54:11.349313+0000","last_active":"2024-04-22T19:55:34.685564+0000","last_peered":"2024-04-22T19:55:34.685564+0000","last_clean":"2024-04-22T19:55:34.685564+0000","last_became_active":"2024-04-22T19:54:11.346733+0000","last_became_peered":"2024-04-22T19:54:11.346733+0000","last_unstale":"2024-04-22T19:55:34.685564+0000","last_undegraded":"2024-04-22T19:55:34.685564+0000","last_fullsized":"2024-04-22T19:55:34.685564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147774+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:55:35.147774+0000","last_peered":"2024-04-22T19:55:35.147774+0000","last_clean":"2024-04-22T19:55:35.147774+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:55:35.147774+0000","last_undegraded":"2024-04-22T19:55:35.147774+0000","last_fullsized":"2024-04-22T19:55:35.147774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146454+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:55:35.146454+0000","last_peered":"2024-04-22T19:55:35.146454+0000","last_clean":"2024-04-22T19:55:35.146454+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:55:35.146454+0000","last_undegraded":"2024-04-22T19:55:35.146454+0000","last_fullsized":"2024-04-22T19:55:35.146454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687266+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:55:34.687266+0000","last_peered":"2024-04-22T19:55:34.687266+0000","last_clean":"2024-04-22T19:55:34.687266+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:55:34.687266+0000","last_undegraded":"2024-04-22T19:55:34.687266+0000","last_fullsized":"2024-04-22T19:55:34.687266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":68,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756778+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:55:34.756778+0000","last_peered":"2024-04-22T19:55:34.756778+0000","last_clean":"2024-04-22T19:55:34.756778+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:55:34.756778+0000","last_undegraded":"2024-04-22T19:55:34.756778+0000","last_fullsized":"2024-04-22T19:55:34.756778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156259+0000","last_change":"2024-04-22T19:54:19.962442+0000","last_active":"2024-04-22T19:55:35.156259+0000","last_peered":"2024-04-22T19:55:35.156259+0000","last_clean":"2024-04-22T19:55:35.156259+0000","last_became_active":"2024-04-22T19:54:19.960324+0000","last_became_peered":"2024-04-22T19:54:19.960324+0000","last_unstale":"2024-04-22T19:55:35.156259+0000","last_undegraded":"2024-04-22T19:55:35.156259+0000","last_fullsized":"2024-04-22T19:55:35.156259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:28:38.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151935+0000","last_change":"2024-04-22T19:54:11.349398+0000","last_active":"2024-04-22T19:55:35.151935+0000","last_peered":"2024-04-22T19:55:35.151935+0000","last_clean":"2024-04-22T19:55:35.151935+0000","last_became_active":"2024-04-22T19:54:11.348383+0000","last_became_peered":"2024-04-22T19:54:11.348383+0000","last_unstale":"2024-04-22T19:55:35.151935+0000","last_undegraded":"2024-04-22T19:55:35.151935+0000","last_fullsized":"2024-04-22T19:55:35.151935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156573+0000","last_change":"2024-04-22T19:54:09.327427+0000","last_active":"2024-04-22T19:55:35.156573+0000","last_peered":"2024-04-22T19:55:35.156573+0000","last_clean":"2024-04-22T19:55:35.156573+0000","last_became_active":"2024-04-22T19:54:09.327146+0000","last_became_peered":"2024-04-22T19:54:09.327146+0000","last_unstale":"2024-04-22T19:55:35.156573+0000","last_undegraded":"2024-04-22T19:55:35.156573+0000","last_fullsized":"2024-04-22T19:55:35.156573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":78,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684331+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:55:34.684331+0000","last_peered":"2024-04-22T19:55:34.684331+0000","last_clean":"2024-04-22T19:55:34.684331+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:55:34.684331+0000","last_undegraded":"2024-04-22T19:55:34.684331+0000","last_fullsized":"2024-04-22T19:55:34.684331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153608+0000","last_change":"2024-04-22T19:54:15.367002+0000","last_active":"2024-04-22T19:55:35.153608+0000","last_peered":"2024-04-22T19:55:35.153608+0000","last_clean":"2024-04-22T19:55:35.153608+0000","last_became_active":"2024-04-22T19:54:15.363979+0000","last_became_peered":"2024-04-22T19:54:15.363979+0000","last_unstale":"2024-04-22T19:55:35.153608+0000","last_undegraded":"2024-04-22T19:55:35.153608+0000","last_fullsized":"2024-04-22T19:55:35.153608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684727+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:55:34.684727+0000","last_peered":"2024-04-22T19:55:34.684727+0000","last_clean":"2024-04-22T19:55:34.684727+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:55:34.684727+0000","last_undegraded":"2024-04-22T19:55:34.684727+0000","last_fullsized":"2024-04-22T19:55:34.684727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150011+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:55:35.150011+0000","last_peered":"2024-04-22T19:55:35.150011+0000","last_clean":"2024-04-22T19:55:35.150011+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:55:35.150011+0000","last_undegraded":"2024-04-22T19:55:35.150011+0000","last_fullsized":"2024-04-22T19:55:35.150011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.684951+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:55:34.684951+0000","last_peered":"2024-04-22T19:55:34.684951+0000","last_clean":"2024-04-22T19:55:34.684951+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:55:34.684951+0000","last_undegraded":"2024-04-22T19:55:34.684951+0000","last_fullsized":"2024-04-22T19:55:34.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692997+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:55:34.692997+0000","last_peered":"2024-04-22T19:55:34.692997+0000","last_clean":"2024-04-22T19:55:34.692997+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:55:34.692997+0000","last_undegraded":"2024-04-22T19:55:34.692997+0000","last_fullsized":"2024-04-22T19:55:34.692997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":79,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686996+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:55:34.686996+0000","last_peered":"2024-04-22T19:55:34.686996+0000","last_clean":"2024-04-22T19:55:34.686996+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:55:34.686996+0000","last_undegraded":"2024-04-22T19:55:34.686996+0000","last_fullsized":"2024-04-22T19:55:34.686996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685020+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:55:34.685020+0000","last_peered":"2024-04-22T19:55:34.685020+0000","last_clean":"2024-04-22T19:55:34.685020+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:55:34.685020+0000","last_undegraded":"2024-04-22T19:55:34.685020+0000","last_fullsized":"2024-04-22T19:55:34.685020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":70,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.690825+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:55:34.690825+0000","last_peered":"2024-04-22T19:55:34.690825+0000","last_clean":"2024-04-22T19:55:34.690825+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:55:34.690825+0000","last_undegraded":"2024-04-22T19:55:34.690825+0000","last_fullsized":"2024-04-22T19:55:34.690825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686573+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:55:34.686573+0000","last_peered":"2024-04-22T19:55:34.686573+0000","last_clean":"2024-04-22T19:55:34.686573+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:55:34.686573+0000","last_undegraded":"2024-04-22T19:55:34.686573+0000","last_fullsized":"2024-04-22T19:55:34.686573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691448+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:55:34.691448+0000","last_peered":"2024-04-22T19:55:34.691448+0000","last_clean":"2024-04-22T19:55:34.691448+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:55:34.691448+0000","last_undegraded":"2024-04-22T19:55:34.691448+0000","last_fullsized":"2024-04-22T19:55:34.691448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756614+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:55:34.756614+0000","last_peered":"2024-04-22T19:55:34.756614+0000","last_clean":"2024-04-22T19:55:34.756614+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:55:34.756614+0000","last_undegraded":"2024-04-22T19:55:34.756614+0000","last_fullsized":"2024-04-22T19:55:34.756614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691771+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:55:34.691771+0000","last_peered":"2024-04-22T19:55:34.691771+0000","last_clean":"2024-04-22T19:55:34.691771+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:55:34.691771+0000","last_undegraded":"2024-04-22T19:55:34.691771+0000","last_fullsized":"2024-04-22T19:55:34.691771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144796+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:55:35.144796+0000","last_peered":"2024-04-22T19:55:35.144796+0000","last_clean":"2024-04-22T19:55:35.144796+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:55:35.144796+0000","last_undegraded":"2024-04-22T19:55:35.144796+0000","last_fullsized":"2024-04-22T19:55:35.144796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147260+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:55:35.147260+0000","last_peered":"2024-04-22T19:55:35.147260+0000","last_clean":"2024-04-22T19:55:35.147260+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:55:35.147260+0000","last_undegraded":"2024-04-22T19:55:35.147260+0000","last_fullsized":"2024-04-22T19:55:35.147260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148074+0000","last_change":"2024-04-22T19:54:09.327430+0000","last_active":"2024-04-22T19:55:35.148074+0000","last_peered":"2024-04-22T19:55:35.148074+0000","last_clean":"2024-04-22T19:55:35.148074+0000","last_became_active":"2024-04-22T19:54:09.326527+0000","last_became_peered":"2024-04-22T19:54:09.326527+0000","last_unstale":"2024-04-22T19:55:35.148074+0000","last_undegraded":"2024-04-22T19:55:35.148074+0000","last_fullsized":"2024-04-22T19:55:35.148074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688440+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:55:34.688440+0000","last_peered":"2024-04-22T19:55:34.688440+0000","last_clean":"2024-04-22T19:55:34.688440+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:55:34.688440+0000","last_undegraded":"2024-04-22T19:55:34.688440+0000","last_fullsized":"2024-04-22T19:55:34.688440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691123+0000","last_change":"2024-04-22T19:54:09.326400+0000","last_active":"2024-04-22T19:55:34.691123+0000","last_peered":"2024-04-22T19:55:34.691123+0000","last_clean":"2024-04-22T19:55:34.691123+0000","last_became_active":"2024-04-22T19:54:09.326073+0000","last_became_peered":"2024-04-22T19:54:09.326073+0000","last_unstale":"2024-04-22T19:55:34.691123+0000","last_undegraded":"2024-04-22T19:55:34.691123+0000","last_fullsized":"2024-04-22T19:55:34.691123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.153328+0000","last_change":"2024-04-22T19:54:11.376169+0000","last_active":"2024-04-22T19:55:35.153328+0000","last_peered":"2024-04-22T19:55:35.153328+0000","last_clean":"2024-04-22T19:55:35.153328+0000","last_became_active":"2024-04-22T19:54:11.367472+0000","last_became_peered":"2024-04-22T19:54:11.367472+0000","last_unstale":"2024-04-22T19:55:35.153328+0000","last_undegraded":"2024-04-22T19:55:35.153328+0000","last_fullsized":"2024-04-22T19:55:35.153328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.154438+0000","last_change":"2024-04-22T19:54:09.348783+0000","last_active":"2024-04-22T19:55:35.154438+0000","last_peered":"2024-04-22T19:55:35.154438+0000","last_clean":"2024-04-22T19:55:35.154438+0000","last_became_active":"2024-04-22T19:54:09.348404+0000","last_became_peered":"2024-04-22T19:54:09.348404+0000","last_unstale":"2024-04-22T19:55:35.154438+0000","last_undegraded":"2024-04-22T19:55:35.154438+0000","last_fullsized":"2024-04-22T19:55:35.154438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.685831+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:55:34.685831+0000","last_peered":"2024-04-22T19:55:34.685831+0000","last_clean":"2024-04-22T19:55:34.685831+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:55:34.685831+0000","last_undegraded":"2024-04-22T19:55:34.685831+0000","last_fullsized":"2024-04-22T19:55:34.685831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691624+0000","last_change":"2024-04-22T19:54:09.323462+0000","last_active":"2024-04-22T19:55:34.691624+0000","last_peered":"2024-04-22T19:55:34.691624+0000","last_clean":"2024-04-22T19:55:34.691624+0000","last_became_active":"2024-04-22T19:54:09.323039+0000","last_became_peered":"2024-04-22T19:54:09.323039+0000","last_unstale":"2024-04-22T19:55:34.691624+0000","last_undegraded":"2024-04-22T19:55:34.691624+0000","last_fullsized":"2024-04-22T19:55:34.691624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:21.881686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151752+0000","last_change":"2024-04-22T19:54:11.361345+0000","last_active":"2024-04-22T19:55:35.151752+0000","last_peered":"2024-04-22T19:55:35.151752+0000","last_clean":"2024-04-22T19:55:35.151752+0000","last_became_active":"2024-04-22T19:54:11.360452+0000","last_became_peered":"2024-04-22T19:54:11.360452+0000","last_unstale":"2024-04-22T19:55:35.151752+0000","last_undegraded":"2024-04-22T19:55:35.151752+0000","last_fullsized":"2024-04-22T19:55:35.151752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.758154+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:55:34.758154+0000","last_peered":"2024-04-22T19:55:34.758154+0000","last_clean":"2024-04-22T19:55:34.758154+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:55:34.758154+0000","last_undegraded":"2024-04-22T19:55:34.758154+0000","last_fullsized":"2024-04-22T19:55:34.758154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.756528+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:55:34.756528+0000","last_peered":"2024-04-22T19:55:34.756528+0000","last_clean":"2024-04-22T19:55:34.756528+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:55:34.756528+0000","last_undegraded":"2024-04-22T19:55:34.756528+0000","last_fullsized":"2024-04-22T19:55:34.756528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.156781+0000","last_change":"2024-04-22T19:54:09.347666+0000","last_active":"2024-04-22T19:55:35.156781+0000","last_peered":"2024-04-22T19:55:35.156781+0000","last_clean":"2024-04-22T19:55:35.156781+0000","last_became_active":"2024-04-22T19:54:09.347242+0000","last_became_peered":"2024-04-22T19:54:09.347242+0000","last_unstale":"2024-04-22T19:55:35.156781+0000","last_undegraded":"2024-04-22T19:55:35.156781+0000","last_fullsized":"2024-04-22T19:55:35.156781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692920+0000","last_change":"2024-04-22T19:54:48.937383+0000","last_active":"2024-04-22T19:55:34.692920+0000","last_peered":"2024-04-22T19:55:34.692920+0000","last_clean":"2024-04-22T19:55:34.692920+0000","last_became_active":"2024-04-22T19:54:48.936500+0000","last_became_peered":"2024-04-22T19:54:48.936500+0000","last_unstale":"2024-04-22T19:55:34.692920+0000","last_undegraded":"2024-04-22T19:55:34.692920+0000","last_fullsized":"2024-04-22T19:55:34.692920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:44:26.714736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.146169+0000","last_change":"2024-04-22T19:54:09.337457+0000","last_active":"2024-04-22T19:55:35.146169+0000","last_peered":"2024-04-22T19:55:35.146169+0000","last_clean":"2024-04-22T19:55:35.146169+0000","last_became_active":"2024-04-22T19:54:09.336663+0000","last_became_peered":"2024-04-22T19:54:09.336663+0000","last_unstale":"2024-04-22T19:55:35.146169+0000","last_undegraded":"2024-04-22T19:55:35.146169+0000","last_fullsized":"2024-04-22T19:55:35.146169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687198+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:55:34.687198+0000","last_peered":"2024-04-22T19:55:34.687198+0000","last_clean":"2024-04-22T19:55:34.687198+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:55:34.687198+0000","last_undegraded":"2024-04-22T19:55:34.687198+0000","last_fullsized":"2024-04-22T19:55:34.687198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.152005+0000","last_change":"2024-04-22T19:54:09.347792+0000","last_active":"2024-04-22T19:55:35.152005+0000","last_peered":"2024-04-22T19:55:35.152005+0000","last_clean":"2024-04-22T19:55:35.152005+0000","last_became_active":"2024-04-22T19:54:09.347359+0000","last_became_peered":"2024-04-22T19:54:09.347359+0000","last_unstale":"2024-04-22T19:55:35.152005+0000","last_undegraded":"2024-04-22T19:55:35.152005+0000","last_fullsized":"2024-04-22T19:55:35.152005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147105+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:55:35.147105+0000","last_peered":"2024-04-22T19:55:35.147105+0000","last_clean":"2024-04-22T19:55:35.147105+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:55:35.147105+0000","last_undegraded":"2024-04-22T19:55:35.147105+0000","last_fullsized":"2024-04-22T19:55:35.147105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147971+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:55:35.147971+0000","last_peered":"2024-04-22T19:55:35.147971+0000","last_clean":"2024-04-22T19:55:35.147971+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:55:35.147971+0000","last_undegraded":"2024-04-22T19:55:35.147971+0000","last_fullsized":"2024-04-22T19:55:35.147971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.686313+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:55:34.686313+0000","last_peered":"2024-04-22T19:55:34.686313+0000","last_clean":"2024-04-22T19:55:34.686313+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:55:34.686313+0000","last_undegraded":"2024-04-22T19:55:34.686313+0000","last_fullsized":"2024-04-22T19:55:34.686313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.691269+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:55:34.691269+0000","last_peered":"2024-04-22T19:55:34.691269+0000","last_clean":"2024-04-22T19:55:34.691269+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:55:34.691269+0000","last_undegraded":"2024-04-22T19:55:34.691269+0000","last_fullsized":"2024-04-22T19:55:34.691269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.148781+0000","last_change":"2024-04-22T19:54:11.386080+0000","last_active":"2024-04-22T19:55:35.148781+0000","last_peered":"2024-04-22T19:55:35.148781+0000","last_clean":"2024-04-22T19:55:35.148781+0000","last_became_active":"2024-04-22T19:54:11.385436+0000","last_became_peered":"2024-04-22T19:54:11.385436+0000","last_unstale":"2024-04-22T19:55:35.148781+0000","last_undegraded":"2024-04-22T19:55:35.148781+0000","last_fullsized":"2024-04-22T19:55:35.148781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.757856+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:55:34.757856+0000","last_peered":"2024-04-22T19:55:34.757856+0000","last_clean":"2024-04-22T19:55:34.757856+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:55:34.757856+0000","last_undegraded":"2024-04-22T19:55:34.757856+0000","last_fullsized":"2024-04-22T19:55:34.757856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.688415+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:55:34.688415+0000","last_peered":"2024-04-22T19:55:34.688415+0000","last_clean":"2024-04-22T19:55:34.688415+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:55:34.688415+0000","last_undegraded":"2024-04-22T19:55:34.688415+0000","last_fullsized":"2024-04-22T19:55:34.688415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.150867+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:55:35.150867+0000","last_peered":"2024-04-22T19:55:35.150867+0000","last_clean":"2024-04-22T19:55:35.150867+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:55:35.150867+0000","last_undegraded":"2024-04-22T19:55:35.150867+0000","last_fullsized":"2024-04-22T19:55:35.150867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.151678+0000","last_change":"2024-04-22T19:54:11.347140+0000","last_active":"2024-04-22T19:55:35.151678+0000","last_peered":"2024-04-22T19:55:35.151678+0000","last_clean":"2024-04-22T19:55:35.151678+0000","last_became_active":"2024-04-22T19:54:11.345540+0000","last_became_peered":"2024-04-22T19:54:11.345540+0000","last_unstale":"2024-04-22T19:55:35.151678+0000","last_undegraded":"2024-04-22T19:55:35.151678+0000","last_fullsized":"2024-04-22T19:55:35.151678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.144882+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:55:35.144882+0000","last_peered":"2024-04-22T19:55:35.144882+0000","last_clean":"2024-04-22T19:55:35.144882+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:55:35.144882+0000","last_undegraded":"2024-04-22T19:55:35.144882+0000","last_fullsized":"2024-04-22T19:55:35.144882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145746+0000","last_change":"2024-04-22T19:54:11.384243+0000","last_active":"2024-04-22T19:55:35.145746+0000","last_peered":"2024-04-22T19:55:35.145746+0000","last_clean":"2024-04-22T19:55:35.145746+0000","last_became_active":"2024-04-22T19:54:11.383676+0000","last_became_peered":"2024-04-22T19:54:11.383676+0000","last_unstale":"2024-04-22T19:55:35.145746+0000","last_undegraded":"2024-04-22T19:55:35.145746+0000","last_fullsized":"2024-04-22T19:55:35.145746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147050+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:55:35.147050+0000","last_peered":"2024-04-22T19:55:35.147050+0000","last_clean":"2024-04-22T19:55:35.147050+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:55:35.147050+0000","last_undegraded":"2024-04-22T19:55:35.147050+0000","last_fullsized":"2024-04-22T19:55:35.147050+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.145981+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:55:35.145981+0000","last_peered":"2024-04-22T19:55:35.145981+0000","last_clean":"2024-04-22T19:55:35.145981+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:55:35.145981+0000","last_undegraded":"2024-04-22T19:55:35.145981+0000","last_fullsized":"2024-04-22T19:55:35.145981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":82,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.692846+0000","last_change":"2024-04-22T19:54:11.341482+0000","last_active":"2024-04-22T19:55:34.692846+0000","last_peered":"2024-04-22T19:55:34.692846+0000","last_clean":"2024-04-22T19:55:34.692846+0000","last_became_active":"2024-04-22T19:54:11.341075+0000","last_became_peered":"2024-04-22T19:54:11.341075+0000","last_unstale":"2024-04-22T19:55:34.692846+0000","last_undegraded":"2024-04-22T19:55:34.692846+0000","last_fullsized":"2024-04-22T19:55:34.692846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:34.687307+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:55:34.687307+0000","last_peered":"2024-04-22T19:55:34.687307+0000","last_clean":"2024-04-22T19:55:34.687307+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:55:34.687307+0000","last_undegraded":"2024-04-22T19:55:34.687307+0000","last_fullsized":"2024-04-22T19:55:34.687307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":81,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-22T19:55:35.147973+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:55:35.147973+0000","last_peered":"2024-04-22T19:55:35.147973+0000","last_clean":"2024-04-22T19:55:35.147973+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:55:35.147973+0000","last_undegraded":"2024-04-22T19:55:35.147973+0000","last_fullsized":"2024-04-22T19:55:35.147973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1335296,"data_stored":960042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":360762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":370399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":368076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":361594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":369133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":368828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":959012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:55:38.989 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-22T19:55:38.989 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:55:38.989 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-22T19:55:38.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-22T19:55:39.023 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:39.023+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:39.095 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:39.120 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:39.120 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:39.121 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:39.121 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:39.121 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:39.121 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:39.119+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:39.142 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:39.231 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:39.231+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:39.294 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:39.295 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:39.305 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:39.303+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:39.325 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:39.325 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:39.356 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:39.356 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:39.370 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:39.370 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:39.387 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:39.387 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:39.389 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:39.420 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:39.420 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:39.420 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:39.419+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:39.460 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:39.460 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:39.495 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:39.507 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:39.507+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:39.528 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:39.528 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:39.532 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 63, 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "fsid": "ac92bbc9-e567-4064-a7f4-2e610e35d3cc", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "created": "2024-04-22T19:53:42.573687+0000", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "modified": "2024-04-22T19:55:38.733105+0000", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "last_up_change": "2024-04-22T19:53:54.653127+0000", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "last_in_change": "2024-04-22T19:53:45.731500+0000", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_num": 5799936, 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_set": [ 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "pglog_hardlimit", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "purged_snapdirs", 2024-04-22T19:55:39.533 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_deletes", 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "sortbitwise" 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_version": 4, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "full_ratio": 0.94999998807907104, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_snapshot": "", 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_max": 8, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "max_osd": 8, 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "require_min_compat_client": "luminous", 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "min_compat_client": "luminous", 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "require_osd_release": "squid", 2024-04-22T19:55:39.534 INFO:teuthology.orchestra.run.smithi111.stdout: "allow_crimson": false, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "pools": [ 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 1, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": ".mgr", 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:53:55.362814+0000", 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.535 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 1, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 1, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 1, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 1, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 1, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "16", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.537 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.538 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_max": 32, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_min": 1 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.539 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": {} 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 8, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 8, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 0.25, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 2, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 2, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 2, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "rbd", 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:01.541706+0000", 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.541 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 8, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 8, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 8, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 8, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 8, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.542 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "19", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.543 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.544 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.545 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd": {} 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.9900000095367432, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.9900000095367432, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 0.87999999523162842, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 3, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.buckets.data", 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:07.985692+0000", 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.547 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 64, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 64, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 64, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 64, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 64, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.548 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "22", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.549 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.550 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.551 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.3799999952316284, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.3799999952316284, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.3799999952316284, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.3799999952316284, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.552 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 4, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.buckets.index", 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:09.656252+0000", 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.553 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 64, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 64, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 64, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 64, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 64, 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.554 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "24", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.555 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.556 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.557 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 2, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 2, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 2, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 2, 2024-04-22T19:55:39.558 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 5, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": ".rgw.root", 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:11.591758+0000", 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.559 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.560 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "26", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.561 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.562 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.563 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.25, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.25, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.25, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.25, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 6, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.log", 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:13.498929+0000", 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.565 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.566 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "28", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.567 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.568 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.569 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.75, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.75, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.570 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 7, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.control", 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:15.382119+0000", 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.571 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.572 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "30", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.573 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.574 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.575 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.75, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.75, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.576 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 8, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.meta", 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:17.508620+0000", 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:55:39.577 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:55:39.578 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "32", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:55:39.579 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:55:39.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_bias": 4 2024-04-22T19:55:39.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.5, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.5, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.5, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.5, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:55:39.582 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "osds": [ 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "996ea3c2-f75d-41f0-9267-69befdc4ab4d", 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.583 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 39, 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6824", 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6825", 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.584 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6826", 2024-04-22T19:55:39.585 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6827", 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6830", 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6831", 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6828", 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6829", 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6825/1848271487", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6827/1848271487", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6831/1848271487", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6829/1848271487", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "277fd7fa-608c-48e4-800d-c26294428dd8", 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.589 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6810", 2024-04-22T19:55:39.590 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6813", 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.591 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6816", 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6819", 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.592 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6822", 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6823", 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6820", 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6821", 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6813/1193123721", 2024-04-22T19:55:39.594 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6819/1193123721", 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6823/1193123721", 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6821/1193123721", 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "bac442e5-3a55-4562-8665-70da37ab5ff7", 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.595 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 39, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6800", 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6801", 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6802", 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.597 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6803", 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6806", 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6807", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6804", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6805", 2024-04-22T19:55:39.599 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6801/2226119870", 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6803/2226119870", 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6807/2226119870", 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6805/2226119870", 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "3195716c-c2fb-4f8d-916a-dc0525a8c456", 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.601 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6808", 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6809", 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6811", 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6812", 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6817", 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6818", 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.604 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6814", 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6815", 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.605 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6809/4032621477", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6812/4032621477", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6818/4032621477", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6815/4032621477", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 4, 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "cbf466e6-386f-4838-ad24-52702ac92370", 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.606 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6800", 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6801", 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6802", 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6803", 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6806", 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6807", 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6804", 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6805", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6801/1643232987", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6803/1643232987", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6807/1643232987", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6805/1643232987", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.611 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 5, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "5813db8d-fb71-4489-af1f-2e8223206f66", 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.612 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6808", 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6809", 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6810", 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6811", 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6814", 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6815", 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6812", 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6813", 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6809/1294966407", 2024-04-22T19:55:39.616 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6811/1294966407", 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6815/1294966407", 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6813/1294966407", 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 6, 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "4117bfb9-ad8e-4b51-a9e0-f858a7402a5b", 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.617 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6824", 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6825", 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6826", 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6827", 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6830", 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6831", 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6828", 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6829", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6825/2579086149", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6827/2579086149", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6831/2579086149", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6829/2579086149", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 7, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "a91542a5-1ccd-4fb1-95be-7d51aa24f193", 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:55:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6816", 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6817", 2024-04-22T19:55:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6818", 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6819", 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6822", 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6823", 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6820", 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6821", 2024-04-22T19:55:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6817/1077004569", 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6819/1077004569", 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6823/1077004569", 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6821/1077004569", 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:55:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_xinfo": [ 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:50.775866+0000", 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-22T19:55:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.087145+0000", 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-22T19:55:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.270011+0000", 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.250163+0000", 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 4, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.201467+0000", 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 5, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.185857+0000", 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 6, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:50.789318+0000", 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 7, 2024-04-22T19:55:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.273134+0000", 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap": [], 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap_items": [ 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.21", 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 5, 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 1 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.2f", 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 5, 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.37", 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 7, 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.38", 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 3, 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:55:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "4.f", 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 1, 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "4.2f", 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 3, 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 5 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap_primaries": [], 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_temp": [], 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_temp": [], 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "blocklist": {}, 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "range_blocklist": {}, 2024-04-22T19:55:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profiles": { 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "default": { 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "crush-failure-domain": "osd", 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "k": "2", 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "m": "1", 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "plugin": "jerasure", 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "technique": "reed_sol_van" 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps_queue": [], 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "new_removed_snaps": [], 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "new_purged_snaps": [], 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_node_flags": {}, 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "device_class_flags": {}, 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode": { 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_enabled": false, 2024-04-22T19:55:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_bucket_count": 0, 2024-04-22T19:55:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "degraded_stretch_mode": 0, 2024-04-22T19:55:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "recovering_stretch_mode": 0, 2024-04-22T19:55:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_bucket": 0 2024-04-22T19:55:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:39.641 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:39.644 INFO:tasks.thrashosds.thrasher:j is {'epoch': 63, 'fsid': 'ac92bbc9-e567-4064-a7f4-2e610e35d3cc', 'created': '2024-04-22T19:53:42.573687+0000', 'modified': '2024-04-22T19:55:38.733105+0000', 'last_up_change': '2024-04-22T19:53:54.653127+0000', 'last_in_change': '2024-04-22T19:53:45.731500+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T19:53:55.362814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-22T19:54:01.541706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-04-22T19:54:07.985692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-04-22T19:54:09.656252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-04-22T19:54:11.591758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-04-22T19:54:13.498929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-04-22T19:54:15.382119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-04-22T19:54:17.508620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '996ea3c2-f75d-41f0-9267-69befdc4ab4d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6824', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6825', 'nonce': 1848271487}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6826', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6827', 'nonce': 1848271487}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6830', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6831', 'nonce': 1848271487}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6828', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6829', 'nonce': 1848271487}]}, 'public_addr': '172.21.15.111:6825/1848271487', 'cluster_addr': '172.21.15.111:6827/1848271487', 'heartbeat_back_addr': '172.21.15.111:6831/1848271487', 'heartbeat_front_addr': '172.21.15.111:6829/1848271487', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '277fd7fa-608c-48e4-800d-c26294428dd8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6810', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6813', 'nonce': 1193123721}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6816', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 1193123721}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6822', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6823', 'nonce': 1193123721}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6820', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6821', 'nonce': 1193123721}]}, 'public_addr': '172.21.15.111:6813/1193123721', 'cluster_addr': '172.21.15.111:6819/1193123721', 'heartbeat_back_addr': '172.21.15.111:6823/1193123721', 'heartbeat_front_addr': '172.21.15.111:6821/1193123721', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bac442e5-3a55-4562-8665-70da37ab5ff7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 2226119870}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 2226119870}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 2226119870}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 2226119870}]}, 'public_addr': '172.21.15.111:6801/2226119870', 'cluster_addr': '172.21.15.111:6803/2226119870', 'heartbeat_back_addr': '172.21.15.111:6807/2226119870', 'heartbeat_front_addr': '172.21.15.111:6805/2226119870', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3195716c-c2fb-4f8d-916a-dc0525a8c456', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6808', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6809', 'nonce': 4032621477}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6811', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6812', 'nonce': 4032621477}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6817', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 4032621477}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6814', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6815', 'nonce': 4032621477}]}, 'public_addr': '172.21.15.111:6809/4032621477', 'cluster_addr': '172.21.15.111:6812/4032621477', 'heartbeat_back_addr': '172.21.15.111:6818/4032621477', 'heartbeat_front_addr': '172.21.15.111:6815/4032621477', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbf466e6-386f-4838-ad24-52702ac92370', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6800', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6801', 'nonce': 1643232987}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6802', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6803', 'nonce': 1643232987}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6806', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6807', 'nonce': 1643232987}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6804', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6805', 'nonce': 1643232987}]}, 'public_addr': '172.21.15.138:6801/1643232987', 'cluster_addr': '172.21.15.138:6803/1643232987', 'heartbeat_back_addr': '172.21.15.138:6807/1643232987', 'heartbeat_front_addr': '172.21.15.138:6805/1643232987', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5813db8d-fb71-4489-af1f-2e8223206f66', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6808', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6809', 'nonce': 1294966407}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6810', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6811', 'nonce': 1294966407}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6814', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6815', 'nonce': 1294966407}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6812', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6813', 'nonce': 1294966407}]}, 'public_addr': '172.21.15.138:6809/1294966407', 'cluster_addr': '172.21.15.138:6811/1294966407', 'heartbeat_back_addr': '172.21.15.138:6815/1294966407', 'heartbeat_front_addr': '172.21.15.138:6813/1294966407', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4117bfb9-ad8e-4b51-a9e0-f858a7402a5b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6824', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6825', 'nonce': 2579086149}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6826', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6827', 'nonce': 2579086149}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6830', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6831', 'nonce': 2579086149}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6828', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6829', 'nonce': 2579086149}]}, 'public_addr': '172.21.15.138:6825/2579086149', 'cluster_addr': '172.21.15.138:6827/2579086149', 'heartbeat_back_addr': '172.21.15.138:6831/2579086149', 'heartbeat_front_addr': '172.21.15.138:6829/2579086149', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a91542a5-1ccd-4fb1-95be-7d51aa24f193', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6816', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6817', 'nonce': 1077004569}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6818', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6819', 'nonce': 1077004569}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6822', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6823', 'nonce': 1077004569}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6820', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6821', 'nonce': 1077004569}]}, 'public_addr': '172.21.15.138:6817/1077004569', 'cluster_addr': '172.21.15.138:6819/1077004569', 'heartbeat_back_addr': '172.21.15.138:6823/1077004569', 'heartbeat_front_addr': '172.21.15.138:6821/1077004569', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:50.775866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.087145+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.270011+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.250163+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.201467+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.185857+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:50.789318+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.273134+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.2f', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.37', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.38', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.2f', 'mappings': [{'from': 3, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-22T19:55:39.644 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.38 2024-04-22T19:55:39.644 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.38 2024-04-22T19:55:39.645 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:39.645 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:39.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:39.646 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:39.639+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:39.743 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:39.743+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:39.845 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:39.843+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:39.855 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:39.855 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:39.875 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:39.963 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:39.963+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:40.046 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:40.047+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:40.088 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.088 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:40.153 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:40.151+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.248 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:40.243+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:40.252 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:40.348 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:40.347+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.432 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:40.477 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:40.475+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:40.551 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:40.551+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:40.651 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:40.651+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:40.740 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.740 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.752 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:40.747+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:40.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:40.759 INFO:teuthology.orchestra.run.smithi111.stderr:clear 3.38 pg_upmap_items mapping 2024-04-22T19:55:40.775 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:55:40.853 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:40.851+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:40.920 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:40.921 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:40.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:40.978 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:40.975+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:41.054 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:41.051+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.112 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:41.157 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:41.151+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:41.256 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:41.255+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:41.278 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.278 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.293 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:41.357 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:41.355+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:41.410 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.410 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:41.458 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:41.455+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:41.552 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.552 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.559 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:41.559+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:41.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:41.643 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:41.660 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:41.655+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:41.687 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.687 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.702 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:41.761 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:41.759+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:41.781 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:55:41.844 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:41.844 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:41.861 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:41.859+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:41.866 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:41.866 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:41.874 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:41.875 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:41.880 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:41.905 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:41.935 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:41.935 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:41.962 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:41.959+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:41.965 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:41.965 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:41.997 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:41.998 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:42.008 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:42.008 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:42.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:42.030 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:42.030 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:42.061 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:42.061 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:42.063 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:42.063+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:42.165 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:42.158+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:42.193 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:42.193 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:42.193 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:42.193 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:42.210 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:42.265 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:42.266+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:42.366 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:42.363+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:42.377 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:42.377 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:42.377 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:42.378 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:42.378 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:42.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:42.483 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:42.483+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:42.569 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:42.562+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.88064775700001, 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.608 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:42.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:42.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:42.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.843567393, 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.612 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:42.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.842634804, 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.616 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:42.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:42.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:42.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.841411874, 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:42.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.624 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.839643667, 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:42.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.628 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.660950629, 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.659931306, 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:42.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.647229201, 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:42.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.41571279999999, 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.40827083000001, 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:42.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.195348030999995, 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.649 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.237343230999997, 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:42.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.217516688000003, 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.660 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:42.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:42.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:42.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.665 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.187109507000002, 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:42.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:42.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:42.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.171282005999998, 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.671 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:42.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.676 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.142836032000005, 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:42.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.682 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.124219267000001, 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:42.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:42.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:42.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.070163201, 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:42.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.651686768000005, 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.694 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:42.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:42.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.093878795999998, 2024-04-22T19:55:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:42.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:42.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:42.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:42.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:42.705 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:42.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:42.707 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:42.703+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:42.808 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:42.806+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:42.908 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:42.907+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:42.918 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:42.918 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:42.918 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:42.919 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:42.936 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:43.009 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:43.010+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:43.110 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:43.106+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:43.146 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:43.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:43.165 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:43.211 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:43.206+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:43.312 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:43.306+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:43.335 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.986475146999993, 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.947600655000002, 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.942523344999998, 2024-04-22T19:55:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.941865106999998, 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.935088140000005, 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.840409644999994, 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.359 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.955927157000005, 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.936768224999994, 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.910658940000005, 2024-04-22T19:55:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.891938713000002, 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.858720184000006, 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.830678148999993, 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.815169496999999, 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.804819707999997, 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.771244883999998, 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.414 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.480028762000003, 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.39328098, 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.332264987000002, 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:43.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.178574307999995, 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.430 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:43.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:43.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.112437959000005, 2024-04-22T19:55:43.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:43.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:43.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:43.442 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:43.444 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:43.444 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:43.442+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:43.545 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:43.538+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:43.645 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:43.642+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:43.655 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:43.655 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:43.673 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:43.747 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:43.746+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:43.820 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:55:43.842 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:43.842 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:43.842 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:43.842 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:43.843 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:43.848 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:43.846+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:43.862 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:43.951 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:43.950+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:44.050 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:44.050+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.665872661999998, 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:44.079 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.650495676000006, 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:55:44.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:55:44.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:55:44.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.674368559000001, 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:55:44.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:55:44.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:55:44.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.664996106000004, 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:55:44.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:55:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:55:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.586612215000002, 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.095 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:55:44.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:55:44.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:55:44.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.100 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.272142011, 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.268566452000002, 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:55:44.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.233024215, 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:55:44.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:55:44.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.117 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.104814648000001, 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:55:44.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.101159448999994, 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:55:44.123 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.049890254000005, 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:55:44.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:44.134 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.046053728999993, 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:55:44.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.036342075999997, 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:55:44.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.032854444999998, 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.146 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:55:44.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:44.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.990147311000001, 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:44.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:55:44.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.986227111999995, 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.157 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:55:44.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:55:44.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:55:44.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.903925185000006, 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.163 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:55:44.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:55:44.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:55:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:55:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.900212746999998, 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:55:44.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:55:44.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.810333808999999, 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:55:44.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:55:44.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.797117205000006, 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:55:44.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:44.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:44.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:44.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:44.184 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:44.185 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:44.186 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:44.187 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:44.182+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:44.286 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:44.282+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:44.388 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:44.386+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:44.397 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:44.397 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:44.418 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:44.425 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:44.426 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:44.456 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:44.456 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:44.486 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:44.486 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:44.489 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:44.482+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:44.517 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:44.517 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:44.550 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:44.550 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:44.583 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:44.583 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:44.589 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:44.586+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:44.595 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:44.596 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:44.613 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:44.615 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:44.616 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:44.649 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:44.649 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:44.690 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:44.690+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:44.783 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:44.784 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:44.791 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:44.786+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:44.803 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:55:44.804 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:44.892 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:44.890+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:44.934 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:44.934 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:44.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:44.997 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:44.994+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:45.072 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.072 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.086 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:45.094 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:45.090+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:45.195 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:45.190+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:45.255 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.256 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:45.296 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:45.294+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:45.397 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:45.390+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:45.439 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.439 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.454 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:45.501 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:45.502+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:45.598 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:45.594+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:45.626 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.627 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:45.699 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:45.698+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:45.759 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.759 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.773 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:45.800 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:45.798+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:45.896 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:45.896 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:45.900 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:45.898+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:45.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:46.001 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:45.998+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:46.031 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:46.031 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:46.046 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:46.102 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:46.098+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:46.202 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:46.198+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:46.213 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:46.213 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:46.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:46.303 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:46.302+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:46.348 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:46.348 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:46.364 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:46.405 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:46.406+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:46.505 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:46.506+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:46.526 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:46.526 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:46.540 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:46.625 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:46.626+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:46.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:46.706 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:46.706 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:46.707 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:46.706+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:46.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:46.807 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:46.806+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:46.828 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:55:46.888 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:46.888 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:46.898 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:46.899 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:46.899 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:46.899 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:46.908 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:46.906+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:46.919 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:46.919 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:46.919 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:46.950 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:46.950 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:46.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:46.980 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:47.009 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:47.010+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:47.015 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:47.015 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:47.048 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:47.048 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:47.074 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:47.075 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:47.089 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:47.089 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:47.089 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:47.089 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:47.089 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:47.095 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:47.096 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:47.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:47.110 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:47.106+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:47.211 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:47.210+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:47.265 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.538261627, 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.266 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.50118126300001, 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.50024867400001, 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.274 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:47.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.49902574399999, 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.282 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.497257537, 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:47.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.318564499, 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:47.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.290 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.317545176, 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:47.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.30484307099999, 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:47.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:47.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:47.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.07332667, 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.299 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:47.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:47.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.0658847, 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.303 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:47.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:47.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.852961901, 2024-04-22T19:55:47.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:47.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.894957101000003, 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:47.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.875130557999995, 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:47.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:47.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.844723376999994, 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:47.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.329 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.828895876000004, 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:47.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:47.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:47.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:47.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.800449901999997, 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.335 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:47.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:47.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:47.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:47.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.340 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.781833137000007, 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:47.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:47.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.727777071000006, 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:47.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.309300637999996, 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.352 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.751492665999997, 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:47.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:47.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:47.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:47.363 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:47.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:47.365 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:47.362+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:47.465 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:47.462+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:47.566 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:47.566+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:47.574 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:47.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:47.574 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:47.575 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:47.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:47.667 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:47.666+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:47.768 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:47.766+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:47.801 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:47.801 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:47.801 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:47.801 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:47.801 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:47.818 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:47.868 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:47.866+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:55:47.969 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:47.970+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:48.032 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:48.032 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:48.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.683493364, 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:48.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:48.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.644618871999995, 2024-04-22T19:55:48.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.639541562000005, 2024-04-22T19:55:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:48.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:48.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:48.045 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.638883324000005, 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:48.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:48.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.632106356999998, 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.050 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:48.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.537427862000001, 2024-04-22T19:55:48.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:48.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.652945373999998, 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:48.060 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:48.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:48.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:48.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.633786442000002, 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.066 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.607677156999998, 2024-04-22T19:55:48.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.588956929999995, 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.555738400999999, 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.527696366000001, 2024-04-22T19:55:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.512187714000007, 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.501837925000004, 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.468263101000005, 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.177046978999996, 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.090299196999993, 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.029283203999995, 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.875592525000002, 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.809456175999998, 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.138 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:48.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:48.140 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:48.138+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:48.240 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:48.238+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:48.341 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:48.342+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:48.350 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:48.350 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:48.350 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:48.350 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:48.367 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:48.442 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:48.438+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:48.534 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:48.534 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:48.534 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:48.534 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:48.534 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:48.543 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:48.542+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:48.552 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:48.643 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:48.642+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:48.745 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:48.742+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:48.764 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.356645592999996, 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:55:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:55:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:55:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:55:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.341268607000003, 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:55:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.365141489999999, 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:55:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:55:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:55:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.355769037000002, 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:55:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.277385146, 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:55:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.962914941999998, 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:55:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:55:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:55:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.959339383, 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:55:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.923797145999998, 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:55:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.795587578999999, 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:55:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:55:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.791932380000006, 2024-04-22T19:55:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:55:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:55:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.740663185000002, 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:55:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:55:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:55:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.736826660000006, 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:55:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.727115006999995, 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.723627375999996, 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.680920241999999, 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:55:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:55:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:55:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.677000043000007, 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.594698116000004, 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:55:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:55:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.590985677999996, 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:55:48.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:55:48.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:55:48.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.501106739999997, 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:55:48.867 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:55:48.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:55:48.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.487890136000004, 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:48.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:48.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:48.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:48.879 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:48.882 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:48.883 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:48.878+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:48.981 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:48.978+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:49.082 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:49.082+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:49.091 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:49.091 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:49.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:49.092 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:49.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:49.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:49.195 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:49.194+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:49.284 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:49.282+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:49.320 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:49.320 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:49.320 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:49.320 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:49.320 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:49.338 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:49.350 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:49.350 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:49.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:49.381 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:49.385 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:49.386+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:49.411 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:49.411 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:49.442 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:49.442 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:49.474 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:49.474 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:49.486 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:49.482+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:49.506 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:49.507 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:49.527 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:49.528 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:49.539 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:49.539 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:49.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:49.572 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:49.573 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:49.594 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:49.594+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:49.676 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:49.676 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:49.688 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:49.686+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:49.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:49.789 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:49.790+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:49.849 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:49.849 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:49.863 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:49.890 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:49.886+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:49.963 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:55:49.991 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:49.990+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:50.029 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.029 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:50.129 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:50.130+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:50.192 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:50.190+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:50.208 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.209 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.223 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:50.292 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:50.290+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:50.391 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.391 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.392 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:50.390+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:50.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:50.493 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:50.494+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:50.524 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.524 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.538 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:50.595 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:50.594+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:50.696 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:50.694+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:50.706 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.706 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:50.797 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:50.794+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:50.841 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.841 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.855 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:50.901 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:50.902+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:50.937 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:55:50.980 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:50.980 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:50.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:51.011 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:51.010+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:51.100 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:51.098+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:51.159 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:51.159 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:51.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:51.217 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:51.218+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:51.302 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:51.302+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:51.337 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:51.337 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:51.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:51.402 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:51.398+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:51.503 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:51.502+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:51.518 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:51.518 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:51.532 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:51.594 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:51.604 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:51.602+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:51.702 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:51.702 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:51.705 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:51.702+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:51.720 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:51.793 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:51.794 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:51.805 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:51.806+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:51.824 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:51.824 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:51.854 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:51.854 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:51.884 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:51.884 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:51.892 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:51.892 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:51.892 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:51.892 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:51.892 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:51.906 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:51.906+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:51.910 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:51.917 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:51.917 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:51.954 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:51.954 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:51.986 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:51.986 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:52.007 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:52.002+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:52.019 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:52.019 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:52.083 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:52.083 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:30 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'16, mlcod=15'14)", 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.356171097, 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026381989999999999, 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:52.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726053+0000", 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726054+0000", 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7230000000000001e-06 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726088+0000", 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4133e-05 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726116+0000", 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.798e-05 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726130+0000", 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726279+0000", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148472 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.726318+0000", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9100000000000002e-05 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728611+0000", 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022926890000000001 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.728691+0000", 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0055999999999994e-05 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:53 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'29)", 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.319090733, 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034571990000000002, 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763133+0000", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763134+0000", 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.266e-06 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763143+0000", 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5539999999999998e-06 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763164+0000", 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1172999999999999e-05 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763180+0000", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5886999999999999e-05 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763327+0000", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000146718 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.763367+0000", 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0819999999999999e-05 2024-04-22T19:55:52.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766498+0000", 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031309089999999999 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766590+0000", 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1872000000000004e-05 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.31815814399999, 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028912740000000001, 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764066+0000", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764067+0000", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2240000000000001e-06 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764098+0000", 2024-04-22T19:55:52.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0985999999999998e-05 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764116+0000", 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8272999999999999e-05 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764131+0000", 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4686e-05 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764259+0000", 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128699 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.764296+0000", 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6276999999999998e-05 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766873+0000", 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025776330000000002 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.766957+0000", 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3496000000000002e-05 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.316935214, 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079059400000000002, 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765288+0000", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765290+0000", 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2500000000000001e-06 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765458+0000", 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000167923 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765479+0000", 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0876000000000001e-05 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765494+0000", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5787e-05 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765612+0000", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118022 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.765646+0000", 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3433000000000003e-05 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773126+0000", 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074797290000000001 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.773194+0000", 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8919999999999997e-05 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'29)", 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.315167007, 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078643759999999993, 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767057+0000", 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767058+0000", 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767066+0000", 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767085+0000", 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9525999999999999e-05 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767101+0000", 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-05 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767217+0000", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000115563 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.767262+0000", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5399999999999999e-05 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774834+0000", 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075720249999999996 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.774921+0000", 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6998999999999998e-05 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'71)", 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.13647396899999, 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036291050000000001, 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945750+0000", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6499999999999999e-07 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945757+0000", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4899999999999997e-06 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945772+0000", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.535e-05 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945780+0000", 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6669999999999996e-06 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945832+0000", 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2379000000000001e-05 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.945850+0000", 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8074999999999999e-05 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949210+0000", 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033594139999999998 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.949379+0000", 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016906500000000001 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.110 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.135454646, 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003390119, 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.111 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946769+0000", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946770+0000", 2024-04-22T19:55:52.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8299999999999997e-07 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946848+0000", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8288000000000007e-05 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946859+0000", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1116e-05 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946865+0000", 2024-04-22T19:55:52.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6470000000000003e-06 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946920+0000", 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4988999999999998e-05 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.946938+0000", 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950072+0000", 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031341799999999999 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.950159+0000", 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7182999999999995e-05 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:120 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'82, mlcod=15'78)", 2024-04-22T19:55:52.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 115.122752541, 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026611479999999999, 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959471+0000", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959472+0000", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9599999999999999e-07 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959558+0000", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6081999999999993e-05 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959587+0000", 2024-04-22T19:55:52.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9113000000000001e-05 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959610+0000", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2932999999999999e-05 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959691+0000", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1281999999999999e-05 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.959708+0000", 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6421000000000001e-05 2024-04-22T19:55:52.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962019+0000", 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023116090000000001 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:56.962132+0000", 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011301199999999999 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'93)", 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 114.89123614, 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002794366, 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190988+0000", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190989+0000", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.190995+0000", 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5699999999999998e-06 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191010+0000", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4715000000000001e-05 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191035+0000", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4746e-05 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191091+0000", 2024-04-22T19:55:52.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6867999999999998e-05 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.191105+0000", 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.397e-05 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193710+0000", 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026045209999999998 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.193782+0000", 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2015999999999996e-05 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4201.0:144 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'102, mlcod=15'98)", 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 114.88379417, 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002892478, 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198430+0000", 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198431+0000", 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.404e-06 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198537+0000", 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106486 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198555+0000", 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689e-05 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198566+0000", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1267000000000001e-05 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198785+0000", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021886200000000001 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.198861+0000", 2024-04-22T19:55:52.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6012000000000003e-05 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201223+0000", 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002361756 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:53:57.201322+0000", 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9001999999999998e-05 2024-04-22T19:55:52.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.670871371000004, 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026389550000000001, 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 60 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411352+0000", 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411356+0000", 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119999999999999e-06 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411366+0000", 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-05 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411395+0000", 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8858999999999999e-05 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411410+0000", 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4960000000000001e-05 2024-04-22T19:55:52.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411546+0000", 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013637400000000001 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411801+0000", 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025496699999999999 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:52.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.412057+0000", 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000255708 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413395+0000", 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001337829 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413879+0000", 2024-04-22T19:55:52.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000483797 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413941+0000", 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2224999999999995e-05 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.413991+0000", 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0534000000000001e-05 2024-04-22T19:55:52.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.712866571000006, 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042940060000000004, 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 206 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369357+0000", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369360+0000", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.993e-06 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369374+0000", 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4202999999999999e-05 2024-04-22T19:55:52.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369406+0000", 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1256e-05 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369422+0000", 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6158999999999999e-05 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.369739+0000", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031746200000000002 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370122+0000", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038293700000000002 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.370865+0000", 2024-04-22T19:55:52.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00074276599999999996 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.372702+0000", 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018375080000000001 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373437+0000", 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000734361 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373526+0000", 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8764000000000006e-05 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373651+0000", 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125597 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.693040027999999, 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042999090000000002, 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 210 2024-04-22T19:55:52.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389184+0000", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389186+0000", 2024-04-22T19:55:52.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.61e-06 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389199+0000", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.257e-05 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389231+0000", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2191999999999999e-05 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389246+0000", 2024-04-22T19:55:52.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5247e-05 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389361+0000", 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114907 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389564+0000", 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202377 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:52.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.389940+0000", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037647400000000001 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.391561+0000", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00162046 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393285+0000", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017244739999999999 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393369+0000", 2024-04-22T19:55:52.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4254999999999999e-05 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.393484+0000", 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114343 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.662632846999998, 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003797122, 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.148 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419591+0000", 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419594+0000", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7369999999999998e-06 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419605+0000", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1653e-05 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419635+0000", 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9295999999999999e-05 2024-04-22T19:55:52.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419650+0000", 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5113000000000001e-05 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419775+0000", 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012560300000000001 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.419996+0000", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.420400+0000", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040469900000000001 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.422001+0000", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016010309999999999 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423128+0000", 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001127046 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423280+0000", 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015183899999999999 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423388+0000", 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107791 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.646805345999994, 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030084259999999998, 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 222 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435418+0000", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435421+0000", 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4360000000000001e-06 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435432+0000", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435464+0000", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1259e-05 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435479+0000", 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5044e-05 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435599+0000", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012017 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.435818+0000", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021919999999999999 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.436254+0000", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043637899999999998 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.437855+0000", 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001600377 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438277+0000", 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042255899999999998 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438364+0000", 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6397000000000006e-05 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.438427+0000", 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3134999999999998e-05 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.618359372, 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003180488, 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 230 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463864+0000", 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463866+0000", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1430000000000001e-06 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463878+0000", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1416e-05 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463909+0000", 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0613e-05 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463924+0000", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5418999999999999e-05 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464049+0000", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124654 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464284+0000", 2024-04-22T19:55:52.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023511300000000001 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.464748+0000", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046396799999999999 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466139+0000", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001391233 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466900+0000", 2024-04-22T19:55:52.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076110900000000005 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.466982+0000", 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1828000000000003e-05 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467045+0000", 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2991999999999996e-05 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.599742606999996, 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029145920000000001, 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 235 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482481+0000", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482483+0000", 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.227e-06 2024-04-22T19:55:52.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482495+0000", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1469e-05 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482526+0000", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1043000000000001e-05 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482541+0000", 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5065999999999999e-05 2024-04-22T19:55:52.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482651+0000", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110337 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.482868+0000", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216591 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.483298+0000", 2024-04-22T19:55:52.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043043500000000001 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.484689+0000", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013903699999999999 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485230+0000", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054102900000000005 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485324+0000", 2024-04-22T19:55:52.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4253999999999996e-05 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485396+0000", 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1771000000000001e-05 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:412 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.545686540999995, 2024-04-22T19:55:52.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003083091, 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 412 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536537+0000", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536538+0000", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.251e-06 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536544+0000", 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0410000000000003e-06 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536558+0000", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3834e-05 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536566+0000", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7270000000000007e-06 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536621+0000", 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4487999999999997e-05 2024-04-22T19:55:52.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536717+0000", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6223000000000004e-05 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.536862+0000", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144895 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.538442+0000", 2024-04-22T19:55:52.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001580407 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539556+0000", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011140600000000001 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539591+0000", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5068999999999999e-05 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.539620+0000", 2024-04-22T19:55:52.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9096000000000001e-05 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.127210108, 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002638236, 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.176 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955014+0000", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955016+0000", 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4030000000000001e-06 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955027+0000", 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1375999999999999e-05 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955058+0000", 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0471999999999999e-05 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955073+0000", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5227e-05 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955252+0000", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017909800000000001 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955469+0000", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021667400000000001 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:52.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.955708+0000", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023894000000000001 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.956607+0000", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089904500000000001 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957484+0000", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087755199999999998 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957571+0000", 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6567e-05 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.957652+0000", 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0882000000000003e-05 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 61.569402136000001, 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026263390000000001, 2024-04-22T19:55:52.181 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1020 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512822+0000", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512824+0000", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512833+0000", 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2550000000000003e-06 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512849+0000", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512857+0000", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9500000000000001e-06 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.512959+0000", 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102265 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513078+0000", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118056 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513205+0000", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012727300000000001 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.513899+0000", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069368200000000004 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515388+0000", 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014899290000000001 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515420+0000", 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1522000000000001e-05 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:50.515448+0000", 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7957999999999999e-05 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.186 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.187 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:52.188 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:52.189 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:52.186+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:52.289 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:52.290+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:52.390 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:52.390+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:52.398 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:52.398 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:52.398 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:52.398 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:52.414 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:52.491 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:52.490+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:52.539 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:52.539 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:52.539 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:52.539 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:52.539 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:52.553 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:52.595 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:52.594+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:52.693 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:52.690+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.372584442000004, 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.333709949999999, 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.726 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:52.730 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.328632639999995, 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:52.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.327974401999995, 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:52.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:52.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:52.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.321197435000002, 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:52.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.226518940000005, 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:52.743 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.342036452000002, 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.322877520000006, 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:52.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.759 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.296768235000002, 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:52.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:52.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.278048007999999, 2024-04-22T19:55:52.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.244829479000003, 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:52.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:52.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:52.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.216787444000005, 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.777 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:52.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:52.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:52.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.201278791999997, 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:52.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:52.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:52.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.190929002999994, 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:52.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.157354178999995, 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.866138057000001, 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.779390274999997, 2024-04-22T19:55:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.718374281999999, 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.564683603000006, 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.498547254000002, 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:52.827 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:52.829 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:52.829 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:52.826+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:52.929 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:52.926+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:52.969 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:55:52.992 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:52.992 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:52.992 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:52.993 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:53.008 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:53.051 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:53.050+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:53.131 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:53.130+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:53.170 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:53.170 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:53.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:53.271 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:53.270+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:53.311 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:55:53.334 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:53.334+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:36 5.6 5:62d799de:::zone_info.eb035469-c6ab-4cf0-ad71-a1ae33c3109a:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:53.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.947632694999996, 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002707049, 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 36 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406362+0000", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406363+0000", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-06 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406373+0000", 2024-04-22T19:55:53.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406392+0000", 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9315999999999999e-05 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406402+0000", 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.042e-05 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406494+0000", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1841000000000004e-05 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406713+0000", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021911399999999999 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.406968+0000", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025435200000000001 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408253+0000", 2024-04-22T19:55:53.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012852460000000001 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.408926+0000", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067354100000000005 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409010+0000", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3900000000000006e-05 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.409069+0000", 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8488e-05 2024-04-22T19:55:53.360 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.932255709000003, 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:53.361 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.366 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.956128591999999, 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.367 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:55:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:55:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.946756139000001, 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.868372248, 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:55:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:55:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.553902043999997, 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026949949999999999, 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 742 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800092+0000", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800095+0000", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9160000000000001e-06 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800108+0000", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800141+0000", 2024-04-22T19:55:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2465000000000002e-05 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800156+0000", 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5234e-05 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800266+0000", 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010979 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800493+0000", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022738000000000001 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.800867+0000", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037365100000000002 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.801835+0000", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00096839699999999996 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802495+0000", 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065988199999999998 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802658+0000", 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163306 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.802787+0000", 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012923000000000001 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.550326484999999, 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026512699999999998, 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 744 2024-04-22T19:55:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803668+0000", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803670+0000", 2024-04-22T19:55:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6220000000000001e-06 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803677+0000", 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2699999999999999e-06 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803696+0000", 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8958e-05 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803704+0000", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6270000000000006e-06 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.803807+0000", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010248500000000001 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804029+0000", 2024-04-22T19:55:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022233100000000001 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.804497+0000", 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046785400000000002 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.805482+0000", 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098448099999999994 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806193+0000", 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071095499999999999 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806250+0000", 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7187e-05 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.806319+0000", 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9499999999999995e-05 2024-04-22T19:55:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.514784247999998, 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:55:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:55:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:55:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.386574680999999, 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027202670000000002, 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 817 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967420+0000", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967422+0000", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.526e-06 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967435+0000", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2439999999999999e-05 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967466+0000", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1195999999999997e-05 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967481+0000", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5056e-05 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967607+0000", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125757 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.967861+0000", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025446300000000002 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.968172+0000", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000310585 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969329+0000", 2024-04-22T19:55:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011570630000000001 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.969983+0000", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065394499999999996 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970071+0000", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8001e-05 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.970140+0000", 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9234999999999997e-05 2024-04-22T19:55:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.382919482000005, 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026493160000000001, 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 819 2024-04-22T19:55:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971075+0000", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971077+0000", 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.86e-06 2024-04-22T19:55:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971089+0000", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-05 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971120+0000", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1482000000000001e-05 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971135+0000", 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5126999999999999e-05 2024-04-22T19:55:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971246+0000", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110233 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971371+0000", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125387 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.971662+0000", 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029157199999999998 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.972750+0000", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010877110000000001 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973584+0000", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083396100000000003 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973665+0000", 2024-04-22T19:55:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1273999999999995e-05 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.973724+0000", 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8848999999999998e-05 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.331650287000002, 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:55:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.327813762000005, 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:55:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:55:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.318102108999994, 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025880370000000001, 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 847 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035892+0000", 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035895+0000", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2670000000000001e-06 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035923+0000", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8008999999999999e-05 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035956+0000", 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2985999999999999e-05 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.035971+0000", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5308999999999999e-05 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036077+0000", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106278 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036296+0000", 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219144 2024-04-22T19:55:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.036647+0000", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035104500000000002 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.037870+0000", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001222781 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038333+0000", 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046296500000000002 2024-04-22T19:55:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038417+0000", 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3811000000000001e-05 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.038480+0000", 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3441999999999993e-05 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.314614477999996, 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:55:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:55:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.271907343999999, 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:55:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:55:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.267987145000006, 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.185685218000003, 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:55:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.181972779999995, 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025226879999999999, 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 909 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172022+0000", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172023+0000", 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7129999999999999e-06 2024-04-22T19:55:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172050+0000", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6469e-05 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172070+0000", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0463999999999999e-05 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172081+0000", 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0832999999999999e-05 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172225+0000", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014370600000000001 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172368+0000", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014326599999999999 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.172660+0000", 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029159599999999998 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.173785+0000", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011248149999999999 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174394+0000", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060915000000000003 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174478+0000", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4024999999999996e-05 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.174544+0000", 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6650999999999996e-05 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.092093841999997, 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:55:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:55:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.078877238000004, 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:55:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:55:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:55:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.467 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:53.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:53.469 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:53.466+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:53.570 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:53.570+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:53.636 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:53.636 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:53.636 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:53.636 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:53.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:53.671 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:53.670+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:53.762 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:53.762 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:53.762 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:53.762 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:53.762 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:53.772 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:53.770+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:53.775 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:53.872 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:53.870+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:40 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.525017425, 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031449149999999999, 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415667+0000", 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415669+0000", 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960000000000001e-06 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415677+0000", 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1329999999999999e-06 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415696+0000", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9018999999999999e-05 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415711+0000", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.484e-05 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.415843+0000", 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013214100000000001 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416148+0000", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030469900000000002 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.416583+0000", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043570700000000002 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.417987+0000", 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014038309999999999 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418583+0000", 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059581 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418710+0000", 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126785 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.418812+0000", 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102354 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.534241183000006, 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.534133023999999, 2024-04-22T19:55:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:55:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.566784874000007, 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:55:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:55:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:55:53.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.528629757000004, 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.966 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:55:53.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:55:53.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.487836353000006, 2024-04-22T19:55:53.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032310860000000002, 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 227 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452848+0000", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452850+0000", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.193e-06 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452862+0000", 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452892+0000", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0243000000000002e-05 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.452907+0000", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4586000000000001e-05 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453017+0000", 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110837 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453227+0000", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000210075 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.453652+0000", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000424261 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455144+0000", 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014918100000000001 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455811+0000", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066766299999999998 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.455967+0000", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015568900000000001 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.456079+0000", 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011233 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.480551155000001, 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003529379, 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 229 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460133+0000", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460136+0000", 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3769999999999999e-06 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460147+0000", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1309e-05 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460177+0000", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0233e-05 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460192+0000", 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5002e-05 2024-04-22T19:55:53.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460308+0000", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011576100000000001 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460543+0000", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023478999999999999 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.460942+0000", 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039878299999999999 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.462316+0000", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001374307 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463514+0000", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001197788 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463598+0000", 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4283999999999995e-05 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.463663+0000", 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4745000000000004e-05 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.473366976999998, 2024-04-22T19:55:53.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:53.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:53.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:53.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:53.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:446 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.378463104000005, 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003144881, 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 446 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562221+0000", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562222+0000", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.082e-06 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562228+0000", 2024-04-22T19:55:53.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4029999999999998e-06 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562245+0000", 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6818999999999999e-05 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562254+0000", 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1039999999999996e-06 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562320+0000", 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6225999999999999e-05 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562409+0000", 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8793000000000002e-05 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:53.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562543+0000", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134468 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565175+0000", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026319830000000001 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565266+0000", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0846000000000004e-05 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565325+0000", 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8601999999999999e-05 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.565366+0000", 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1554999999999998e-05 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:569 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:53.994 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.304976615000001, 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032154940000000002, 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 569 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:53.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635708+0000", 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635709+0000", 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.187e-06 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635715+0000", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8440000000000003e-06 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635729+0000", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3613e-05 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635735+0000", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2339999999999999e-06 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:53.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635784+0000", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9011000000000002e-05 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635836+0000", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2649999999999999e-05 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.635953+0000", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116119 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:53.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.636404+0000", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045183499999999999 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638869+0000", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002464922 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638898+0000", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8941999999999998e-05 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:53.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.638923+0000", 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5137e-05 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.303498751000006, 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:54.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:54.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:54.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.300238977999996, 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.006 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:54.011 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.070191003000005, 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029893110000000001, 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 772 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870493+0000", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870496+0000", 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4700000000000001e-06 2024-04-22T19:55:54.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870508+0000", 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1683e-05 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870538+0000", 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0361999999999998e-05 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870553+0000", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4667e-05 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870660+0000", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010758400000000001 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.870863+0000", 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020276800000000001 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.871187+0000", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032392400000000001 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.872324+0000", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001137267 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873333+0000", 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010086159999999999 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873417+0000", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4433999999999998e-05 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.873483+0000", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5536000000000004e-05 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:54.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.056616499, 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033272549999999999, 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 778 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884068+0000", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884071+0000", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.847e-06 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884084+0000", 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3456e-05 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884115+0000", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0796000000000001e-05 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884130+0000", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4693e-05 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884259+0000", 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012921300000000001 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884475+0000", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021582400000000001 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.884827+0000", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035200800000000001 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.885940+0000", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001113553 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887207+0000", 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001266536 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887291+0000", 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4332000000000005e-05 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.887395+0000", 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103997 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 93.002997398000005, 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031129170000000002, 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 804 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937687+0000", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937689+0000", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1069999999999999e-06 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937701+0000", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2133000000000001e-05 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937733+0000", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2119000000000002e-05 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937754+0000", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452999999999999e-05 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.937874+0000", 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120147 2024-04-22T19:55:54.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938093+0000", 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000218521 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.938572+0000", 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047961299999999999 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.939685+0000", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001112554 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940531+0000", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084665700000000001 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940686+0000", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015467899999999999 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940800+0000", 2024-04-22T19:55:54.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113934 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.924846328000001, 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002918852, 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.028 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 838 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015838+0000", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015840+0000", 2024-04-22T19:55:54.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1639999999999999e-06 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015852+0000", 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1579999999999999e-05 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015880+0000", 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8371999999999999e-05 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.015894+0000", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4117000000000001e-05 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016019+0000", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124936 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016250+0000", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230194 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.016608+0000", 2024-04-22T19:55:54.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035822399999999998 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.017732+0000", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011238579999999999 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018602+0000", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087053800000000002 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018689+0000", 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6417999999999998e-05 2024-04-22T19:55:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.018757+0000", 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8450999999999999e-05 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.898358539, 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029236150000000001, 2024-04-22T19:55:54.033 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 850 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042326+0000", 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042328+0000", 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2469999999999998e-06 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042339+0000", 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042370+0000", 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0216e-05 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042387+0000", 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7393000000000001e-05 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042498+0000", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011056999999999999 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042715+0000", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021705499999999999 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.043039+0000", 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032476500000000003 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.044062+0000", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001022743 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045116+0000", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010539799999999999 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045189+0000", 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2887999999999997e-05 2024-04-22T19:55:54.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.045250+0000", 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0482000000000001e-05 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.818175073999996, 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030208320000000002, 2024-04-22T19:55:54.039 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 886 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122509+0000", 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122512+0000", 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.153e-06 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122523+0000", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1433e-05 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122554+0000", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0521999999999997e-05 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122568+0000", 2024-04-22T19:55:54.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4713e-05 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122680+0000", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011195400000000001 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.122895+0000", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021446099999999999 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.123219+0000", 2024-04-22T19:55:54.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032397200000000001 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.124381+0000", 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00116249 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125333+0000", 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095187199999999998 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125418+0000", 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4682e-05 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.125530+0000", 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011258 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.798588408000001, 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003119513, 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 895 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142096+0000", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142098+0000", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.243e-06 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142110+0000", 2024-04-22T19:55:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1219999999999999e-05 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142138+0000", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8158999999999999e-05 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142152+0000", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4239e-05 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142277+0000", 2024-04-22T19:55:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012501100000000001 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142529+0000", 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025213999999999998 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.142839+0000", 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030988499999999998 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.143908+0000", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001069328 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.144933+0000", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010247850000000001 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145095+0000", 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161473 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.145216+0000", 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.705915004999994, 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028670589999999999, 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:54.051 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 937 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:54.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234769+0000", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234772+0000", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234782+0000", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234813+0000", 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0462000000000001e-05 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234827+0000", 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4562999999999999e-05 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.234939+0000", 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111511 2024-04-22T19:55:54.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235154+0000", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021529399999999999 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.235469+0000", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031488799999999998 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.236618+0000", 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001148718 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237478+0000", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086008099999999995 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237570+0000", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2170999999999996e-05 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.237637+0000", 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6511000000000001e-05 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:54.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:54.057 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:54.057 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:54.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:54.059 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:54.058+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:54.158 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:54.154+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:54.191 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:54.191 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:54.191 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:54.191 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:54.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:54.240 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:54.240 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:54.255 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:54.255 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:54.259 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:54.258+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:54.271 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:54.271 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:54.286 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:54.286 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:54.304 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:54.304 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:54.323 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:54.323 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:54.328 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:54.328 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:54.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:54.344 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:54.344 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:54.360 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:54.358+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:54.362 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:54.362 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:54.461 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:54.458+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:54.501 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:54.501 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:54.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:54.562 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:54.558+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:54.633 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:54.633 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:54.648 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:54.663 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:54.662+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:54.764 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:54.762+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:54.773 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:54.773 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:54.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:54.864 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:54.862+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:54.958 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:54.958 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:54.965 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:54.962+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:54.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:55.066 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:55.066+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:55.090 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.090 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.104 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:55.166 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:55.162+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:55.262 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.263 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.267 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:55.266+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:55.277 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:55.343 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:55:55.368 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:55.366+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:55.369 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to '9ed8263edff7e87907bf24b054e5c7144c194dbe'. 2024-04-22T19:55:55.369 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.369 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-22T19:55:55.369 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-04-22T19:55:55.370 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at 9ed8263edff rgw: apply default quota config on account creation 2024-04-22T19:55:55.378 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-22T19:55:55.398 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.398 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:55.427 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-22T19:55:55.430 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T19:55:55.430 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-22T19:55:55.468 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:55.466+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:55.570 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:55.570+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:55.577 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.577 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.591 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:55.677 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:55.678+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:55.749 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.750 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:55:55.772 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:55.770+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:55.873 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:55.874+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:55.925 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:55.925 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:55.940 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:55:55.981 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:55.982+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:56.068 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:56.068 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:56.075 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:56.074+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:56.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:55:56.150 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-22T19:55:56.175 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:56.174+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:56.203 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:56.203 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:56.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:55:56.221 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-22T19:55:56.276 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:56.274+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:56.276 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T19:55:56.277 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T19:55:56.277 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-22T19:55:56.317 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T19:55:56.320 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-22T19:55:56.320 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-22T19:55:56.324 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:56.324 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:56.328 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-22T19:55:56.329 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-22T19:55:56.330 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9ed8263edff7e87907bf24b054e5c7144c194dbe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-22T19:55:56.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:55:56.377 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:56.374+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:56.378 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:55:56.438 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:55:56.494 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:56.494 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:56.495 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:56.494+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:56.509 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:55:56.510 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:56.511 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:56.526 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:56.526 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:56.542 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:56.542 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:56.562 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:56.562 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:56.578 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:56.574+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:56.584 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:56.584 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:56.604 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:56.604 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:56.624 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:56.624 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:56.626 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:56.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:56.627 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:56.627 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:56.627 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:56.641 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:55:56.644 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:56.645 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:56.679 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:56.678+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:56.686 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:55:56.687 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:55:56.687 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00906875 s, 1.2 GB/s 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 103.41519741099999, 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:55:56.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.376322919000003, 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003625755, 2024-04-22T19:55:56.768 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386603+0000", 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386605+0000", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386620+0000", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4773000000000001e-05 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386656+0000", 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.646e-05 2024-04-22T19:55:56.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386675+0000", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386895+0000", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022049600000000001 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.386947+0000", 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1699000000000001e-05 2024-04-22T19:55:56.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390102+0000", 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003154876 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.390229+0000", 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012709599999999999 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.772 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.371245608999999, 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051965020000000004, 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391680+0000", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391682+0000", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.891e-06 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391698+0000", 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.556e-05 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391722+0000", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3884999999999999e-05 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391743+0000", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1162000000000002e-05 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391857+0000", 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114004 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.391901+0000", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3928999999999999e-05 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396780+0000", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048792769999999996 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396877+0000", 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6793999999999995e-05 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.370587370999999, 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046561969999999999, 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392339+0000", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000002e-07 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392371+0000", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2029000000000001e-05 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392393+0000", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1874000000000001e-05 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392408+0000", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.509e-05 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392625+0000", 2024-04-22T19:55:56.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217109 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.392664+0000", 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8328999999999998e-05 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396917+0000", 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004252746 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.396995+0000", 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8325000000000006e-05 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.363810404000006, 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003497844, 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399116+0000", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399117+0000", 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.482e-06 2024-04-22T19:55:56.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399129+0000", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.19e-05 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399154+0000", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5422000000000002e-05 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399169+0000", 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4572e-05 2024-04-22T19:55:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399272+0000", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102747 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399319+0000", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6786999999999998e-05 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402540+0000", 2024-04-22T19:55:56.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032210910000000001 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.402613+0000", 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3843000000000004e-05 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.269131908999995, 2024-04-22T19:55:56.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004494568, 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 193 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493794+0000", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493796+0000", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0430000000000002e-06 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493807+0000", 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493834+0000", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7902000000000002e-05 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493849+0000", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4374e-05 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.493950+0000", 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001013 2024-04-22T19:55:56.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494102+0000", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015210000000000001 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.494313+0000", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021122900000000001 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.496586+0000", 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022730020000000001 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498140+0000", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015537890000000001 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498227+0000", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6953999999999995e-05 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.498289+0000", 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1481000000000003e-05 2024-04-22T19:55:56.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.384649421000006, 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043375979999999998, 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 208 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378277+0000", 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378281+0000", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1239999999999998e-06 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378293+0000", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378316+0000", 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3679000000000001e-05 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378330+0000", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4e-05 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378437+0000", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106623 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378645+0000", 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020855099999999999 2024-04-22T19:55:56.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.379031+0000", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000385497 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.380372+0000", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013415600000000001 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382333+0000", 2024-04-22T19:55:56.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001960645 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382509+0000", 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017609799999999999 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.382614+0000", 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105021 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.365490488999995, 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033120179999999999, 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 212 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397436+0000", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397438+0000", 2024-04-22T19:55:56.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0260000000000002e-06 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397446+0000", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5369999999999997e-06 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397476+0000", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9872000000000001e-05 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397494+0000", 2024-04-22T19:55:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397636+0000", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014139 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.397975+0000", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033953800000000001 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.398654+0000", 2024-04-22T19:55:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067885500000000002 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400116+0000", 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001462404 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400597+0000", 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000480557 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400683+0000", 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6286999999999996e-05 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.400748+0000", 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4228999999999998e-05 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:56.802 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.339381204000006, 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040646550000000004, 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:56.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423545+0000", 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423548+0000", 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.937e-06 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423577+0000", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9088999999999999e-05 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423609+0000", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2443000000000001e-05 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423625+0000", 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6192e-05 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.423781+0000", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015569299999999999 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424134+0000", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035282100000000002 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.424947+0000", 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081347500000000003 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.426458+0000", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00151099 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427325+0000", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00086611999999999995 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427489+0000", 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000164022 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.427609+0000", 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012087300000000001 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.320660977000003, 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002983837, 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.808 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 224 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442265+0000", 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442267+0000", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2129999999999998e-06 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442278+0000", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.113e-05 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442309+0000", 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0119000000000001e-05 2024-04-22T19:55:56.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442327+0000", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8516e-05 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442428+0000", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100898 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.442644+0000", 2024-04-22T19:55:56.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021586700000000001 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.443053+0000", 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040919900000000001 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.444254+0000", 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012010510000000001 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445103+0000", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084848400000000004 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445187+0000", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4355000000000001e-05 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.445249+0000", 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2005e-05 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.287442447999993, 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030627380000000002, 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 233 2024-04-22T19:55:56.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475484+0000", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475486+0000", 2024-04-22T19:55:56.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3640000000000002e-06 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475497+0000", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1489e-05 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475528+0000", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0355999999999999e-05 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475549+0000", 2024-04-22T19:55:56.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1396e-05 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475696+0000", 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014651599999999999 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.475915+0000", 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219457 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.476337+0000", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042139599999999999 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.477605+0000", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012681389999999999 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478392+0000", 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078758300000000001 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478484+0000", 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1929999999999996e-05 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.478546+0000", 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2112000000000004e-05 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:316 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.819 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.259400412999995, 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030857229999999999, 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 316 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:56.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503526+0000", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503527+0000", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1620000000000001e-06 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503534+0000", 2024-04-22T19:55:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1219999999999997e-06 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503548+0000", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.384e-05 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503556+0000", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.337e-06 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503616+0000", 2024-04-22T19:55:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0146000000000003e-05 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503745+0000", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012888900000000001 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.503951+0000", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020616100000000001 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.505653+0000", 2024-04-22T19:55:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00170214 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506510+0000", 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000857061 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506566+0000", 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5260999999999998e-05 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.506611+0000", 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5603999999999999e-05 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:383 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.243891761, 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037786590000000002, 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 383 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519034+0000", 2024-04-22T19:55:56.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519035+0000", 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519041+0000", 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6169999999999998e-06 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519054+0000", 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3151e-05 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519061+0000", 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3749999999999999e-06 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519121+0000", 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0194e-05 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519225+0000", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104756 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.519374+0000", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148615 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.520319+0000", 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00094490999999999998 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522738+0000", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024194529999999998 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522779+0000", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0280000000000001e-05 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.522813+0000", 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4201e-05 2024-04-22T19:55:56.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:399 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.233541971999998, 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003701139, 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 399 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529384+0000", 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529386+0000", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529394+0000", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9580000000000007e-06 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529411+0000", 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824e-05 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529420+0000", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9830000000000002e-06 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529500+0000", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9493000000000006e-05 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529601+0000", 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100992 2024-04-22T19:55:56.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.529842+0000", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024165999999999999 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.531807+0000", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001965081 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.532960+0000", 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011524689999999999 2024-04-22T19:55:56.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533027+0000", 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7076999999999995e-05 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.533085+0000", 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8307999999999998e-05 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:449 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.199967147999999, 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049377539999999999, 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 449 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562959+0000", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562960+0000", 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.043e-06 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562965+0000", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1209999999999998e-06 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562976+0000", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0672e-05 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.562984+0000", 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5390000000000007e-06 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563052+0000", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7387999999999999e-05 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563208+0000", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155952 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.563356+0000", 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148374 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.564821+0000", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014648020000000001 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567834+0000", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030134820000000001 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567868+0000", 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4034e-05 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.567897+0000", 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8347000000000002e-05 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:766 6.19 e32/26 6:9edc23b1:::obj_delete_at_hint.0000000063:head v 32'8, mlcod=32'6)", 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.908751026000004, 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036599990000000002, 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854175+0000", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854176+0000", 2024-04-22T19:55:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.062e-06 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854184+0000", 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4270000000000008e-06 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854199+0000", 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4958e-05 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854211+0000", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1318000000000001e-05 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854330+0000", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119627 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.854367+0000", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7042000000000002e-05 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857749+0000", 2024-04-22T19:55:56.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033813070000000001 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.857835+0000", 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6258e-05 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:56.846 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.822003244000001, 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029792519999999999, 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 805 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940923+0000", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940925+0000", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.294e-06 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940936+0000", 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1185999999999999e-05 2024-04-22T19:55:56.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940966+0000", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0076000000000001e-05 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.940987+0000", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941103+0000", 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011539700000000001 2024-04-22T19:55:56.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941323+0000", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022031399999999999 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.941632+0000", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030900200000000001 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.942656+0000", 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001023583 2024-04-22T19:55:56.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943799+0000", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011435250000000001 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943860+0000", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0359000000000003e-05 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.943902+0000", 2024-04-22T19:55:56.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2383999999999999e-05 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.760987251000003, 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030475160000000001, 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 832 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001939+0000", 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001941+0000", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-06 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001952+0000", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1056999999999999e-05 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.001984+0000", 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1504999999999997e-05 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002005+0000", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0814000000000001e-05 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002180+0000", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017553100000000001 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002391+0000", 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021024800000000001 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.002716+0000", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032566499999999999 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.003800+0000", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010834079999999999 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004851+0000", 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001051015 2024-04-22T19:55:56.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004928+0000", 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7027999999999995e-05 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.004986+0000", 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8612000000000001e-05 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.607296571999996, 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027992049999999999, 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 901 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155629+0000", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155632+0000", 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:55:56.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155643+0000", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155675+0000", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1405999999999997e-05 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155691+0000", 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6042999999999999e-05 2024-04-22T19:55:56.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.155835+0000", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014381299999999999 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156052+0000", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021708099999999999 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.156361+0000", 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000308802 2024-04-22T19:55:56.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.157576+0000", 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215799 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158280+0000", 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070340799999999998 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158366+0000", 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6351e-05 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.158429+0000", 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2582999999999994e-05 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.541160223000006, 2024-04-22T19:55:56.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029717200000000002, 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 931 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221766+0000", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221768+0000", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221780+0000", 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221811+0000", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1798999999999998e-05 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221833+0000", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1376e-05 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.221955+0000", 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012264700000000001 2024-04-22T19:55:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222180+0000", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022457799999999999 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.222524+0000", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034392400000000001 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.223830+0000", 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00130631 2024-04-22T19:55:56.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224590+0000", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00076017700000000001 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224677+0000", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6170999999999999e-05 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.224738+0000", 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0891999999999999e-05 2024-04-22T19:55:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.869 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:56.869 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:56.869 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:56.870 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:55:56.870 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:56.866+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:56.911 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_55_56 2024-04-22T19:55:56.971 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:56.970+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:57.030 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.030 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:57.030 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:57.030 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.045 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:55:57.071 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:57.070+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:57.072 INFO:tasks.workunit.client.0.smithi111.stdout:quota set for the bucket: buck_2024_03_22_19_55_56 2024-04-22T19:55:57.166 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.167 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:57.167 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:57.167 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:57.167 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.172 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:57.170+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:57.182 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:55:57.273 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:57.270+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:57.337 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_55_56 2024-04-22T19:55:57.337 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 10Mb. 2024-04-22T19:55:57.337 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:55:57.337 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:57.337 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - Test max objects passed 2024-04-22T19:55:57.338 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:57.342 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.342 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:57.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 103.919560941, 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028174070000000001, 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-04-22T19:55:57.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421739+0000", 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421740+0000", 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5230000000000001e-06 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421748+0000", 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.072e-06 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421768+0000", 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9871e-05 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421781+0000", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2996000000000001e-05 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.421899+0000", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117447 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422094+0000", 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000195231 2024-04-22T19:55:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.422272+0000", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017857499999999999 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.423510+0000", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012379960000000001 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424403+0000", 2024-04-22T19:55:57.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089285500000000002 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424485+0000", 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1243999999999997e-05 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.424556+0000", 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1596999999999999e-05 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.943433823999996, 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027236550000000002, 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.349 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397866+0000", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397868+0000", 2024-04-22T19:55:57.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2419999999999999e-06 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397879+0000", 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0611000000000001e-05 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397910+0000", 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1148000000000001e-05 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.397928+0000", 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8434999999999999e-05 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398077+0000", 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000148467 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398355+0000", 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027805400000000002 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.398597+0000", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024245700000000001 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.399708+0000", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001111138 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400389+0000", 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068077100000000005 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400481+0000", 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2260000000000001e-05 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.400589+0000", 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108072 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.354 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.934061370999999, 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.358 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.855677479999997, 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:55:57.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:55:57.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.502089479999995, 2024-04-22T19:55:57.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.318955518999999, 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:55:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.315118994000002, 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027938780000000001, 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 843 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026181+0000", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026182+0000", 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026192+0000", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.927e-06 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026213+0000", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0996e-05 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026225+0000", 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-05 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026312+0000", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6488000000000003e-05 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026432+0000", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120166 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.026704+0000", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027184699999999997 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.027921+0000", 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001217578 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028772+0000", 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085106500000000002 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028858+0000", 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5977999999999996e-05 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.028975+0000", 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116357 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.301919710000007, 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027344560000000001, 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 849 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039380+0000", 2024-04-22T19:55:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039382+0000", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.063e-06 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039394+0000", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2283000000000001e-05 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039425+0000", 2024-04-22T19:55:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0815999999999998e-05 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039441+0000", 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5389000000000001e-05 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039534+0000", 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900999999999994e-05 2024-04-22T19:55:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039658+0000", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123664 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.039930+0000", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027239300000000001 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.040974+0000", 2024-04-22T19:55:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010438730000000001 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041909+0000", 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093417299999999995 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.041994+0000", 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5611000000000004e-05 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.042114+0000", 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.259212575999996, 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002760106, 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 868 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082087+0000", 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082089+0000", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3240000000000001e-06 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082103+0000", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3936e-05 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082133+0000", 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9603000000000001e-05 2024-04-22T19:55:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082150+0000", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7105999999999999e-05 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082275+0000", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125263 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082487+0000", 2024-04-22T19:55:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021208800000000001 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.082785+0000", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029768200000000001 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.083939+0000", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011542239999999999 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084697+0000", 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075777699999999995 2024-04-22T19:55:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084780+0000", 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3282000000000007e-05 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.084847+0000", 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6821000000000003e-05 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.255292377000004, 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:55:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.17299045, 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:55:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:55:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:55:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:55:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.079399073999994, 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027946379999999999, 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 949 2024-04-22T19:55:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261901+0000", 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261903+0000", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261916+0000", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2524000000000001e-05 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261947+0000", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1544999999999997e-05 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.261962+0000", 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4997000000000001e-05 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262080+0000", 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117137 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262299+0000", 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000219507 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.262622+0000", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032239200000000001 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.263813+0000", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001191969 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264469+0000", 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065552700000000004 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264620+0000", 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151099 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.264695+0000", 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5117999999999995e-05 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.066182470000001, 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027663850000000001, 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 955 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275117+0000", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275119+0000", 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275131+0000", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1313e-05 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275161+0000", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0682000000000002e-05 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275177+0000", 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5053e-05 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275296+0000", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119634 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275501+0000", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020516499999999999 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.275814+0000", 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313181 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.276941+0000", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001126958 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277733+0000", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079107600000000004 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277819+0000", 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6805000000000007e-05 2024-04-22T19:55:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.277884+0000", 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4247999999999999e-05 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5100.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098904449504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.018963+0000", 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.32233645300000002, 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028020369999999998, 2024-04-22T19:55:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5100", 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/1580228492", 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018963+0000", 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018963+0000", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018964+0000", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1179999999999999e-06 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018970+0000", 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0610000000000001e-06 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018984+0000", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3701e-05 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.018992+0000", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6969999999999993e-06 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.019042+0000", 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0158999999999999e-05 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.019088+0000", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6434000000000003e-05 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.019192+0000", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010395699999999999 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.019612+0000", 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000420099 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.021663+0000", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020507720000000002 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.021718+0000", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4335000000000001e-05 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.021765+0000", 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7704000000000003e-05 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5100.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'6, mlcod=71'4)", 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.31765264599999998, 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003316318, 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023648+0000", 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4700000000000001e-07 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023654+0000", 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5200000000000003e-06 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023667+0000", 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2490000000000001e-05 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023673+0000", 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.635e-06 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023725+0000", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1579000000000002e-05 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023744+0000", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8734999999999999e-05 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026940+0000", 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003195902 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026963+0000", 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5100.0:55 7.3 e71/28 7:c609908c:::notify.5:head v 71'7, mlcod=71'5)", 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.31760676500000001, 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002986547, 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2500000000000001e-07 2024-04-22T19:55:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023697+0000", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8589999999999998e-06 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023704+0000", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0709999999999997e-06 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023709+0000", 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0780000000000003e-06 2024-04-22T19:55:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023752+0000", 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3028999999999997e-05 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023771+0000", 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8943000000000001e-05 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026635+0000", 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028634839999999999 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026679+0000", 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4758000000000001e-05 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'9, mlcod=71'7)", 2024-04-22T19:55:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.164195427, 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030810120000000002, 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177105+0000", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5000000000000002e-07 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177110+0000", 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3510000000000001e-06 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177122+0000", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2007e-05 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177129+0000", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6529999999999997e-06 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177187+0000", 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8319999999999997e-05 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177207+0000", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0109999999999999e-05 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180141+0000", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029336520000000001 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180185+0000", 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4168999999999997e-05 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:55 7.3 e71/28 7:c609908c:::notify.5:head v 71'10, mlcod=71'8)", 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.16395816999999999, 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046724219999999999, 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177342+0000", 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9800000000000003e-07 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177347+0000", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9690000000000002e-06 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177358+0000", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1253000000000001e-05 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177366+0000", 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0390000000000005e-06 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177410+0000", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4131000000000001e-05 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177426+0000", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5885000000000001e-05 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181969+0000", 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045423649999999996 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182014+0000", 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5182000000000002e-05 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:57 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'10, mlcod=71'8)", 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.160557382, 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038103680000000002, 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180743+0000", 2024-04-22T19:55:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0200000000000001e-07 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180749+0000", 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3999999999999997e-06 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180761+0000", 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1739000000000001e-05 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180768+0000", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0609999999999998e-06 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180821+0000", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2726999999999998e-05 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180846+0000", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4641999999999999e-05 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184502+0000", 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036559850000000001 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184553+0000", 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1011999999999999e-05 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1193 3.4 e71/20 3:2024137d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_2:head v 71'1, mlcod=0'0)", 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.058210994000000002, 2024-04-22T19:55:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068172320000000003, 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2399999999999999e-07 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284236+0000", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011472069999999999 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284253+0000", 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6575e-05 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284263+0000", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8749999999999995e-06 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284325+0000", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2482000000000002e-05 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284341+0000", 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019999999999999e-05 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289866+0000", 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055250630000000002 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289906+0000", 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9585999999999997e-05 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.446 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.448 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:55:57.448 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:57.446+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:57.548 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:57.546+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:57.565 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:55:57.565 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.578 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:55:57.631 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:55:57.631 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:55:57.649 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:57.646+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:57.658 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:55:57.658 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:55:57.658 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0241369 s, 434 MB/s 2024-04-22T19:55:57.692 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.693 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:55:57.693 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:55:57.693 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:55:57.693 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:55:57.751 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:57.750+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:57.826 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_55_57 2024-04-22T19:55:57.851 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:57.850+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:57.870 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:55:57.870 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:55:57.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:55:57.870 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:55:57.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.463140022, 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:55:57.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:55:57.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:55:57.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.463031863, 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:55:57.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.495683713000005, 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:55:57.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:55:57.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.457528596000003, 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037868450000000001, 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 216 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412055+0000", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412057+0000", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6369999999999999e-06 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412069+0000", 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1353e-05 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412098+0000", 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9759000000000001e-05 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412114+0000", 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5795999999999999e-05 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412259+0000", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000144623 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.412628+0000", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000369057 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.413339+0000", 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071116699999999996 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415018+0000", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016786189999999999 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415641+0000", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062315299999999999 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415727+0000", 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5717999999999995e-05 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.415842+0000", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114963 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.402265815999996, 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.893 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:55:57.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:55:57.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.232397590000005, 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.898 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.903 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:576 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.229137816999994, 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039039980000000001, 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 576 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640446+0000", 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3099999999999997e-07 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640450+0000", 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.675e-06 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640459+0000", 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640464+0000", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1279999999999999e-06 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640525+0000", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.033e-05 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640612+0000", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7299999999999994e-05 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.640804+0000", 2024-04-22T19:55:57.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019142700000000001 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641417+0000", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061322799999999995 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644279+0000", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028623490000000001 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644313+0000", 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4158000000000001e-05 2024-04-22T19:55:57.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.644350+0000", 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6278000000000001e-05 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5073.0:5 5.14 5:2a207e2a:::zonegroup_info.1f3673b9-c5fa-45cc-9c61-1cb24ab351a2:head [call,read 0~436] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.753012+0000", 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1165712329999999, 2024-04-22T19:55:57.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037088199999999998, 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5073", 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/1523366209", 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 5 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753012+0000", 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753012+0000", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753013+0000", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0860000000000001e-06 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753018+0000", 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6029999999999998e-06 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753025+0000", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7989999999999996e-06 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753031+0000", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5300000000000002e-06 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753085+0000", 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4175999999999998e-05 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.753090+0000", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.25e-06 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.756481+0000", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033917119999999999 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.756565+0000", 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3275999999999993e-05 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.756721+0000", 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015638800000000001 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1159 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.97602921099999995, 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082653799999999993, 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1159 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893557+0000", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1030000000000002e-06 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893573+0000", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6121e-05 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893599+0000", 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5527000000000001e-05 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893608+0000", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5170000000000005e-06 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0537e-05 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893784+0000", 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114715 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893895+0000", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111445 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894822+0000", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092721199999999996 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901753+0000", 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069308690000000001 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901790+0000", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6381000000000003e-05 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9952999999999999e-05 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1165 4.0 4:00b97b13:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.97594089799999995, 2024-04-22T19:55:57.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081770639999999995, 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1165 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893643+0000", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7599999999999997e-07 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893646+0000", 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1650000000000002e-06 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893651+0000", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3859999999999998e-06 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893655+0000", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6540000000000001e-06 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893714+0000", 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8938999999999999e-05 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893815+0000", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100857 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893913+0000", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8016999999999993e-05 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894843+0000", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093034900000000002 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901729+0000", 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006885436 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901777+0000", 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8486000000000003e-05 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2299000000000003e-05 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1166 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.97591667599999998, 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083575569999999998, 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1166 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:55:57.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5499999999999999e-07 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.283e-06 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893673+0000", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8380000000000004e-06 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893676+0000", 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8650000000000001e-06 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894194+0000", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000518591 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894267+0000", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2964000000000001e-05 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894353+0000", 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6032000000000006e-05 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.895150+0000", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079645599999999997 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901901+0000", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067511699999999999 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901954+0000", 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2568000000000002e-05 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.902024+0000", 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0535000000000001e-05 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5100.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098904455392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023354+0000", 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.84622918899999999, 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035321789999999999, 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.930 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5100", 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/1580228492", 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 55 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023354+0000", 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023354+0000", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023355+0000", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4099999999999997e-07 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023358+0000", 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3720000000000001e-06 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023368+0000", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.448e-06 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023373+0000", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6979999999999997e-06 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023414+0000", 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1368000000000001e-05 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023484+0000", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0402999999999997e-05 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023614+0000", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012945200000000001 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026800+0000", 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031859219999999999 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026813+0000", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3509000000000001e-05 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026849+0000", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5494999999999998e-05 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026886+0000", 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7670999999999999e-05 2024-04-22T19:55:57.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5100.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023393+0000", 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.84619063699999997, 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037020260000000002, 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5100", 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/1580228492", 2024-04-22T19:55:57.936 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 56 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023393+0000", 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023393+0000", 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023393+0000", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8099999999999998e-07 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023395+0000", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9599999999999999e-06 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023400+0000", 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5430000000000004e-06 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023403+0000", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.236e-06 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023447+0000", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4385000000000003e-05 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023498+0000", 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0540000000000001e-05 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023585+0000", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7007000000000002e-05 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.024007+0000", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042216399999999999 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.027049+0000", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030416190000000002 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.027075+0000", 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.633e-05 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.027095+0000", 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9860999999999998e-05 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792601852016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:55:57.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.69274930700000004, 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053878320000000004, 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 55 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176835+0000", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176838+0000", 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0929999999999999e-06 2024-04-22T19:55:57.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176845+0000", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4050000000000003e-06 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176850+0000", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176904+0000", 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4883999999999998e-05 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177000+0000", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5042000000000002e-05 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177130+0000", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013014 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180207+0000", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030771029999999999 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182137+0000", 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001930733 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182169+0000", 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1637000000000002e-05 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182222+0000", 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2747999999999997e-05 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792601856144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.689131296, 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042869960000000004, 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180453+0000", 2024-04-22T19:55:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079999999999999e-06 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180456+0000", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3469999999999999e-06 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180464+0000", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0180000000000001e-06 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180469+0000", 2024-04-22T19:55:57.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0830000000000003e-06 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180507+0000", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7762000000000002e-05 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180574+0000", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6537000000000003e-05 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180672+0000", 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7918999999999995e-05 2024-04-22T19:55:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181837+0000", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011655389999999999 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184672+0000", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028345509999999998 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184702+0000", 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9798000000000002e-05 2024-04-22T19:55:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184739+0000", 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7434000000000001e-05 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1277 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.25012382599999999, 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045028200000000003, 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1277 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2500000000000005e-07 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619464+0000", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5599999999999998e-06 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619474+0000", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0675e-05 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619480+0000", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0749999999999997e-06 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619526+0000", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6607000000000003e-05 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619576+0000", 2024-04-22T19:55:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9376999999999998e-05 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619635+0000", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9954999999999998e-05 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.620179+0000", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054328299999999998 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623911+0000", 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037319580000000001 2024-04-22T19:55:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623940+0000", 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9105999999999999e-05 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623962+0000", 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2498999999999999e-05 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1284 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.250060695, 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047462119999999997, 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1284 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.41e-07 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619524+0000", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.327e-06 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619528+0000", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7299999999999999e-06 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619540+0000", 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619862+0000", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032193199999999998 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619908+0000", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6187999999999999e-05 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619972+0000", 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3182999999999995e-05 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623206+0000", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032341219999999999 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624219+0000", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010137810000000001 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624249+0000", 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9887e-05 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624269+0000", 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9531999999999999e-05 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1292 4.19 4:9b504767:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.058849893, 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040307520000000003, 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1292 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810735+0000", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9970000000000001e-06 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810744+0000", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0280000000000006e-06 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810768+0000", 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3260000000000001e-05 2024-04-22T19:55:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810778+0000", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0343000000000001e-05 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810877+0000", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8709999999999995e-05 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811005+0000", 2024-04-22T19:55:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012782000000000001 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811152+0000", 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014767200000000001 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814371+0000", 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032191199999999998 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814633+0000", 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026128399999999997 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814683+0000", 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0744000000000001e-05 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814764+0000", 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0773999999999996e-05 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1294 4.19 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.058780908999999999, 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061606559999999996, 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1294 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810803+0000", 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7100000000000002e-07 2024-04-22T19:55:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810807+0000", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0210000000000001e-06 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810816+0000", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4769999999999992e-06 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810827+0000", 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380999999999999e-05 2024-04-22T19:55:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811424+0000", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059679000000000004 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811545+0000", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121489 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811686+0000", 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014067300000000001 2024-04-22T19:55:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814379+0000", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026932599999999998 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816906+0000", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002527058 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816937+0000", 2024-04-22T19:55:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1092e-05 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816963+0000", 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5843999999999999e-05 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1299 4.28 e71/22 4:14484338:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.7:head v 71'1, mlcod=0'0)", 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.057568698000000001, 2024-04-22T19:55:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004693521, 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812016+0000", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812023+0000", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8199999999999999e-06 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812031+0000", 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9230000000000008e-06 2024-04-22T19:55:57.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812036+0000", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0130000000000001e-06 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812086+0000", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9762000000000002e-05 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812103+0000", 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6316000000000001e-05 2024-04-22T19:55:57.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816666+0000", 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045633499999999999 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816708+0000", 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2246999999999997e-05 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:55:57.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:55:57.979 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:55:57.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:55:57.980 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:57.978+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:58.081 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:58.078+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:58.093 INFO:tasks.workunit.client.0.smithi111.stdout:bucket quota max_objs set for the given user: buck_2024_03_22_19_55_57 2024-04-22T19:55:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:58.130 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:55:58.181 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:58.178+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:58.282 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:55:58.282+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:55:58.311 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:58.311 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:58.311 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:55:58.311 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:55:58.311 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:58.320 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_55_57 2024-04-22T19:55:58.321 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 10Mb. 2024-04-22T19:55:58.321 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:55:58.321 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:58.321 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-22T19:55:58.321 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:58.327 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:55:58.413 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:58.414+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:58.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:55:58.484 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:55:58.482+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:55:58.503 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:55:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.154213321, 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:55:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:55:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:55:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 101.122738107, 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:496 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 97.913959484000003, 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004731084, 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 496 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588345+0000", 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588347+0000", 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0669999999999999e-06 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588357+0000", 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0216e-05 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588389+0000", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1974000000000003e-05 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588411+0000", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1724000000000001e-05 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588555+0000", 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014460699999999999 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.588727+0000", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017222799999999999 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.589159+0000", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000431495 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.590361+0000", 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012021340000000001 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.592936+0000", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025746020000000001 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593015+0000", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8979000000000004e-05 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593076+0000", 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1057999999999997e-05 2024-04-22T19:55:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 97.908544180999996, 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:55:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:55:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:646 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 97.814820584000003, 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004116275, 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 646 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687484+0000", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687485+0000", 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-22T19:55:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687493+0000", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7689999999999996e-06 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687512+0000", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8855000000000002e-05 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687523+0000", 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0696000000000001e-05 2024-04-22T19:55:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687604+0000", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1589999999999996e-05 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.687707+0000", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102531 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.688056+0000", 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034902499999999999 2024-04-22T19:55:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.689113+0000", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001056899 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691449+0000", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023358670000000002 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691538+0000", 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9574999999999995e-05 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.691600+0000", 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1661999999999993e-05 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1160 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6084652880000001, 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056328690000000004, 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1160 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893841+0000", 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.357e-06 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893854+0000", 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2587e-05 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893888+0000", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4338999999999998e-05 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893903+0000", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4946000000000001e-05 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894116+0000", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021338300000000001 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894507+0000", 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039105900000000002 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894916+0000", 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040844500000000001 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897575+0000", 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026587410000000001 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899333+0000", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001758772 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899412+0000", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8720999999999994e-05 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899472+0000", 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9518999999999997e-05 2024-04-22T19:55:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1164 4.e 4:738004f6:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.608240702, 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120020000000007, 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1164 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894065+0000", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3999999999999999e-06 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894073+0000", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3129999999999999e-06 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894092+0000", 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8955999999999999e-05 2024-04-22T19:55:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894106+0000", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4209999999999999e-05 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894367+0000", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026029800000000001 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894704+0000", 2024-04-22T19:55:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033720000000000001 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895099+0000", 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039516900000000001 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897619+0000", 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025196440000000001 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901913+0000", 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042945250000000004 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901997+0000", 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4182000000000001e-05 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902075+0000", 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8104999999999998e-05 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1167 4.c 4:313a420b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6081546069999999, 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075928640000000004, 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1167 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894151+0000", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.277e-06 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894159+0000", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8429999999999993e-06 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894420+0000", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026149499999999999 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894439+0000", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8936e-05 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894583+0000", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014430700000000001 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894859+0000", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027515800000000001 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895244+0000", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038518899999999997 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897796+0000", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025523529999999998 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901528+0000", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003732244 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901646+0000", 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011786999999999999 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901742+0000", 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6192000000000003e-05 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1158 4.38 e71/22 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head v 71'1, mlcod=0'0)", 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6059766770000001, 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053332520000000001, 2024-04-22T19:55:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896328+0000", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0999999999999997e-07 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896339+0000", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0370000000000001e-05 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896386+0000", 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7478999999999997e-05 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896405+0000", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9283000000000002e-05 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896655+0000", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024980199999999998 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896699+0000", 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4106000000000001e-05 2024-04-22T19:55:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901558+0000", 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048586569999999997 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901661+0000", 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102645 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:55:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.2155776140000001, 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:55:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:55:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:55:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.1867349169999999, 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1278 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.88254036700000005, 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058606129999999998, 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1278 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.103e-06 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619775+0000", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6129999999999993e-06 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619808+0000", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2549999999999998e-05 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619831+0000", 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2606e-05 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620135+0000", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030401099999999997 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620389+0000", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025460499999999998 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620690+0000", 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030031699999999998 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623273+0000", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002583082 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625492+0000", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022194350000000001 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625568+0000", 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6081999999999994e-05 2024-04-22T19:55:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625624+0000", 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1279 4.35 4:af8a70f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.882394927, 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055171339999999999, 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1279 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619911+0000", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619919+0000", 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.157e-06 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619947+0000", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8062e-05 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619965+0000", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621510+0000", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001545151 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621711+0000", 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020052899999999999 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621991+0000", 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028019200000000002 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624413+0000", 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024225570000000001 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625241+0000", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082763499999999996 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625326+0000", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4812e-05 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625426+0000", 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100385 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1282 4.e 4:738004f6:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.621410+0000", 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.88089451799999996, 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040555239999999996, 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1282 2024-04-22T19:55:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621410+0000", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621410+0000", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621412+0000", 2024-04-22T19:55:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1799999999999999e-06 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621423+0000", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1216000000000001e-05 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621452+0000", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8935999999999999e-05 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621476+0000", 2024-04-22T19:55:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4173e-05 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621613+0000", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136444 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621794+0000", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018172699999999999 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622041+0000", 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000247042 2024-04-22T19:55:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625191+0000", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031492439999999998 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625232+0000", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1056000000000001e-05 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625362+0000", 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013026499999999999 2024-04-22T19:55:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625465+0000", 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103241 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1285 4.c 4:313a420b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.622389+0000", 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.87991463400000003, 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044257020000000001, 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1285 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622389+0000", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622389+0000", 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622391+0000", 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7400000000000001e-06 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622401+0000", 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4769999999999992e-06 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622448+0000", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7658999999999999e-05 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622473+0000", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5123e-05 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622718+0000", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024490500000000001 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.622926+0000", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020786599999999999 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623271+0000", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034430099999999998 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625971+0000", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027000959999999999 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626666+0000", 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069572700000000004 2024-04-22T19:55:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626747+0000", 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0572e-05 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626815+0000", 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8236000000000002e-05 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1296 4.2c 4:343e2248:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.69121386900000004, 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066207729999999999, 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1296 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811093+0000", 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8770000000000002e-06 2024-04-22T19:55:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811108+0000", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4610000000000001e-05 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811139+0000", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1649000000000001e-05 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811160+0000", 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0873000000000002e-05 2024-04-22T19:55:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811370+0000", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020964599999999999 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811667+0000", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029708799999999999 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:55:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409749 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.816968+0000", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048917479999999996 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817495+0000", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052629 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817617+0000", 2024-04-22T19:55:58.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012221500000000001 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817711+0000", 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1297 4.d 4:b02f05ae:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.69108481399999999, 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063288770000000001, 2024-04-22T19:55:58.587 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1297 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811221+0000", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4300000000000001e-06 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811230+0000", 2024-04-22T19:55:58.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4760000000000004e-06 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811270+0000", 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9635999999999998e-05 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811288+0000", 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8077e-05 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811407+0000", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119077 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811671+0000", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026407200000000002 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040566199999999999 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813598+0000", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001521688 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817334+0000", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037357470000000002 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817450+0000", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116041 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817548+0000", 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7971000000000001e-05 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1298 4.3d 4:bd1a4b3a:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.69097322299999997, 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059324319999999996, 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.593 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1298 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811332+0000", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811344+0000", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.128e-05 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811365+0000", 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1239000000000001e-05 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811381+0000", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6093e-05 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811537+0000", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155847 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811894+0000", 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035725600000000002 2024-04-22T19:55:58.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812272+0000", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037791300000000001 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.815056+0000", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027843780000000001 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817030+0000", 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001973313 2024-04-22T19:55:58.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817161+0000", 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131278 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817263+0000", 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102468 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1302 4.3d 4:bcbf267d:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.69090049799999997, 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065603440000000001, 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1302 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811405+0000", 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2899999999999999e-06 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811412+0000", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2570000000000001e-06 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811430+0000", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8019000000000001e-05 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811447+0000", 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7309999999999999e-05 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812941+0000", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014938289999999999 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813318+0000", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037674900000000001 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813703+0000", 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038467900000000002 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817462+0000", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037590240000000001 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817838+0000", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037608599999999998 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817911+0000", 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3292000000000002e-05 2024-04-22T19:55:58.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817964+0000", 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2809000000000002e-05 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.23719807000000001, 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:55:58.604 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:55:58.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:55:58.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:55:58.610 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:55:58.610 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:58.610 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:55:58.610 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:55:58.611 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:55:58.611 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:55:58.611 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.032463 s, 323 MB/s 2024-04-22T19:55:58.611 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:58.606+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:58.612 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:55:58.668 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:55:58.711 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:58.710+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:58.766 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_55_58 2024-04-22T19:55:58.786 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:55:58.786 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:55:58.786 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:55:58.786 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:55:58.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:55:58.811 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:55:58.811 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:55:58.811 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:58.810+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:58.830 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:55:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:55:58.848 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:55:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:55:58.865 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:55:58.866 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:55:58.886 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:55:58.886 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:55:58.899 INFO:tasks.workunit.client.0.smithi111.stdout:quota set for the bucket: buck_2024_03_22_19_55_58 2024-04-22T19:55:58.904 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:55:58.905 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:55:58.912 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:58.910+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:58.921 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:55:58.922 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:55:58.941 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:55:58.941 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:55:58.975 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:58.975 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:58.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:55:59.013 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:55:59.010+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:55:59.114 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:59.114+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:59.124 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_55_58 2024-04-22T19:55:59.124 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 10Mb. 2024-04-22T19:55:59.124 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:55:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:55:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:55:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104723 s, 1.0 GB/s 2024-04-22T19:55:59.158 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.158 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:55:59.187 INFO:tasks.workunit.client.0.smithi111.stdout:readding file to bucket: 10MBfile1 2024-04-22T19:55:59.187 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:59.187 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-22T19:55:59.187 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:55:59.215 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:59.214+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:59.315 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:55:59.314+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:55:59.345 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.345 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:55:59.408 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:55:59.408 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:55:59.416 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:59.414+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:59.446 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:55:59.446 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:55:59.446 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0350331 s, 299 MB/s 2024-04-22T19:55:59.456 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:55:59.482 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.482 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:55:59.537 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:55:59.538+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:55:59.606 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_55_59 2024-04-22T19:55:59.617 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:59.614+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:59.665 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.665 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:55:59.718 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:55:59.714+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:55:59.801 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.801 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.816 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:55:59.818 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:55:59.818+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:55:59.861 INFO:tasks.workunit.client.0.smithi111.stdout:bucket quota max_objs set for the given user: buck_2024_03_22_19_55_59 2024-04-22T19:55:59.919 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:55:59.918+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:55:59.945 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:55:59.945 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:55:59.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:00.020 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:00.018+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:00.088 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_55_59 2024-04-22T19:56:00.088 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 10Mb. 2024-04-22T19:56:00.088 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:56:00.094 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.094 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.108 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:00.116 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records in 2024-04-22T19:56:00.116 INFO:tasks.workunit.client.0.smithi111.stderr:1+0 records out 2024-04-22T19:56:00.116 INFO:tasks.workunit.client.0.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0237224 s, 442 MB/s 2024-04-22T19:56:00.121 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:00.118+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:00.154 INFO:tasks.workunit.client.0.smithi111.stdout:readding file to bucket: 10MBfile1 2024-04-22T19:56:00.155 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:00.155 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-22T19:56:00.155 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:00.222 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:00.218+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:00.228 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.228 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.241 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:00.323 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:00.322+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:00.398 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.398 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:00.413 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:56:00.413 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:00.424 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:00.422+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:00.524 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:00.522+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:00.528 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.528 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.544 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:00.565 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_00 2024-04-22T19:56:00.625 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:00.622+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:00.658 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.658 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.674 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:00.759 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:00.758+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:00.766 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:00.766 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_22_19_56_00 with max size as zero 2024-04-22T19:56:00.766 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:00.766 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:00.826 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:00.826 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:00.827 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:00.826+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:00.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:00.927 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:00.926+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:00.928 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_00 2024-04-22T19:56:00.960 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:01.001 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:01.001 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:01.016 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:01.059 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:01.058+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:01.100 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:01.101 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:01.118 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:01.118 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:01.129 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:01.130+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:01.134 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.135 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_22_19_56_00 with max objects as zero 2024-04-22T19:56:01.135 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.135 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:01.136 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:01.136 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:01.153 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:01.174 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:01.174 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:01.177 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:01.177 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:01.177 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:01.177 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:01.193 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:01.197 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:01.197 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:01.219 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:01.219 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:01.230 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:01.230+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:01.241 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:01.241 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:01.300 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_01 2024-04-22T19:56:01.315 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:01.315 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:01.315 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:01.316 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:01.316 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:01.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:01.331 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:01.330+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:01.432 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:01.430+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:01.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:56:01.495 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.495 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_22_19_56_01 max objects -1 2024-04-22T19:56:01.495 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.495 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:01.497 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:01.497 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:01.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:01.497 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:01.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.08974154800001, 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:01.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:56:01.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:56:01.501 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.011357657, 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.502 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:01.507 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.657769657, 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:56:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:56:01.512 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.47463569600001, 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029322609999999998, 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 841 2024-04-22T19:56:01.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022344+0000", 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022347+0000", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022361+0000", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4046000000000001e-05 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022391+0000", 2024-04-22T19:56:01.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0023e-05 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022406+0000", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022517+0000", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011176299999999999 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.022726+0000", 2024-04-22T19:56:01.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020857499999999999 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.023039+0000", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031260899999999999 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.024274+0000", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012355910000000001 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025076+0000", 2024-04-22T19:56:01.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080133699999999995 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025162+0000", 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6580000000000001e-05 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.025276+0000", 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114264 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.410972554, 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:56:01.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:56:01.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:56:01.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.32867062699999, 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002905632, 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.524 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 907 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168309+0000", 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168312+0000", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6769999999999999e-06 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168325+0000", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168357+0000", 2024-04-22T19:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2245e-05 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168373+0000", 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5843999999999999e-05 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168570+0000", 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019674499999999999 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.168801+0000", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023162000000000001 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.169133+0000", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331615 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.170263+0000", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001130254 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171060+0000", 2024-04-22T19:56:01.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079721299999999996 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171147+0000", 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6458000000000005e-05 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.171215+0000", 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7978000000000005e-05 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5100.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'6, mlcod=71'4)", 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4733328229999998, 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003316318, 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023648+0000", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4700000000000001e-07 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023654+0000", 2024-04-22T19:56:01.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5200000000000003e-06 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023667+0000", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2490000000000001e-05 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023673+0000", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.635e-06 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023725+0000", 2024-04-22T19:56:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1579000000000002e-05 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023744+0000", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8734999999999999e-05 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026940+0000", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003195902 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026963+0000", 2024-04-22T19:56:01.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5100.0:55 7.3 e71/28 7:c609908c:::notify.5:head v 71'7, mlcod=71'5)", 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4732869419999997, 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002986547, 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023693+0000", 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2500000000000001e-07 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023697+0000", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8589999999999998e-06 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023704+0000", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0709999999999997e-06 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023709+0000", 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0780000000000003e-06 2024-04-22T19:56:01.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023752+0000", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3028999999999997e-05 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023771+0000", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8943000000000001e-05 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026635+0000", 2024-04-22T19:56:01.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028634839999999999 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026679+0000", 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4758000000000001e-05 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'9, mlcod=71'7)", 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:01.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3198756039999999, 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030810120000000002, 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177105+0000", 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5000000000000002e-07 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177110+0000", 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3510000000000001e-06 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177122+0000", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2007e-05 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177129+0000", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6529999999999997e-06 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177187+0000", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8319999999999997e-05 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177207+0000", 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0109999999999999e-05 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180141+0000", 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029336520000000001 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180185+0000", 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4168999999999997e-05 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:55 7.3 e71/28 7:c609908c:::notify.5:head v 71'10, mlcod=71'8)", 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3196383469999997, 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046724219999999999, 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177342+0000", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9800000000000003e-07 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177347+0000", 2024-04-22T19:56:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9690000000000002e-06 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177358+0000", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1253000000000001e-05 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177366+0000", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0390000000000005e-06 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177410+0000", 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4131000000000001e-05 2024-04-22T19:56:01.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177426+0000", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5885000000000001e-05 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181969+0000", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045423649999999996 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182014+0000", 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5182000000000002e-05 2024-04-22T19:56:01.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:57 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'10, mlcod=71'8)", 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3162375590000002, 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038103680000000002, 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:01.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180743+0000", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0200000000000001e-07 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180749+0000", 2024-04-22T19:56:01.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3999999999999997e-06 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180761+0000", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1739000000000001e-05 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180768+0000", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0609999999999998e-06 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180821+0000", 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2726999999999998e-05 2024-04-22T19:56:01.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180846+0000", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4641999999999999e-05 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184502+0000", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036559850000000001 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184553+0000", 2024-04-22T19:56:01.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1011999999999999e-05 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1193 3.4 e71/20 3:2024137d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_2:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2138911710000002, 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068172320000000003, 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2399999999999999e-07 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284236+0000", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011472069999999999 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284253+0000", 2024-04-22T19:56:01.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6575e-05 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284263+0000", 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8749999999999995e-06 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284325+0000", 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2482000000000002e-05 2024-04-22T19:56:01.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284341+0000", 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019999999999999e-05 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289866+0000", 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055250630000000002 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289906+0000", 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9585999999999997e-05 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4925.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.7390073500000001, 2024-04-22T19:56:01.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004632471, 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4925", 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/2151403331", 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757974+0000", 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6330000000000001e-06 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757979+0000", 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9679999999999997e-06 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757993+0000", 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3988999999999999e-05 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757999+0000", 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0580000000000003e-06 2024-04-22T19:56:01.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758044+0000", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4502999999999997e-05 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758097+0000", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3452000000000003e-05 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758176+0000", 2024-04-22T19:56:01.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344999999999993e-05 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758625+0000", 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044872500000000002 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762525+0000", 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038995950000000001 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762556+0000", 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1273999999999999e-05 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762605+0000", 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8928999999999999e-05 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4925.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'15, mlcod=71'13)", 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.766678+0000", 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.7303021149999998, 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029830880000000001, 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766678+0000", 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766678+0000", 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766678+0000", 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8800000000000002e-07 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766685+0000", 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5119999999999997e-06 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766695+0000", 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8959999999999998e-06 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766701+0000", 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9089999999999997e-06 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766757+0000", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6719999999999999e-05 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.766776+0000", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8267e-05 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.769632+0000", 2024-04-22T19:56:01.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028561699999999999 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.769661+0000", 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9026e-05 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1300 4.1c 4:3aef1644:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:01.567 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.6861486999999999, 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039934849999999997, 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1300 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:01.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810834+0000", 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.402e-06 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810842+0000", 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9479999999999997e-06 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810864+0000", 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1472e-05 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810875+0000", 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0779e-05 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810940+0000", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832999999999994e-05 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811069+0000", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129288 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811211+0000", 2024-04-22T19:56:01.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000142409 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812095+0000", 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00088343999999999998 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814735+0000", 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026403529999999998 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814784+0000", 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8612000000000001e-05 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814825+0000", 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0948999999999997e-05 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1294 4.19 e71/22 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.68479161, 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045822329999999998, 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:01.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812189+0000", 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7700000000000001e-07 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812196+0000", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8169999999999999e-06 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812204+0000", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4059999999999999e-06 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812209+0000", 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1109999999999999e-06 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812443+0000", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023384600000000001 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812454+0000", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.137e-05 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816733+0000", 2024-04-22T19:56:01.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042785219999999999 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816770+0000", 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7883999999999998e-05 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1297 4.d e71/22 4:b02f05ae:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.5:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:01.578 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.6843406070000002, 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041354290000000004, 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812640+0000", 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812646+0000", 2024-04-22T19:56:01.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5679999999999999e-06 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812659+0000", 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3064999999999999e-05 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812666+0000", 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2450000000000001e-06 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812714+0000", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7683999999999999e-05 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812730+0000", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6801999999999999e-05 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816747+0000", 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040166330000000004 2024-04-22T19:56:01.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816775+0000", 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7708e-05 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5256.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.7955880529999999, 2024-04-22T19:56:01.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035139669999999998, 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5256", 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/457560468", 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701394+0000", 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.846e-06 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701401+0000", 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0319999999999998e-06 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701416+0000", 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5078e-05 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701422+0000", 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7390000000000002e-06 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701490+0000", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7026999999999994e-05 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701585+0000", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5910999999999997e-05 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701728+0000", 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014257300000000001 2024-04-22T19:56:01.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.703294+0000", 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015656680000000001 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704835+0000", 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001540921 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704864+0000", 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.953e-05 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704906+0000", 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1641999999999999e-05 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1925 4.3f 4:fc146a8f:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:01.589 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.21137086699999999, 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037117000000000001, 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1925 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285611+0000", 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1239999999999999e-06 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285620+0000", 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2760000000000006e-06 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285641+0000", 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0769000000000001e-05 2024-04-22T19:56:01.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285651+0000", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0229e-05 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285719+0000", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7235000000000003e-05 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285866+0000", 2024-04-22T19:56:01.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014709099999999999 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286023+0000", 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015727699999999999 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.287286+0000", 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001263068 2024-04-22T19:56:01.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289237+0000", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00195094 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289279+0000", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2415e-05 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289321+0000", 2024-04-22T19:56:01.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1276000000000003e-05 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5255.0:56 7.14 e72/28 7:2b04a3e9:::notify.6:head v 72'72, mlcod=72'70)", 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.092825898000000004, 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031895059999999999, 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:01.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5900000000000003e-07 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404158+0000", 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.709e-06 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404165+0000", 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9709999999999998e-06 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404170+0000", 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8489999999999997e-06 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404222+0000", 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2321999999999998e-05 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404240+0000", 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7566000000000001e-05 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.407302+0000", 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030619430000000001 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.407343+0000", 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1786999999999998e-05 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.600 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:01.602 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:01.603 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:01.598+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:01.651 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_01 2024-04-22T19:56:01.703 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:01.702+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:01.758 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5294.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128370937376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.759172+0000", 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00056608099999999996, 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058262500000000003, 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5294", 2024-04-22T19:56:01.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3117871274", 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759172+0000", 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759172+0000", 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:01.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759173+0000", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5300000000000004e-07 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759176+0000", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4060000000000001e-06 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759183+0000", 2024-04-22T19:56:01.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7050000000000002e-06 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759187+0000", 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1579999999999998e-06 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759241+0000", 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4317000000000002e-05 2024-04-22T19:56:01.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759316+0000", 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4790999999999996e-05 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.759452+0000", 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013595299999999999 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:01.763 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:01.764 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-04-22T19:56:01.764 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:01.773 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:01.819 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:01.818+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:01.849 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.849 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_22_19_56_01 with max size -1 2024-04-22T19:56:01.849 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:01.849 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:01.905 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:01.902+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:01.931 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:01.931 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:01.931 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:01.931 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:01.931 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:01.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:02.035 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:02.034+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:02.105 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.698134442, 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:56:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.698026283, 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.730678133, 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:56:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:56:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:56:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.637260236, 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.46739201, 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1159 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2110236309999998, 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082653799999999993, 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1159 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893557+0000", 2024-04-22T19:56:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1030000000000002e-06 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893573+0000", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6121e-05 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893599+0000", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5527000000000001e-05 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893608+0000", 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5170000000000005e-06 2024-04-22T19:56:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0537e-05 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893784+0000", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114715 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893895+0000", 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111445 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894822+0000", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092721199999999996 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901753+0000", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069308690000000001 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901790+0000", 2024-04-22T19:56:02.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6381000000000003e-05 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9952999999999999e-05 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1165 4.0 4:00b97b13:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2109353179999998, 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081770639999999995, 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.139 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1165 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:02.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893643+0000", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7599999999999997e-07 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893646+0000", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1650000000000002e-06 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893651+0000", 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3859999999999998e-06 2024-04-22T19:56:02.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893655+0000", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6540000000000001e-06 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893714+0000", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8938999999999999e-05 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893815+0000", 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100857 2024-04-22T19:56:02.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893913+0000", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8016999999999993e-05 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894843+0000", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093034900000000002 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901729+0000", 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006885436 2024-04-22T19:56:02.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901777+0000", 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8486000000000003e-05 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2299000000000003e-05 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1166 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2109110960000002, 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083575569999999998, 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1166 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5499999999999999e-07 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.283e-06 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893673+0000", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8380000000000004e-06 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893676+0000", 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8650000000000001e-06 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894194+0000", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000518591 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894267+0000", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2964000000000001e-05 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894353+0000", 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6032000000000006e-05 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.895150+0000", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079645599999999997 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901901+0000", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067511699999999999 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901954+0000", 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2568000000000002e-05 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.902024+0000", 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0535000000000001e-05 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792601852016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.9277437270000002, 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053878320000000004, 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.150 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 55 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:02.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176835+0000", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176838+0000", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0929999999999999e-06 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176845+0000", 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4050000000000003e-06 2024-04-22T19:56:02.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176850+0000", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176904+0000", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4883999999999998e-05 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177000+0000", 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5042000000000002e-05 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177130+0000", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013014 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180207+0000", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030771029999999999 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182137+0000", 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001930733 2024-04-22T19:56:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182169+0000", 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1637000000000002e-05 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182222+0000", 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2747999999999997e-05 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792601856144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.9241257159999998, 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042869960000000004, 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180453+0000", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079999999999999e-06 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180456+0000", 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3469999999999999e-06 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180464+0000", 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0180000000000001e-06 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180469+0000", 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0830000000000003e-06 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180507+0000", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7762000000000002e-05 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180574+0000", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6537000000000003e-05 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180672+0000", 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7918999999999995e-05 2024-04-22T19:56:02.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181837+0000", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011655389999999999 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184672+0000", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028345509999999998 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184702+0000", 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9798000000000002e-05 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184739+0000", 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7434000000000001e-05 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1277 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4851182459999999, 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045028200000000003, 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.161 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1277 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2500000000000005e-07 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619464+0000", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5599999999999998e-06 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619474+0000", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0675e-05 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619480+0000", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0749999999999997e-06 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619526+0000", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6607000000000003e-05 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619576+0000", 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9376999999999998e-05 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619635+0000", 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9954999999999998e-05 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.620179+0000", 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054328299999999998 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623911+0000", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037319580000000001 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623940+0000", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9105999999999999e-05 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623962+0000", 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2498999999999999e-05 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.166 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1284 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4850551149999998, 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047462119999999997, 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1284 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.41e-07 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619524+0000", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.327e-06 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619528+0000", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7299999999999999e-06 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619540+0000", 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619862+0000", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032193199999999998 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619908+0000", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6187999999999999e-05 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619972+0000", 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3182999999999995e-05 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623206+0000", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032341219999999999 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624219+0000", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010137810000000001 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624249+0000", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9887e-05 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624269+0000", 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9531999999999999e-05 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1292 4.19 4:9b504767:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2938443130000001, 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040307520000000003, 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1292 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810735+0000", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9970000000000001e-06 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810744+0000", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0280000000000006e-06 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810768+0000", 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3260000000000001e-05 2024-04-22T19:56:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810778+0000", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0343000000000001e-05 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810877+0000", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8709999999999995e-05 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811005+0000", 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012782000000000001 2024-04-22T19:56:02.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811152+0000", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014767200000000001 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814371+0000", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032191199999999998 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814633+0000", 2024-04-22T19:56:02.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026128399999999997 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814683+0000", 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0744000000000001e-05 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814764+0000", 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0773999999999996e-05 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1294 4.19 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2937753289999998, 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061606559999999996, 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1294 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.178 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810803+0000", 2024-04-22T19:56:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7100000000000002e-07 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810807+0000", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0210000000000001e-06 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810816+0000", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4769999999999992e-06 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810827+0000", 2024-04-22T19:56:02.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380999999999999e-05 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811424+0000", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059679000000000004 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811545+0000", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121489 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811686+0000", 2024-04-22T19:56:02.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014067300000000001 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814379+0000", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026932599999999998 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816906+0000", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002527058 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816937+0000", 2024-04-22T19:56:02.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1092e-05 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816963+0000", 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5843999999999999e-05 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1299 4.28 e71/22 4:14484338:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.7:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2925631180000003, 2024-04-22T19:56:02.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004693521, 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812016+0000", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812023+0000", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8199999999999999e-06 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812031+0000", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9230000000000008e-06 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812036+0000", 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0130000000000001e-06 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812086+0000", 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9762000000000002e-05 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812103+0000", 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6316000000000001e-05 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816666+0000", 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045633499999999999 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816708+0000", 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2246999999999997e-05 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1326 3.7 3:e29da06d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.187 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.835646675, 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01503327, 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1326 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268933+0000", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0229999999999999e-06 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270882+0000", 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001949295 2024-04-22T19:56:02.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270921+0000", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482000000000002e-05 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270939+0000", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.804e-05 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271051+0000", 2024-04-22T19:56:02.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111968 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271162+0000", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110741 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271255+0000", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3273e-05 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.274937+0000", 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036822270000000002 2024-04-22T19:56:02.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283792+0000", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088552119999999995 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283887+0000", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4325000000000002e-05 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283964+0000", 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7683999999999997e-05 2024-04-22T19:56:02.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1923 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.81893457800000002, 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004868397, 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1923 2024-04-22T19:56:02.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285644+0000", 2024-04-22T19:56:02.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9999999999999998e-07 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285647+0000", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5810000000000001e-06 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285662+0000", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4256999999999999e-05 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285670+0000", 2024-04-22T19:56:02.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7630000000000006e-06 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286287+0000", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061706300000000005 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286407+0000", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011989099999999999 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286530+0000", 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000122624 2024-04-22T19:56:02.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289208+0000", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026778790000000002 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290452+0000", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012447479999999999 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290481+0000", 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8659000000000001e-05 2024-04-22T19:56:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290512+0000", 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0431999999999999e-05 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2016 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.61824684900000004, 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041567979999999997, 2024-04-22T19:56:02.198 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2016 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-07 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486335+0000", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2090000000000001e-06 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486344+0000", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.149e-06 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486349+0000", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.135e-06 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486949+0000", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059992900000000002 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487030+0000", 2024-04-22T19:56:02.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0740000000000003e-05 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487130+0000", 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100052 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.488590+0000", 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001460598 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490441+0000", 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018504459999999999 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490468+0000", 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7756999999999999e-05 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490488+0000", 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9208e-05 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2129 4.19 4:996a006b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.26733579099999999, 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064033040000000003, 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2129 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6499999999999999e-07 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837246+0000", 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2770000000000001e-06 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837255+0000", 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3200000000000006e-06 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837261+0000", 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-06 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837317+0000", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6369000000000002e-05 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837393+0000", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5364999999999994e-05 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837489+0000", 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6553999999999997e-05 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838446+0000", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095680699999999995 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843547+0000", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051014950000000002 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843600+0000", 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3068000000000001e-05 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843645+0000", 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4833999999999998e-05 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2132 4.14 4:2ad31bec:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.26729217, 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041151340000000003, 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:02.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2132 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:02.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9500000000000002e-07 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837289+0000", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8030000000000001e-06 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837296+0000", 2024-04-22T19:56:02.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.396e-06 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837302+0000", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3369999999999999e-06 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837359+0000", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7045e-05 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837481+0000", 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012242500000000001 2024-04-22T19:56:02.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837578+0000", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7291000000000001e-05 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838434+0000", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085555400000000002 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841314+0000", 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028799329999999999 2024-04-22T19:56:02.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841367+0000", 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2615999999999999e-05 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841401+0000", 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4139e-05 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:02.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:02.215 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:02.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:02.216 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:02.214+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:02.317 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:02.318+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:02.348 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:02.348 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:02.348 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:02.348 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:02.362 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:02.418 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:02.414+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:02.453 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:56:02.518 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:02.518+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:02.528 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:02.529 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:02.529 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:02.529 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:02.529 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:02.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:02.619 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:02.618+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.714 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.363631321, 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.719 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 105.332156107, 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:56:02.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:56:02.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:56:02.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.117962181, 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:56:02.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:56:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:56:02.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.729 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1160 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.817883288, 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056328690000000004, 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1160 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893841+0000", 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.357e-06 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893854+0000", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2587e-05 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893888+0000", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4338999999999998e-05 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893903+0000", 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4946000000000001e-05 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894116+0000", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021338300000000001 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894507+0000", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039105900000000002 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894916+0000", 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040844500000000001 2024-04-22T19:56:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897575+0000", 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026587410000000001 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899333+0000", 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001758772 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899412+0000", 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8720999999999994e-05 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899472+0000", 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9518999999999997e-05 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1164 4.e 4:738004f6:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8176587020000001, 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120020000000007, 2024-04-22T19:56:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1164 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894065+0000", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3999999999999999e-06 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894073+0000", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3129999999999999e-06 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894092+0000", 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8955999999999999e-05 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894106+0000", 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4209999999999999e-05 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894367+0000", 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026029800000000001 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894704+0000", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033720000000000001 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895099+0000", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039516900000000001 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897619+0000", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025196440000000001 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901913+0000", 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042945250000000004 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901997+0000", 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4182000000000001e-05 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902075+0000", 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8104999999999998e-05 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1167 4.c 4:313a420b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8175726069999998, 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075928640000000004, 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1167 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894151+0000", 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.277e-06 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894159+0000", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8429999999999993e-06 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894420+0000", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026149499999999999 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894439+0000", 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8936e-05 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894583+0000", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014430700000000001 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894859+0000", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027515800000000001 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895244+0000", 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038518899999999997 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897796+0000", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025523529999999998 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901528+0000", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003732244 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901646+0000", 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011786999999999999 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901742+0000", 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6192000000000003e-05 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1158 4.38 e71/22 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8153946770000005, 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053332520000000001, 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896328+0000", 2024-04-22T19:56:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0999999999999997e-07 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896339+0000", 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0370000000000001e-05 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896386+0000", 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7478999999999997e-05 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896405+0000", 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9283000000000002e-05 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896655+0000", 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024980199999999998 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896699+0000", 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4106000000000001e-05 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901558+0000", 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048586569999999997 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901661+0000", 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102645 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.4249956140000002, 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3961529170000002, 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1278 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0919583670000002, 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058606129999999998, 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1278 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.103e-06 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619775+0000", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6129999999999993e-06 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619808+0000", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2549999999999998e-05 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619831+0000", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2606e-05 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620135+0000", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030401099999999997 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620389+0000", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025460499999999998 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620690+0000", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030031699999999998 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623273+0000", 2024-04-22T19:56:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002583082 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625492+0000", 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022194350000000001 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625568+0000", 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6081999999999994e-05 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625624+0000", 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1279 4.35 4:af8a70f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0918129270000003, 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055171339999999999, 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1279 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619911+0000", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619919+0000", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.157e-06 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619947+0000", 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8062e-05 2024-04-22T19:56:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619965+0000", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621510+0000", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001545151 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621711+0000", 2024-04-22T19:56:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020052899999999999 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621991+0000", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028019200000000002 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624413+0000", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024225570000000001 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625241+0000", 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082763499999999996 2024-04-22T19:56:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625326+0000", 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4812e-05 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625426+0000", 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100385 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1296 4.2c 4:343e2248:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.9006318689999997, 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066207729999999999, 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1296 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811093+0000", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8770000000000002e-06 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811108+0000", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4610000000000001e-05 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811139+0000", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1649000000000001e-05 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811160+0000", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0873000000000002e-05 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811370+0000", 2024-04-22T19:56:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020964599999999999 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811667+0000", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029708799999999999 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409749 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.816968+0000", 2024-04-22T19:56:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048917479999999996 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817495+0000", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052629 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817617+0000", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012221500000000001 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817711+0000", 2024-04-22T19:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1297 4.d 4:b02f05ae:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.9005028140000002, 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063288770000000001, 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1297 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811221+0000", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4300000000000001e-06 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811230+0000", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4760000000000004e-06 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811270+0000", 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9635999999999998e-05 2024-04-22T19:56:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811288+0000", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8077e-05 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811407+0000", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119077 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811671+0000", 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026407200000000002 2024-04-22T19:56:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040566199999999999 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813598+0000", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001521688 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817334+0000", 2024-04-22T19:56:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037357470000000002 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817450+0000", 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116041 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817548+0000", 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7971000000000001e-05 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1298 4.3d 4:bd1a4b3a:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.9003912229999997, 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059324319999999996, 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1298 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811332+0000", 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811344+0000", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.128e-05 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811365+0000", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1239000000000001e-05 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811381+0000", 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6093e-05 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811537+0000", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155847 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811894+0000", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035725600000000002 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812272+0000", 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037791300000000001 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.815056+0000", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027843780000000001 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817030+0000", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001973313 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817161+0000", 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131278 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817263+0000", 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102468 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1302 4.3d 4:bcbf267d:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.9003184979999999, 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065603440000000001, 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1302 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811405+0000", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2899999999999999e-06 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811412+0000", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2570000000000001e-06 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811430+0000", 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8019000000000001e-05 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811447+0000", 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7309999999999999e-05 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812941+0000", 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014938289999999999 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813318+0000", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037674900000000001 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813703+0000", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038467900000000002 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817462+0000", 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037590240000000001 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817838+0000", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037608599999999998 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817911+0000", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3292000000000002e-05 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817964+0000", 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2809000000000002e-05 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4466160700000001, 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1438 4.2c 4:356cb9eb:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.3.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.958807915, 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073189539999999999, 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1438 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752915+0000", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4099999999999999e-07 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752918+0000", 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3380000000000001e-06 2024-04-22T19:56:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752927+0000", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6289999999999999e-06 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752934+0000", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5440000000000001e-06 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754268+0000", 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754420+0000", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015206599999999999 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754776+0000", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035611799999999999 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.759810+0000", 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050339740000000001 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760135+0000", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000324495 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760178+0000", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2935000000000001e-05 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760233+0000", 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5336e-05 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2122 4.2e 4:748c5aea:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.87418433200000001, 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067340239999999999, 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2122 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837540+0000", 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837553+0000", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2483000000000001e-05 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837578+0000", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5299999999999998e-05 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837592+0000", 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4323e-05 2024-04-22T19:56:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837712+0000", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119175 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837922+0000", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021048200000000001 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838213+0000", 2024-04-22T19:56:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029056900000000002 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839960+0000", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017478719999999999 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844032+0000", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040710110000000002 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844170+0000", 2024-04-22T19:56:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138734 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844272+0000", 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010155200000000001 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2126 4.3a 4:5c4cf205:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.87400401800000005, 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063795070000000004, 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2126 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837719+0000", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7999999999999995e-07 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837725+0000", 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2790000000000004e-06 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837735+0000", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0043e-05 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837759+0000", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3773000000000001e-05 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837857+0000", 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8255e-05 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838031+0000", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017340699999999999 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838274+0000", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243546 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.841218+0000", 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029444039999999999 2024-04-22T19:56:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.843968+0000", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027496980000000001 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844046+0000", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7396000000000002e-05 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844098+0000", 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2026e-05 2024-04-22T19:56:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2127 4.30 4:0d6d3a23:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.87394636299999995, 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064904150000000002, 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2127 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837777+0000", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.47e-07 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837780+0000", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7400000000000002e-06 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837790+0000", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9329999999999996e-06 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837798+0000", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8890000000000002e-06 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839011+0000", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012130159999999999 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839218+0000", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206543 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839570+0000", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035186000000000001 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.841958+0000", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887880000000002 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844127+0000", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021684009999999999 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844197+0000", 2024-04-22T19:56:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0469000000000006e-05 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844266+0000", 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8829000000000001e-05 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:02.820 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:02.821 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:02.822 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:02.822+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:02.922 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:02.922+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:02.993 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:02.993 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:02.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:02.993 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:03.007 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:03.022 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:03.018+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:03.123 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:03.122+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:03.135 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records in 2024-04-22T19:56:03.135 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records out 2024-04-22T19:56:03.135 INFO:tasks.workunit.client.0.smithi111.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.2847 s, 1.6 GB/s 2024-04-22T19:56:03.174 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:03.174 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:03.174 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:03.174 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:03.174 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:03.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:03.223 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:03.222+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:03.261 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:03.282 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_03 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 105.931859757, 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 105.92645509499999, 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:56:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:56:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:56:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.953263143, 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:56:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.821544985, 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:56:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:56:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:56:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:56:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:56:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.775107949, 2024-04-22T19:56:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.775047562, 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:56:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:56:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:56:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.771470784, 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:56:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:56:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:56:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.766716692, 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:56:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:56:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:56:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:56:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.766631089, 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:56:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 102.46474982399999, 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:56:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:56:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:56:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.5073.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.5770760309999998, 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068417790000000001, 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.5073", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/1523366209", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741536+0000", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741563+0000", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6477000000000001e-05 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741584+0000", 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741605+0000", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0086e-05 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741770+0000", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016539699999999999 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741791+0000", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0628999999999998e-05 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748093+0000", 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063023100000000002 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748215+0000", 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121824 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748376+0000", 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016107400000000001 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1158 4.38 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.4247649779999998, 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084044919999999995, 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1158 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893847+0000", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2970000000000002e-06 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893858+0000", 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0815999999999999e-05 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893888+0000", 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9609999999999999e-05 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893902+0000", 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4375999999999999e-05 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894039+0000", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013648100000000001 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894348+0000", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030901399999999998 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894712+0000", 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036429600000000001 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898011+0000", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032995749999999999 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902012+0000", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040000540000000003 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902161+0000", 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014986399999999999 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902250+0000", 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8109000000000006e-05 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1168 4.36 4:6e3d37f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.4246220239999996, 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733459999999999, 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1168 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893989+0000", 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5269999999999999e-06 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893999+0000", 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4660000000000005e-06 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894019+0000", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0530000000000002e-05 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894039+0000", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9953e-05 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894183+0000", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000143807 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894464+0000", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028028800000000001 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894842+0000", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037805500000000003 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897800+0000", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002958306 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898065+0000", 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026532500000000001 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898176+0000", 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110801 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898261+0000", 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5288000000000001e-05 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.5118.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792601838608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1209410999999996, 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043349520000000004, 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.5118", 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 69 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197671+0000", 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3159999999999999e-06 2024-04-22T19:56:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197681+0000", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4339999999999998e-06 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197710+0000", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9405999999999999e-05 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197724+0000", 2024-04-22T19:56:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4286e-05 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197862+0000", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772099999999999 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197995+0000", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013270400000000001 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.198239+0000", 2024-04-22T19:56:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024383200000000001 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.199256+0000", 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010177910000000001 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.201810+0000", 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025539019999999998 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.201897+0000", 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6268999999999997e-05 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.202004+0000", 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107291 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1276 4.38 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6988440039999997, 2024-04-22T19:56:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066159000000000001, 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1276 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619768+0000", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3800000000000001e-06 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619779+0000", 2024-04-22T19:56:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0226e-05 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619821+0000", 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2286000000000001e-05 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619843+0000", 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620004+0000", 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016069399999999999 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620206+0000", 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020142599999999999 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620465+0000", 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025984499999999998 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623701+0000", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032360800000000001 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626241+0000", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025396049999999999 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626322+0000", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0915999999999996e-05 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626382+0000", 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9905999999999999e-05 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1286 4.36 4:6e3d37f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6987193930000002, 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045958500000000003, 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1286 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619892+0000", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.55e-06 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619900+0000", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4259999999999997e-06 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619922+0000", 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2554000000000001e-05 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619939+0000", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7039000000000001e-05 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620098+0000", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015893400000000001 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620300+0000", 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201996 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620561+0000", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026070500000000002 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623673+0000", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003112568 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624210+0000", 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053618999999999997 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624367+0000", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015762400000000001 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624486+0000", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119264 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4940.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438259993728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3945708830000001, 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124609999999996, 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4940", 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/1789800640", 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924042+0000", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4870000000000001e-06 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924053+0000", 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924085+0000", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1396000000000002e-05 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924099+0000", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924242+0000", 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014274099999999999 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924359+0000", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116801 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924742+0000", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038299599999999998 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.926282+0000", 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001540558 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.928926+0000", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026435400000000002 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.929010+0000", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4575999999999998e-05 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.929152+0000", 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1328 3.d e71/20 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0164310009999999, 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018439563999999999, 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302182+0000", 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0199999999999999e-06 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307605+0000", 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054233349999999996 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307646+0000", 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0252e-05 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307663+0000", 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307796+0000", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013284399999999999 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307831+0000", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5503000000000002e-05 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320466+0000", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01263479 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320619+0000", 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015249 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1930 4.15 4:aa66b718:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.0326336330000001, 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045934749999999996, 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1930 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285979+0000", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.384e-06 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285990+0000", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1671999999999999e-05 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286021+0000", 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-22T19:56:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286036+0000", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4943000000000001e-05 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286206+0000", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016971400000000001 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286569+0000", 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036310299999999998 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.287025+0000", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045601600000000001 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.289067+0000", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020422299999999999 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290363+0000", 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001295601 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290443+0000", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0333999999999994e-05 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290570+0000", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012649800000000001 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2023 4.15 4:aa66b718:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.8319841970000001, 2024-04-22T19:56:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004252914, 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2023 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486628+0000", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486639+0000", 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0959e-05 2024-04-22T19:56:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486675+0000", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5896000000000003e-05 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486697+0000", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1756999999999999e-05 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486838+0000", 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140514 2024-04-22T19:56:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.487084+0000", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024657599999999998 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.487367+0000", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028238100000000001 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.489075+0000", 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017083930000000001 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490708+0000", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016331309999999999 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490819+0000", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011055100000000001 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490879+0000", 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0115999999999998e-05 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:03.427 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:03.427 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:03.428 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:03.428 INFO:tasks.workunit.client.0.smithi111.stdout:quota set for the bucket: buck_2024_03_22_19_56_03 2024-04-22T19:56:03.428 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:03.429 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:03.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:03.429 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:03.426+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:03.430 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:03.430 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:03.446 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:03.447 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:03.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:03.471 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:03.492 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:03.492 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:03.509 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:03.509 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:03.527 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:03.527 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:03.528 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:03.526+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:03.604 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:03.604 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:03.618 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:03.665 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:03.666+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:03.731 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:03.726+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:03.740 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:03.740 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:03.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:03.831 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:03.830+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:03.921 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:03.921 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:03.932 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:03.930+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:03.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:04.033 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:04.030+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:04.100 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.100 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.114 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:04.134 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:04.130+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:04.234 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:04.234+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:04.244 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.244 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:04.336 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:04.334+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:04.427 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.428 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.436 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:04.434+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:04.442 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:04.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:56:04.537 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:04.534+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:04.561 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.562 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:04.637 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:04.634+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:04.688 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.688 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.701 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:04.739 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:04.738+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:04.839 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:04.838+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:04.849 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:04.849 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:04.862 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:04.940 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:04.938+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:05.009 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:05.009 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:05.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:05.067 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:05.066+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:05.140 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:05.140 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:05.142 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:05.142+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:05.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:05.242 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:05.242+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:05.319 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:05.319 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:05.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:05.379 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:05.378+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:05.444 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:05.442+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:05.453 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:05.453 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:05.466 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:05.480 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:56:05.545 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:05.542+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:05.546 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:05.607 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:05.607 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:05.620 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:05.646 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:05.646+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:05.678 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:05.679 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:05.696 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:05.696 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:05.713 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:05.713 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:05.730 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:05.731 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.33123013399999, 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036064869999999998, 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.739 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407238+0000", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407240+0000", 2024-04-22T19:56:05.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2529999999999999e-06 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407248+0000", 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7159999999999992e-06 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407262+0000", 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4105e-05 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407275+0000", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2405000000000001e-05 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407385+0000", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110641 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407424+0000", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8339e-05 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410774+0000", 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003350062 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410845+0000", 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0965999999999998e-05 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:05.743 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.25284624299999, 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034711299999999998, 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 236 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:05.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485622+0000", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485625+0000", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8600000000000001e-06 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485655+0000", 2024-04-22T19:56:05.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9785999999999999e-05 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485686+0000", 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1216000000000001e-05 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485704+0000", 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7849000000000001e-05 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.485859+0000", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015510599999999999 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486196+0000", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033731100000000002 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.486929+0000", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073278999999999998 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488854+0000", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001924416 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.488939+0000", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5360999999999998e-05 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489027+0000", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7886999999999994e-05 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.489093+0000", 2024-04-22T19:56:05.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6548e-05 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.89925824300001, 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003225927, 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:05.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 760 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839210+0000", 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839212+0000", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7099999999999999e-06 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839222+0000", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6739999999999992e-06 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839242+0000", 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0817000000000001e-05 2024-04-22T19:56:05.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839253+0000", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0176e-05 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839388+0000", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013513800000000001 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.839745+0000", 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035724999999999998 2024-04-22T19:56:05.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.840293+0000", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000547946 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.841509+0000", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001215914 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842169+0000", 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066022900000000002 2024-04-22T19:56:05.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842324+0000", 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000154499 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.842436+0000", 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112574 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.65246114, 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029989370000000001, 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 870 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086007+0000", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086009+0000", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086019+0000", 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0447e-05 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086052+0000", 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502000000000002e-05 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086067+0000", 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5457000000000001e-05 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086199+0000", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013134600000000001 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086425+0000", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022634099999999999 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.086893+0000", 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046816199999999999 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088044+0000", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001150653 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088852+0000", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00080798600000000001 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.088942+0000", 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9658000000000001e-05 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:21.089006+0000", 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4624999999999999e-05 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5100.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'6, mlcod=71'4)", 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7148214090000007, 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003316318, 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023647+0000", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023648+0000", 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4700000000000001e-07 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023654+0000", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5200000000000003e-06 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023667+0000", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2490000000000001e-05 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023673+0000", 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.635e-06 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023725+0000", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1579000000000002e-05 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.023744+0000", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8734999999999999e-05 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026940+0000", 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003195902 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.026963+0000", 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:56 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'9, mlcod=71'7)", 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.5613641900000008, 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030810120000000002, 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177104+0000", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177105+0000", 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5000000000000002e-07 2024-04-22T19:56:05.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177110+0000", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3510000000000001e-06 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177122+0000", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2007e-05 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177129+0000", 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6529999999999997e-06 2024-04-22T19:56:05.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177187+0000", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8319999999999997e-05 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177207+0000", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0109999999999999e-05 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180141+0000", 2024-04-22T19:56:05.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029336520000000001 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180185+0000", 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4168999999999997e-05 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:55 7.3 e71/28 7:c609908c:::notify.5:head v 71'10, mlcod=71'8)", 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.5611269330000006, 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046724219999999999, 2024-04-22T19:56:05.768 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177341+0000", 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177342+0000", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9800000000000003e-07 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177347+0000", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9690000000000002e-06 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177358+0000", 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1253000000000001e-05 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177366+0000", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0390000000000005e-06 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177410+0000", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4131000000000001e-05 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177426+0000", 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5885000000000001e-05 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181969+0000", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045423649999999996 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182014+0000", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5182000000000002e-05 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5118.0:57 7.14 e71/28 7:2b04a3e9:::notify.6:head v 71'10, mlcod=71'8)", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:05.772 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.5577261450000002, 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038103680000000002, 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180742+0000", 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180743+0000", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0200000000000001e-07 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180749+0000", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3999999999999997e-06 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180761+0000", 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1739000000000001e-05 2024-04-22T19:56:05.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180768+0000", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0609999999999998e-06 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180821+0000", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2726999999999998e-05 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180846+0000", 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4641999999999999e-05 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184502+0000", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036559850000000001 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184553+0000", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1011999999999999e-05 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1193 3.4 e71/20 3:2024137d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_2:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:05.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4553797569999993, 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068172320000000003, 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.283089+0000", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2399999999999999e-07 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284236+0000", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011472069999999999 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284253+0000", 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6575e-05 2024-04-22T19:56:05.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284263+0000", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8749999999999995e-06 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284325+0000", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2482000000000002e-05 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.284341+0000", 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019999999999999e-05 2024-04-22T19:56:05.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289866+0000", 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055250630000000002 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.289906+0000", 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9585999999999997e-05 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4925.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:05.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.9804959359999996, 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004632471, 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4925", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/2151403331", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757972+0000", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757974+0000", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6330000000000001e-06 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757979+0000", 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9679999999999997e-06 2024-04-22T19:56:05.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757993+0000", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3988999999999999e-05 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.757999+0000", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0580000000000003e-06 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758044+0000", 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4502999999999997e-05 2024-04-22T19:56:05.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758097+0000", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3452000000000003e-05 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758176+0000", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344999999999993e-05 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.758625+0000", 2024-04-22T19:56:05.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044872500000000002 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762525+0000", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038995950000000001 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762556+0000", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1273999999999999e-05 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.762605+0000", 2024-04-22T19:56:05.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8928999999999999e-05 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1300 4.1c 4:3aef1644:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.9276372859999995, 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039934849999999997, 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1300 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810831+0000", 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810834+0000", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.402e-06 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810842+0000", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9479999999999997e-06 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810864+0000", 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1472e-05 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810875+0000", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0779e-05 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810940+0000", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832999999999994e-05 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811069+0000", 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129288 2024-04-22T19:56:05.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811211+0000", 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000142409 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812095+0000", 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00088343999999999998 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814735+0000", 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026403529999999998 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814784+0000", 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8612000000000001e-05 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814825+0000", 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0948999999999997e-05 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1294 4.19 e71/22 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.9262801960000004, 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045822329999999998, 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:05.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812188+0000", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812189+0000", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7700000000000001e-07 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812196+0000", 2024-04-22T19:56:05.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8169999999999999e-06 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812204+0000", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4059999999999999e-06 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812209+0000", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1109999999999999e-06 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812443+0000", 2024-04-22T19:56:05.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023384600000000001 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812454+0000", 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.137e-05 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816733+0000", 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042785219999999999 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816770+0000", 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7883999999999998e-05 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1297 4.d e71/22 4:b02f05ae:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.5:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.9258291930000002, 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041354290000000004, 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812639+0000", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812640+0000", 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-04-22T19:56:05.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812646+0000", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5679999999999999e-06 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812659+0000", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3064999999999999e-05 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812666+0000", 2024-04-22T19:56:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2450000000000001e-06 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812714+0000", 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7683999999999999e-05 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812730+0000", 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6801999999999999e-05 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816747+0000", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040166330000000004 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816775+0000", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7708e-05 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5256.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:05.800 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.0370766390000004, 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035139669999999998, 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5256", 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/457560468", 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701392+0000", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701394+0000", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.846e-06 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701401+0000", 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0319999999999998e-06 2024-04-22T19:56:05.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701416+0000", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5078e-05 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701422+0000", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7390000000000002e-06 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701490+0000", 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7026999999999994e-05 2024-04-22T19:56:05.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701585+0000", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5910999999999997e-05 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.701728+0000", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014257300000000001 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.703294+0000", 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015656680000000001 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704835+0000", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001540921 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704864+0000", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.953e-05 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.704906+0000", 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1641999999999999e-05 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.805 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1925 4.3f 4:fc146a8f:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4528594530000003, 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037117000000000001, 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:05.806 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1925 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285609+0000", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285611+0000", 2024-04-22T19:56:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1239999999999999e-06 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285620+0000", 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2760000000000006e-06 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285641+0000", 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0769000000000001e-05 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285651+0000", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0229e-05 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285719+0000", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7235000000000003e-05 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285866+0000", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014709099999999999 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:05.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286023+0000", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015727699999999999 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.287286+0000", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001263068 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289237+0000", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00195094 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289279+0000", 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2415e-05 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289321+0000", 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1276000000000003e-05 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5255.0:56 7.14 e72/28 7:2b04a3e9:::notify.6:head v 72'72, mlcod=72'70)", 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3343144840000001, 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031895059999999999, 2024-04-22T19:56:05.811 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404154+0000", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5900000000000003e-07 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404158+0000", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.709e-06 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404165+0000", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9709999999999998e-06 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404170+0000", 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8489999999999997e-06 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404222+0000", 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2321999999999998e-05 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.404240+0000", 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7566000000000001e-05 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.407302+0000", 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030619430000000001 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.407343+0000", 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1786999999999998e-05 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5294.0:56 7.14 e72/28 7:2b04a3e9:::notify.6:head v 72'78, mlcod=72'76)", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.755826+0000", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.982642486, 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003097444, 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755826+0000", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755826+0000", 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755827+0000", 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1600000000000001e-07 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755832+0000", 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3580000000000002e-06 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755839+0000", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3509999999999996e-06 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755845+0000", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9630000000000003e-06 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755890+0000", 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4969999999999998e-05 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.755907+0000", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6776e-05 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.758881+0000", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002973837 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.758923+0000", 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2472999999999998e-05 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2129 4.19 e72/22 4:996a006b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.7:head v 72'14, mlcod=72'12)", 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837856+0000", 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9006128269999998, 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055973139999999999, 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837856+0000", 2024-04-22T19:56:05.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837856+0000", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837857+0000", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837864+0000", 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0820000000000001e-06 2024-04-22T19:56:05.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837876+0000", 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2198000000000001e-05 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837884+0000", 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5619999999999998e-06 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837935+0000", 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837955+0000", 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0353999999999999e-05 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843374+0000", 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054193139999999997 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843453+0000", 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8427e-05 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2122 4.2e e72/22 4:748c5aea:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.0:head v 72'2, mlcod=0'0)", 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.838225+0000", 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9002430930000003, 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052173289999999997, 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.824 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838225+0000", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838225+0000", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838226+0000", 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-22T19:56:05.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838230+0000", 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1559999999999997e-06 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838243+0000", 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2736e-05 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838250+0000", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3289999999999996e-06 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838313+0000", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2633999999999997e-05 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838334+0000", 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0727999999999999e-05 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843396+0000", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050623899999999999 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843443+0000", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6662999999999997e-05 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.5610.0:56 7.14 e73/28 7:2b04a3e9:::notify.6:head v 73'84, mlcod=73'82)", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:03.375107+0000", 2024-04-22T19:56:05.828 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.3633611070000002, 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034969350000000001, 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375107+0000", 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375107+0000", 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:05.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375108+0000", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4999999999999998e-07 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375112+0000", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9670000000000003e-06 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375119+0000", 2024-04-22T19:56:05.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0110000000000003e-06 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375124+0000", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2750000000000003e-06 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375222+0000", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7614000000000004e-05 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.375239+0000", 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7920000000000001e-05 2024-04-22T19:56:05.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.378561+0000", 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033213420000000001 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:03.378604+0000", 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3455999999999999e-05 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:05.832 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:05.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:05.834 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:05.834 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:05.835 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:05.835 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:05.835 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:05.835 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:05.836 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:05.836 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:05.837 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:05.834+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:05.935 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:05.930+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:05.987 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:05.987 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:05.987 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:05.987 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:06.000 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:06.035 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:06.034+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:06.137 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:06.134+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:06.168 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:06.168 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:06.168 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:06.168 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:06.168 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:06.182 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:06.237 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:06.234+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.899288418, 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:56:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.899180259, 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.315 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:06.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.931832109, 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.321 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:56:06.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:56:06.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.838414212, 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.327 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:56:06.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 105.668545986, 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:56:06.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:56:06.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1159 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.4121776070000003, 2024-04-22T19:56:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082653799999999993, 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1159 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893557+0000", 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1030000000000002e-06 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893573+0000", 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6121e-05 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893599+0000", 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5527000000000001e-05 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893608+0000", 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5170000000000005e-06 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0537e-05 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893784+0000", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114715 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893895+0000", 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111445 2024-04-22T19:56:06.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894822+0000", 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092721199999999996 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901753+0000", 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069308690000000001 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901790+0000", 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6381000000000003e-05 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9952999999999999e-05 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1165 4.0 4:00b97b13:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.4120892939999994, 2024-04-22T19:56:06.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081770639999999995, 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1165 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893643+0000", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7599999999999997e-07 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893646+0000", 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1650000000000002e-06 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893651+0000", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3859999999999998e-06 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893655+0000", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6540000000000001e-06 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893714+0000", 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8938999999999999e-05 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893815+0000", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100857 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893913+0000", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8016999999999993e-05 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894843+0000", 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093034900000000002 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901729+0000", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006885436 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901777+0000", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8486000000000003e-05 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2299000000000003e-05 2024-04-22T19:56:06.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1166 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.4120650720000008, 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083575569999999998, 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1166 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:06.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5499999999999999e-07 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.283e-06 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893673+0000", 2024-04-22T19:56:06.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8380000000000004e-06 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893676+0000", 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8650000000000001e-06 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894194+0000", 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000518591 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894267+0000", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2964000000000001e-05 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894353+0000", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6032000000000006e-05 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.895150+0000", 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079645599999999997 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901901+0000", 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067511699999999999 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901954+0000", 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2568000000000002e-05 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.902024+0000", 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0535000000000001e-05 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792601852016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.1288977029999998, 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053878320000000004, 2024-04-22T19:56:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 55 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176835+0000", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176838+0000", 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0929999999999999e-06 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176845+0000", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4050000000000003e-06 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176850+0000", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176904+0000", 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4883999999999998e-05 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177000+0000", 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5042000000000002e-05 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177130+0000", 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013014 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180207+0000", 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030771029999999999 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182137+0000", 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001930733 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182169+0000", 2024-04-22T19:56:06.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1637000000000002e-05 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182222+0000", 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2747999999999997e-05 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792601856144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.1252796919999994, 2024-04-22T19:56:06.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042869960000000004, 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:06.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180453+0000", 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079999999999999e-06 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180456+0000", 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3469999999999999e-06 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180464+0000", 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0180000000000001e-06 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180469+0000", 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0830000000000003e-06 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180507+0000", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7762000000000002e-05 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180574+0000", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6537000000000003e-05 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180672+0000", 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7918999999999995e-05 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181837+0000", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011655389999999999 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184672+0000", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028345509999999998 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184702+0000", 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9798000000000002e-05 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184739+0000", 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7434000000000001e-05 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1277 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.6862722219999995, 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045028200000000003, 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1277 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:06.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2500000000000005e-07 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619464+0000", 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5599999999999998e-06 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619474+0000", 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0675e-05 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619480+0000", 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0749999999999997e-06 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619526+0000", 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6607000000000003e-05 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619576+0000", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9376999999999998e-05 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619635+0000", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9954999999999998e-05 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.620179+0000", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054328299999999998 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623911+0000", 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037319580000000001 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623940+0000", 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9105999999999999e-05 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623962+0000", 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2498999999999999e-05 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1284 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.6862090910000003, 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047462119999999997, 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1284 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.375 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:06.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.41e-07 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619524+0000", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.327e-06 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619528+0000", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7299999999999999e-06 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619540+0000", 2024-04-22T19:56:06.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619862+0000", 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032193199999999998 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619908+0000", 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6187999999999999e-05 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619972+0000", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3182999999999995e-05 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623206+0000", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032341219999999999 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624219+0000", 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010137810000000001 2024-04-22T19:56:06.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624249+0000", 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9887e-05 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624269+0000", 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9531999999999999e-05 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1292 4.19 4:9b504767:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4949982889999998, 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040307520000000003, 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1292 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810735+0000", 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9970000000000001e-06 2024-04-22T19:56:06.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810744+0000", 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0280000000000006e-06 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810768+0000", 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3260000000000001e-05 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810778+0000", 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0343000000000001e-05 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810877+0000", 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8709999999999995e-05 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811005+0000", 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012782000000000001 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811152+0000", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014767200000000001 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814371+0000", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032191199999999998 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814633+0000", 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026128399999999997 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814683+0000", 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0744000000000001e-05 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814764+0000", 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0773999999999996e-05 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1294 4.19 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.386 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4949293049999994, 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061606559999999996, 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1294 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810803+0000", 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7100000000000002e-07 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810807+0000", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0210000000000001e-06 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810816+0000", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4769999999999992e-06 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810827+0000", 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380999999999999e-05 2024-04-22T19:56:06.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811424+0000", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059679000000000004 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811545+0000", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121489 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811686+0000", 2024-04-22T19:56:06.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014067300000000001 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814379+0000", 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026932599999999998 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816906+0000", 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002527058 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816937+0000", 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1092e-05 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816963+0000", 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5843999999999999e-05 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1299 4.28 e71/22 4:14484338:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.7:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:06.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4937170940000009, 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004693521, 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812016+0000", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812023+0000", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8199999999999999e-06 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812031+0000", 2024-04-22T19:56:06.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9230000000000008e-06 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812036+0000", 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0130000000000001e-06 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812086+0000", 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9762000000000002e-05 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812103+0000", 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6316000000000001e-05 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816666+0000", 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045633499999999999 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816708+0000", 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2246999999999997e-05 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1326 3.7 3:e29da06d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.0368006510000001, 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01503327, 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1326 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268933+0000", 2024-04-22T19:56:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0229999999999999e-06 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270882+0000", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001949295 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270921+0000", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482000000000002e-05 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270939+0000", 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.804e-05 2024-04-22T19:56:06.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271051+0000", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111968 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271162+0000", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110741 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271255+0000", 2024-04-22T19:56:06.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3273e-05 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.274937+0000", 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036822270000000002 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283792+0000", 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088552119999999995 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283887+0000", 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4325000000000002e-05 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283964+0000", 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7683999999999997e-05 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.402 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1923 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.020088554, 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004868397, 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1923 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285644+0000", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9999999999999998e-07 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285647+0000", 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5810000000000001e-06 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285662+0000", 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4256999999999999e-05 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285670+0000", 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7630000000000006e-06 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286287+0000", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061706300000000005 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286407+0000", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011989099999999999 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286530+0000", 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000122624 2024-04-22T19:56:06.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289208+0000", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026778790000000002 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290452+0000", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012447479999999999 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290481+0000", 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8659000000000001e-05 2024-04-22T19:56:06.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290512+0000", 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0431999999999999e-05 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2016 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.8194008249999998, 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041567979999999997, 2024-04-22T19:56:06.408 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2016 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-07 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486335+0000", 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2090000000000001e-06 2024-04-22T19:56:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486344+0000", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.149e-06 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486349+0000", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.135e-06 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486949+0000", 2024-04-22T19:56:06.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059992900000000002 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487030+0000", 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0740000000000003e-05 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487130+0000", 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100052 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.488590+0000", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001460598 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490441+0000", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018504459999999999 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490468+0000", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7756999999999999e-05 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490488+0000", 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9208e-05 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2129 4.19 4:996a006b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4684897670000003, 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064033040000000003, 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2129 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6499999999999999e-07 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837246+0000", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2770000000000001e-06 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837255+0000", 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3200000000000006e-06 2024-04-22T19:56:06.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837261+0000", 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-06 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837317+0000", 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6369000000000002e-05 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837393+0000", 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5364999999999994e-05 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837489+0000", 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6553999999999997e-05 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838446+0000", 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095680699999999995 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843547+0000", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051014950000000002 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843600+0000", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3068000000000001e-05 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843645+0000", 2024-04-22T19:56:06.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4833999999999998e-05 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2132 4.14 4:2ad31bec:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4684461459999998, 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041151340000000003, 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:06.420 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2132 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9500000000000002e-07 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837289+0000", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8030000000000001e-06 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837296+0000", 2024-04-22T19:56:06.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.396e-06 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837302+0000", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3369999999999999e-06 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837359+0000", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7045e-05 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837481+0000", 2024-04-22T19:56:06.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012242500000000001 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837578+0000", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7291000000000001e-05 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838434+0000", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085555400000000002 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841314+0000", 2024-04-22T19:56:06.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028799329999999999 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841367+0000", 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2615999999999999e-05 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841401+0000", 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4139e-05 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:06.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:06.426 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:06.427 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:06.427 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:06.426+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:06.528 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:06.526+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:06.563 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:06.563 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:06.563 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:06.563 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:06.577 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:06.669 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:06.670+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:06.730 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:06.730+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:06.749 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:06.749 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:06.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:06.849 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:06.850+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:06.932 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:06.930+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:06.933 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:06.933 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 111.58310885100001, 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:56:06.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 109.55163363699999, 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050902090000000001, 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379566+0000", 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379567+0000", 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4499999999999997e-07 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379584+0000", 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7535999999999999e-05 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379600+0000", 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5914999999999999e-05 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.379619+0000", 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8413000000000001e-05 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380061+0000", 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044273700000000001 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.380114+0000", 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3115000000000002e-05 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384542+0000", 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004427444 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384656+0000", 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114404 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 106.337439711, 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047512759999999996, 2024-04-22T19:56:06.946 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 504 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593760+0000", 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593762+0000", 2024-04-22T19:56:06.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593771+0000", 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8589999999999994e-06 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593797+0000", 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6157999999999999e-05 2024-04-22T19:56:06.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593813+0000", 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841999999999998e-05 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593886+0000", 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2631000000000003e-05 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.593984+0000", 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8726000000000003e-05 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.594204+0000", 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021973899999999999 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.595335+0000", 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011313320000000001 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598366+0000", 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030305570000000001 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598446+0000", 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0496999999999999e-05 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.598511+0000", 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4801000000000005e-05 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.953 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1160 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.037360818, 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056328690000000004, 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1160 2024-04-22T19:56:06.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893839+0000", 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893841+0000", 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.357e-06 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893854+0000", 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2587e-05 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893888+0000", 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4338999999999998e-05 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893903+0000", 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4946000000000001e-05 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894116+0000", 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021338300000000001 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894507+0000", 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039105900000000002 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894916+0000", 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040844500000000001 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897575+0000", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026587410000000001 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899333+0000", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001758772 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899412+0000", 2024-04-22T19:56:06.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8720999999999994e-05 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.899472+0000", 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9518999999999997e-05 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1164 4.e 4:738004f6:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:06.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.037136232, 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120020000000007, 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1164 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.961 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894063+0000", 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894065+0000", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3999999999999999e-06 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894073+0000", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3129999999999999e-06 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894092+0000", 2024-04-22T19:56:06.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8955999999999999e-05 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894106+0000", 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4209999999999999e-05 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894367+0000", 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026029800000000001 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894704+0000", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033720000000000001 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895099+0000", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039516900000000001 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897619+0000", 2024-04-22T19:56:06.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025196440000000001 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901913+0000", 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042945250000000004 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901997+0000", 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4182000000000001e-05 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902075+0000", 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8104999999999998e-05 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1167 4.c 4:313a420b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:06.967 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.037050137, 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075928640000000004, 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1167 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894149+0000", 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894151+0000", 2024-04-22T19:56:06.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.277e-06 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894159+0000", 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8429999999999993e-06 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894420+0000", 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026149499999999999 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894439+0000", 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8936e-05 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894583+0000", 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014430700000000001 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894859+0000", 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027515800000000001 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.895244+0000", 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038518899999999997 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897796+0000", 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025523529999999998 2024-04-22T19:56:06.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901528+0000", 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003732244 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901646+0000", 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011786999999999999 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901742+0000", 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6192000000000003e-05 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1158 4.38 e71/22 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.034872206999999, 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053332520000000001, 2024-04-22T19:56:06.974 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896327+0000", 2024-04-22T19:56:06.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896328+0000", 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0999999999999997e-07 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896339+0000", 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0370000000000001e-05 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896386+0000", 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7478999999999997e-05 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896405+0000", 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9283000000000002e-05 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896655+0000", 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024980199999999998 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.896699+0000", 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4106000000000001e-05 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901558+0000", 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048586569999999997 2024-04-22T19:56:06.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.901661+0000", 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102645 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6444731439999991, 2024-04-22T19:56:06.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6156304470000009, 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:06.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1278 4.1 4:832a89ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3114358970000008, 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058606129999999998, 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1278 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619764+0000", 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.103e-06 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619775+0000", 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6129999999999993e-06 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619808+0000", 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2549999999999998e-05 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619831+0000", 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2606e-05 2024-04-22T19:56:06.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620135+0000", 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030401099999999997 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620389+0000", 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025460499999999998 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620690+0000", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030031699999999998 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623273+0000", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002583082 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625492+0000", 2024-04-22T19:56:06.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022194350000000001 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625568+0000", 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6081999999999994e-05 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625624+0000", 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.996 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1279 4.35 4:af8a70f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3112904570000001, 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055171339999999999, 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:06.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1279 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:06.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619909+0000", 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619911+0000", 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619919+0000", 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.157e-06 2024-04-22T19:56:06.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619947+0000", 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8062e-05 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619965+0000", 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621510+0000", 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001545151 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621711+0000", 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020052899999999999 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.621991+0000", 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028019200000000002 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624413+0000", 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024225570000000001 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625241+0000", 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00082763499999999996 2024-04-22T19:56:07.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625326+0000", 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4812e-05 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.625426+0000", 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100385 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1296 4.2c 4:343e2248:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1201093990000004, 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066207729999999999, 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.004 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1296 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811090+0000", 2024-04-22T19:56:07.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811093+0000", 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8770000000000002e-06 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811108+0000", 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4610000000000001e-05 2024-04-22T19:56:07.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811139+0000", 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1649000000000001e-05 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811160+0000", 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0873000000000002e-05 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811370+0000", 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020964599999999999 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811667+0000", 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029708799999999999 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409749 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.816968+0000", 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048917479999999996 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817495+0000", 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052629 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817617+0000", 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012221500000000001 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817711+0000", 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4028000000000002e-05 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1297 4.d 4:b02f05ae:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.119980344, 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063288770000000001, 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.011 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1297 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811219+0000", 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811221+0000", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4300000000000001e-06 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811230+0000", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4760000000000004e-06 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811270+0000", 2024-04-22T19:56:07.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9635999999999998e-05 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811288+0000", 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8077e-05 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811407+0000", 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119077 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811671+0000", 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026407200000000002 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812077+0000", 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040566199999999999 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813598+0000", 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001521688 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817334+0000", 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037357470000000002 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817450+0000", 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116041 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817548+0000", 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7971000000000001e-05 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1298 4.3d 4:bd1a4b3a:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:07.017 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1198687530000004, 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059324319999999996, 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1298 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811331+0000", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811332+0000", 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811344+0000", 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.128e-05 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811365+0000", 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1239000000000001e-05 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811381+0000", 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6093e-05 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811537+0000", 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155847 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811894+0000", 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035725600000000002 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812272+0000", 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037791300000000001 2024-04-22T19:56:07.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.815056+0000", 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027843780000000001 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817030+0000", 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001973313 2024-04-22T19:56:07.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817161+0000", 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131278 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817263+0000", 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102468 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1302 4.3d 4:bcbf267d:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1197960279999997, 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065603440000000001, 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.025 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1302 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811404+0000", 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811405+0000", 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2899999999999999e-06 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811412+0000", 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2570000000000001e-06 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811430+0000", 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8019000000000001e-05 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.811447+0000", 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7309999999999999e-05 2024-04-22T19:56:07.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.812941+0000", 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014938289999999999 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813318+0000", 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037674900000000001 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.813703+0000", 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038467900000000002 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817462+0000", 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037590240000000001 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817838+0000", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037608599999999998 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817911+0000", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3292000000000002e-05 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.817964+0000", 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2809000000000002e-05 2024-04-22T19:56:07.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6660936, 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.032 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:07.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1438 4.2c 4:356cb9eb:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.3.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1782854450000002, 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073189539999999999, 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.039 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1438 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:07.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752914+0000", 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752915+0000", 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4099999999999999e-07 2024-04-22T19:56:07.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752918+0000", 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3380000000000001e-06 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752927+0000", 2024-04-22T19:56:07.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6289999999999999e-06 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.752934+0000", 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5440000000000001e-06 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754268+0000", 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754420+0000", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015206599999999999 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.754776+0000", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035611799999999999 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.759810+0000", 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050339740000000001 2024-04-22T19:56:07.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760135+0000", 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000324495 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760178+0000", 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2935000000000001e-05 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.760233+0000", 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5336e-05 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2122 4.2e 4:748c5aea:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0936618620000003, 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067340239999999999, 2024-04-22T19:56:07.046 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2122 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837538+0000", 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837540+0000", 2024-04-22T19:56:07.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837553+0000", 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2483000000000001e-05 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837578+0000", 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5299999999999998e-05 2024-04-22T19:56:07.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837592+0000", 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4323e-05 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837712+0000", 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119175 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837922+0000", 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021048200000000001 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838213+0000", 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029056900000000002 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839960+0000", 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017478719999999999 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844032+0000", 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040710110000000002 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844170+0000", 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138734 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844272+0000", 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010155200000000001 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.053 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2126 4.3a 4:5c4cf205:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0934815479999997, 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063795070000000004, 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2126 2024-04-22T19:56:07.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837718+0000", 2024-04-22T19:56:07.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837719+0000", 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7999999999999995e-07 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837725+0000", 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2790000000000004e-06 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837735+0000", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0043e-05 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837759+0000", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3773000000000001e-05 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837857+0000", 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8255e-05 2024-04-22T19:56:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838031+0000", 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017340699999999999 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.838274+0000", 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243546 2024-04-22T19:56:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.841218+0000", 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029444039999999999 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.843968+0000", 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027496980000000001 2024-04-22T19:56:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844046+0000", 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7396000000000002e-05 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844098+0000", 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2026e-05 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.060 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2127 4.30 4:0d6d3a23:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0934238929999998, 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064904150000000002, 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.061 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2127 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837776+0000", 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837777+0000", 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.47e-07 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837780+0000", 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7400000000000002e-06 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837790+0000", 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9329999999999996e-06 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.837798+0000", 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8890000000000002e-06 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839011+0000", 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012130159999999999 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839218+0000", 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206543 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.839570+0000", 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035186000000000001 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.841958+0000", 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887880000000002 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844127+0000", 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021684009999999999 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844197+0000", 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0469000000000006e-05 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.844266+0000", 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8829000000000001e-05 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.067 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.068 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.068 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.068 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:07.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:07.070 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:07.066+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:07.170 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:07.166+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:07.241 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:07.241 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:07.241 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:07.242 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:07.255 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:07.301 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:07.302+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_56_03 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 2Gb. 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:07.352 INFO:tasks.workunit.client.0.smithi111.stdout:delete objects successful 2024-04-22T19:56:07.371 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:07.370+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:07.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:07.477 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:07.478+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:07.504 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:56:07.561 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:07.561 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:07.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:07.561 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 110.17400795499999, 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005112325, 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.562 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386750+0000", 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386753+0000", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.999e-06 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386764+0000", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386790+0000", 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6611999999999999e-05 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386805+0000", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4993e-05 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.386960+0000", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001549 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387251+0000", 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029126500000000002 2024-04-22T19:56:07.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.387523+0000", 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027187799999999997 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.388836+0000", 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013124110000000001 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391685+0000", 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002849192 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391799+0000", 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114324 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.391863+0000", 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3429000000000005e-05 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903869245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 110.168603293, 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064763080000000001, 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.568 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392155+0000", 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392157+0000", 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1169999999999998e-06 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392168+0000", 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.061e-05 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392194+0000", 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6401e-05 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392207+0000", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3233e-05 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392286+0000", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9003000000000002e-05 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392425+0000", 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139233 2024-04-22T19:56:07.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.392626+0000", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020033599999999999 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.393992+0000", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013665000000000001 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398332+0000", 2024-04-22T19:56:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043397139999999997 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398443+0000", 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011101 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.398631+0000", 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018815100000000001 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.195411341, 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046974759999999999, 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-22T19:56:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365347+0000", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365350+0000", 2024-04-22T19:56:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3230000000000002e-06 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365389+0000", 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8680000000000002e-05 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365425+0000", 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6134000000000003e-05 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365443+0000", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8051e-05 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365613+0000", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170316 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.365992+0000", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037824499999999998 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.366724+0000", 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073202599999999999 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.368507+0000", 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017833530000000001 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369841+0000", 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001333978 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.369927+0000", 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6130000000000004e-05 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.370044+0000", 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011724 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.579 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.063693183, 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044597259999999998, 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 271 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497065+0000", 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497067+0000", 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2730000000000001e-06 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497079+0000", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1365999999999999e-05 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497101+0000", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2541999999999999e-05 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497115+0000", 2024-04-22T19:56:07.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3352e-05 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497266+0000", 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015152399999999999 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497468+0000", 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020191299999999999 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:07.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.497889+0000", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042083499999999999 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.499073+0000", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011845969999999999 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501346+0000", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022730189999999998 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501431+0000", 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4787e-05 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.501525+0000", 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3517999999999995e-05 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:424 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.017256147, 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080782809999999997, 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 424 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543502+0000", 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543503+0000", 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7700000000000003e-07 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543508+0000", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.651e-06 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543518+0000", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088000000000001e-05 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543539+0000", 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0900999999999999e-05 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544487+0000", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094813799999999995 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544731+0000", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244632 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.545214+0000", 2024-04-22T19:56:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048300600000000002 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.546274+0000", 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010601409999999999 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551373+0000", 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050982930000000003 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551482+0000", 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109017 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551580+0000", 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8536999999999995e-05 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.01719576000001, 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072193279999999997, 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 425 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543562+0000", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543563+0000", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1399999999999996e-07 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543568+0000", 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8679999999999998e-06 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543578+0000", 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6590000000000002e-06 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543585+0000", 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9399999999999996e-06 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543666+0000", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1094000000000007e-05 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.543870+0000", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203795 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.544204+0000", 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033447199999999999 2024-04-22T19:56:07.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.549940+0000", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057356170000000001 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550650+0000", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071063400000000003 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550726+0000", 2024-04-22T19:56:07.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5226000000000001e-05 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.550782+0000", 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6208999999999997e-05 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:427 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:07.597 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.013618982, 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046561950000000001, 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 427 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547139+0000", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547141+0000", 2024-04-22T19:56:07.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4729999999999999e-06 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547149+0000", 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7059999999999993e-06 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547170+0000", 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0789e-05 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547182+0000", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2174999999999999e-05 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547258+0000", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5600999999999997e-05 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547372+0000", 2024-04-22T19:56:07.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113964 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.547782+0000", 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000409615 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.548708+0000", 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00092650600000000001 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551602+0000", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002894434 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551708+0000", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010582 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551795+0000", 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7112000000000002e-05 2024-04-22T19:56:07.603 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:430 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.00886489, 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046950009999999999, 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.604 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551893+0000", 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551894+0000", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6300000000000004e-07 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551899+0000", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.203e-06 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551911+0000", 2024-04-22T19:56:07.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1316e-05 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551919+0000", 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552860+0000", 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00094162800000000002 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553136+0000", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027605700000000002 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.553657+0000", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00052034 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.555923+0000", 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022664220000000001 2024-04-22T19:56:07.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556375+0000", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000452366 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556473+0000", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7617999999999999e-05 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556588+0000", 2024-04-22T19:56:07.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011523600000000001 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:431 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.008779287, 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051921490000000001, 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.610 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 431 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551979+0000", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551980+0000", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8599999999999996e-07 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551985+0000", 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.22e-06 2024-04-22T19:56:07.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.551996+0000", 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1103e-05 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.552004+0000", 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1850000000000004e-06 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554403+0000", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023984050000000002 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554577+0000", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017469100000000001 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.554863+0000", 2024-04-22T19:56:07.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028568199999999999 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556644+0000", 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001781047 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.556944+0000", 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029950000000000002 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557076+0000", 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013230300000000001 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.557171+0000", 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5026999999999997e-05 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.616 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 106.706898022, 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055963879999999999, 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 766 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.617 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853860+0000", 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853862+0000", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.95e-06 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853873+0000", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0971999999999999e-05 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853904+0000", 2024-04-22T19:56:07.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0545e-05 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.853919+0000", 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5148e-05 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854041+0000", 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122366 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854371+0000", 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033022999999999999 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.854908+0000", 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053656799999999996 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.856079+0000", 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001170592 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859191+0000", 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031120660000000001 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859342+0000", 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015180400000000001 2024-04-22T19:56:07.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:20.859457+0000", 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114147 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.5073.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.819224229, 2024-04-22T19:56:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068417790000000001, 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.5073", 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/1523366209", 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:07.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741534+0000", 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741536+0000", 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741563+0000", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6477000000000001e-05 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741584+0000", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741605+0000", 2024-04-22T19:56:07.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0086e-05 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741770+0000", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016539699999999999 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.741791+0000", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0628999999999998e-05 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748093+0000", 2024-04-22T19:56:07.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063023100000000002 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748215+0000", 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121824 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.748376+0000", 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016107400000000001 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1158 4.38 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.666913176, 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084044919999999995, 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1158 2024-04-22T19:56:07.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893845+0000", 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893847+0000", 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2970000000000002e-06 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893858+0000", 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0815999999999999e-05 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893888+0000", 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9609999999999999e-05 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893902+0000", 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4375999999999999e-05 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894039+0000", 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013648100000000001 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894348+0000", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030901399999999998 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894712+0000", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036429600000000001 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898011+0000", 2024-04-22T19:56:07.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032995749999999999 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902012+0000", 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040000540000000003 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902161+0000", 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014986399999999999 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.902250+0000", 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8109000000000006e-05 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1168 4.36 4:6e3d37f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.666770222, 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733459999999999, 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1168 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893988+0000", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893989+0000", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5269999999999999e-06 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.893999+0000", 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4660000000000005e-06 2024-04-22T19:56:07.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894019+0000", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0530000000000002e-05 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894039+0000", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9953e-05 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894183+0000", 2024-04-22T19:56:07.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000143807 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894464+0000", 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028028800000000001 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.894842+0000", 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037805500000000003 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.897800+0000", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002958306 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898065+0000", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026532500000000001 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898176+0000", 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110801 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:56.898261+0000", 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5288000000000001e-05 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.5118.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792601838608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.363089298, 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043349520000000004, 2024-04-22T19:56:07.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.5118", 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 69 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197669+0000", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197671+0000", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3159999999999999e-06 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197681+0000", 2024-04-22T19:56:07.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4339999999999998e-06 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197710+0000", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9405999999999999e-05 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197724+0000", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4286e-05 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197862+0000", 2024-04-22T19:56:07.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013772099999999999 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.197995+0000", 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013270400000000001 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.198239+0000", 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024383200000000001 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.199256+0000", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010177910000000001 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.201810+0000", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025539019999999998 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.201897+0000", 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6268999999999997e-05 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.202004+0000", 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107291 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1276 4.38 4:1d238b63:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9409922020000003, 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066159000000000001, 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.647 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1276 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619766+0000", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619768+0000", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3800000000000001e-06 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619779+0000", 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0226e-05 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619821+0000", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2286000000000001e-05 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619843+0000", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620004+0000", 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016069399999999999 2024-04-22T19:56:07.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620206+0000", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020142599999999999 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620465+0000", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025984499999999998 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623701+0000", 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032360800000000001 2024-04-22T19:56:07.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626241+0000", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025396049999999999 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626322+0000", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0915999999999996e-05 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.626382+0000", 2024-04-22T19:56:07.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9905999999999999e-05 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1286 4.36 4:6e3d37f8:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9408675909999999, 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045958500000000003, 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1286 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619891+0000", 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619892+0000", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.55e-06 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619900+0000", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4259999999999997e-06 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619922+0000", 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2554000000000001e-05 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.619939+0000", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7039000000000001e-05 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620098+0000", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015893400000000001 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620300+0000", 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201996 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.620561+0000", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026070500000000002 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.623673+0000", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003112568 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624210+0000", 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00053618999999999997 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624367+0000", 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015762400000000001 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.624486+0000", 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119264 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4940.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438259993728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6367190810000007, 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124609999999996, 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4940", 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/1789800640", 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924039+0000", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924042+0000", 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4870000000000001e-06 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924053+0000", 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1545999999999999e-05 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924085+0000", 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1396000000000002e-05 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924099+0000", 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924242+0000", 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014274099999999999 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924359+0000", 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116801 2024-04-22T19:56:07.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.924742+0000", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038299599999999998 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.926282+0000", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001540558 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.928926+0000", 2024-04-22T19:56:07.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026435400000000002 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.929010+0000", 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4575999999999998e-05 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.929152+0000", 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1328 3.d e71/20 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2585791989999997, 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018439563999999999, 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302182+0000", 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0199999999999999e-06 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307605+0000", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054233349999999996 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307646+0000", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0252e-05 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307663+0000", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307796+0000", 2024-04-22T19:56:07.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013284399999999999 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307831+0000", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5503000000000002e-05 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320466+0000", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01263479 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320619+0000", 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015249 2024-04-22T19:56:07.668 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1930 4.15 4:aa66b718:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.2747818310000003, 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045934749999999996, 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.669 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1930 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285976+0000", 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285979+0000", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.384e-06 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.285990+0000", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1671999999999999e-05 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286021+0000", 2024-04-22T19:56:07.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286036+0000", 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4943000000000001e-05 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286206+0000", 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016971400000000001 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.286569+0000", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036310299999999998 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.287025+0000", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045601600000000001 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.289067+0000", 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020422299999999999 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290363+0000", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001295601 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290443+0000", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0333999999999994e-05 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.290570+0000", 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012649800000000001 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2023 4.15 4:aa66b718:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.0741323950000004, 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004252914, 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2023 2024-04-22T19:56:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486626+0000", 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486628+0000", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486639+0000", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0959e-05 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486675+0000", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5896000000000003e-05 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:07.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486697+0000", 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1756999999999999e-05 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.486838+0000", 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140514 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.487084+0000", 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024657599999999998 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.487367+0000", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028238100000000001 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.489075+0000", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017083930000000001 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490708+0000", 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016331309999999999 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490819+0000", 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011055100000000001 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:01.490879+0000", 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0115999999999998e-05 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:07.680 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:07.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:07.683 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:07.678+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:07.782 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:07.782+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:07.838 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:07.856 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:07.856 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:07.856 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:07.856 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:07.870 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:07.883 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:07.882+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:07.983 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:07.984 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:07.984 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:07.982+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:08.000 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:08.001 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:08.017 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:08.018 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:08.035 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:08.035 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:08.036 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:08.036 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:08.050 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:08.055 INFO:tasks.workunit.client.0.smithi111.stderr:100+0 records in 2024-04-22T19:56:08.055 INFO:tasks.workunit.client.0.smithi111.stderr:100+0 records out 2024-04-22T19:56:08.055 INFO:tasks.workunit.client.0.smithi111.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.700136 s, 1.5 GB/s 2024-04-22T19:56:08.055 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:08.056 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:08.073 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:08.073 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:08.084 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:08.082+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:08.090 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:08.090 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:08.120 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:08.120 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.185 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:08.182+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:08.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:08.286 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:08.282+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:08.317 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.317 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.332 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:08.387 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:08.386+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:08.454 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.455 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:08.494 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:56:08.514 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:08.514+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:08.589 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:08.586+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:08.635 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.635 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:08.690 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:08.690+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:08.774 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.775 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.788 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:08.791 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:08.786+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:08.891 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:08.890+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:08.903 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:08.903 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:08.916 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:08.993 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:08.990+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:09.093 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:09.090+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:09.194 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:09.194+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:09.205 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.205 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.218 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:09.294 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:09.290+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:09.337 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.337 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:09.396 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:09.394+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:09.496 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:09.494+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:09.515 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.515 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.530 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:09.597 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:09.598+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:09.648 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.648 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:09.699 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:09.698+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:09.777 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.777 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.792 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:09.839 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:09.838+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:09.901 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:09.898+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:09.920 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:09.920 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:09.934 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:10.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:10.018+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:10.103 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:10.102+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:10.118 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:10.118 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:10.134 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:10.141 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:10.205 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:10.202+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:10.305 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:10.302+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:10.320 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:10.320 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:10.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:10.383 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:10.384 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:10.405 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:10.405 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:10.406+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:10.425 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:10.425 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:10.449 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:10.449 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:10.475 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:10.503 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:10.503 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:10.507 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:10.506+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:10.515 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:56:10.536 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:10.561 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:10.561 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903869247872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 113.157054984, 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043439760000000003, 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.566 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406443+0000", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406445+0000", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.748e-06 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406453+0000", 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9519999999999994e-06 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406476+0000", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3414999999999999e-05 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406494+0000", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7472000000000001e-05 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406590+0000", 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6547999999999998e-05 2024-04-22T19:56:10.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406686+0000", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5107999999999998e-05 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406924+0000", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238447 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.408473+0000", 2024-04-22T19:56:10.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001549269 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410550+0000", 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020763069999999999 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410652+0000", 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102858 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410787+0000", 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134852 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 113.15694682500001, 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045691849999999999, 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.572 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 58 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406551+0000", 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406553+0000", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6980000000000001e-06 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406558+0000", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.293e-06 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406571+0000", 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2269000000000001e-05 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406579+0000", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406672+0000", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3109000000000006e-05 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.406907+0000", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023479800000000001 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.407114+0000", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000207216 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.410574+0000", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034598710000000002 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411030+0000", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045536399999999999 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411079+0000", 2024-04-22T19:56:10.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9425999999999997e-05 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:17.411121+0000", 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1541000000000001e-05 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.189598675, 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041478790000000001, 2024-04-22T19:56:10.577 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 207 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373900+0000", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373904+0000", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373919+0000", 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5264000000000002e-05 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373954+0000", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4904999999999999e-05 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.373971+0000", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7703e-05 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374104+0000", 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013226000000000001 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374329+0000", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000225591 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.374875+0000", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054593100000000004 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377039+0000", 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021641590000000001 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377889+0000", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084945799999999998 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.377980+0000", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1520000000000005e-05 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.378048+0000", 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7151999999999997e-05 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 110.096180778, 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041516690000000002, 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 231 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467318+0000", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467320+0000", 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467331+0000", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1246999999999999e-05 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467361+0000", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0448999999999999e-05 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467377+0000", 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5150000000000001e-05 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467530+0000", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015363599999999999 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.467876+0000", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034548000000000001 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.468587+0000", 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071119100000000001 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.470290+0000", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017029650000000001 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471220+0000", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093020799999999997 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471361+0000", 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141223 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.471469+0000", 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107947 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:571 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 109.926312552, 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045601349999999999, 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 571 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637186+0000", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3e-07 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637190+0000", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4479999999999999e-06 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637198+0000", 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6330000000000002e-06 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637203+0000", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6580000000000001e-06 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637238+0000", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4922999999999998e-05 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637285+0000", 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6885000000000003e-05 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637406+0000", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012103399999999999 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.637894+0000", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048757999999999999 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641691+0000", 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037970339999999999 2024-04-22T19:56:10.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641722+0000", 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0947e-05 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:20.641746+0000", 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4363e-05 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1159 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.669944172999999, 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082653799999999993, 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1159 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:10.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893554+0000", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893557+0000", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1030000000000002e-06 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893573+0000", 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6121e-05 2024-04-22T19:56:10.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893599+0000", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5527000000000001e-05 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893608+0000", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5170000000000005e-06 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0537e-05 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893784+0000", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114715 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893895+0000", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111445 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894822+0000", 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092721199999999996 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901753+0000", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069308690000000001 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901790+0000", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6381000000000003e-05 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9952999999999999e-05 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1165 4.0 4:00b97b13:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.66985586, 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081770639999999995, 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1165 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.599 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893642+0000", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893643+0000", 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7599999999999997e-07 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893646+0000", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1650000000000002e-06 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893651+0000", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3859999999999998e-06 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893655+0000", 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6540000000000001e-06 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893714+0000", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8938999999999999e-05 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893815+0000", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100857 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893913+0000", 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8016999999999993e-05 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894843+0000", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093034900000000002 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901729+0000", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006885436 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901777+0000", 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8486000000000003e-05 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901820+0000", 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2299000000000003e-05 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1166 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.669831638, 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083575569999999998, 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1166 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893667+0000", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5499999999999999e-07 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893669+0000", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.283e-06 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893673+0000", 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8380000000000004e-06 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.893676+0000", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8650000000000001e-06 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894194+0000", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000518591 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894267+0000", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2964000000000001e-05 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.894353+0000", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6032000000000006e-05 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.895150+0000", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079645599999999997 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901901+0000", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067511699999999999 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.901954+0000", 2024-04-22T19:56:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2568000000000002e-05 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:56.902024+0000", 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0535000000000001e-05 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792601852016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.386664269000001, 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053878320000000004, 2024-04-22T19:56:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 55 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176834+0000", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176835+0000", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176838+0000", 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0929999999999999e-06 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176845+0000", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4050000000000003e-06 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176850+0000", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.176904+0000", 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4883999999999998e-05 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177000+0000", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5042000000000002e-05 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.177130+0000", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013014 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180207+0000", 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030771029999999999 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182137+0000", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001930733 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182169+0000", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1637000000000002e-05 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.182222+0000", 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2747999999999997e-05 2024-04-22T19:56:10.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.5118.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792601856144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.383046258, 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042869960000000004, 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.5118", 2024-04-22T19:56:10.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/3852069238", 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 57 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180452+0000", 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180453+0000", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079999999999999e-06 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180456+0000", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3469999999999999e-06 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180464+0000", 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0180000000000001e-06 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180469+0000", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0830000000000003e-06 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180507+0000", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7762000000000002e-05 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180574+0000", 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6537000000000003e-05 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.180672+0000", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7918999999999995e-05 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.181837+0000", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011655389999999999 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184672+0000", 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028345509999999998 2024-04-22T19:56:10.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184702+0000", 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9798000000000002e-05 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.184739+0000", 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7434000000000001e-05 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1277 4.11 4:88e534c3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.944038788, 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045028200000000003, 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1277 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619460+0000", 2024-04-22T19:56:10.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2500000000000005e-07 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619464+0000", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5599999999999998e-06 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619474+0000", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0675e-05 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619480+0000", 2024-04-22T19:56:10.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0749999999999997e-06 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619526+0000", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6607000000000003e-05 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619576+0000", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9376999999999998e-05 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619635+0000", 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9954999999999998e-05 2024-04-22T19:56:10.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.620179+0000", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054328299999999998 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623911+0000", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037319580000000001 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623940+0000", 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9105999999999999e-05 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623962+0000", 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2498999999999999e-05 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1284 4.11 4:8824f7a3:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.943975656999999, 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047462119999999997, 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1284 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:10.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619523+0000", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.41e-07 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619524+0000", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.327e-06 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619528+0000", 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7299999999999999e-06 2024-04-22T19:56:10.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619540+0000", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619862+0000", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032193199999999998 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619908+0000", 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6187999999999999e-05 2024-04-22T19:56:10.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.619972+0000", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3182999999999995e-05 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.623206+0000", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032341219999999999 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624219+0000", 2024-04-22T19:56:10.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010137810000000001 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624249+0000", 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9887e-05 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.624269+0000", 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9531999999999999e-05 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1292 4.19 4:9b504767:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.752764855000001, 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040307520000000003, 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1292 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810733+0000", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810735+0000", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9970000000000001e-06 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810744+0000", 2024-04-22T19:56:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0280000000000006e-06 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810768+0000", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3260000000000001e-05 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810778+0000", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0343000000000001e-05 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810877+0000", 2024-04-22T19:56:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8709999999999995e-05 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811005+0000", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012782000000000001 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811152+0000", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014767200000000001 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814371+0000", 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032191199999999998 2024-04-22T19:56:10.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814633+0000", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026128399999999997 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814683+0000", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0744000000000001e-05 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814764+0000", 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0773999999999996e-05 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1294 4.19 4:9b48a7ca:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.752695871, 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061606559999999996, 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1294 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810802+0000", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810803+0000", 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7100000000000002e-07 2024-04-22T19:56:10.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810807+0000", 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0210000000000001e-06 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810816+0000", 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4769999999999992e-06 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.810827+0000", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380999999999999e-05 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811424+0000", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059679000000000004 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811545+0000", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121489 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.811686+0000", 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014067300000000001 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.814379+0000", 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026932599999999998 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816906+0000", 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002527058 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816937+0000", 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1092e-05 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816963+0000", 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5843999999999999e-05 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:1299 4.28 e71/22 4:14484338:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2.7:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:10.642 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.75148366, 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004693521, 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812015+0000", 2024-04-22T19:56:10.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812016+0000", 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0899999999999999e-06 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812023+0000", 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8199999999999999e-06 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812031+0000", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9230000000000008e-06 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812036+0000", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0130000000000001e-06 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812086+0000", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9762000000000002e-05 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.812103+0000", 2024-04-22T19:56:10.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6316000000000001e-05 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816666+0000", 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045633499999999999 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:57.816708+0000", 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2246999999999997e-05 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1326 3.7 3:e29da06d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.294567217000001, 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01503327, 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1326 2024-04-22T19:56:10.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268931+0000", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.268933+0000", 2024-04-22T19:56:10.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0229999999999999e-06 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270882+0000", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001949295 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270921+0000", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482000000000002e-05 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.270939+0000", 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.804e-05 2024-04-22T19:56:10.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271051+0000", 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111968 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271162+0000", 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110741 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.271255+0000", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3273e-05 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.274937+0000", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036822270000000002 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283792+0000", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088552119999999995 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283887+0000", 2024-04-22T19:56:10.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4325000000000002e-05 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:55:58.283964+0000", 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7683999999999997e-05 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:1923 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2778551199999999, 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004868397, 2024-04-22T19:56:10.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1923 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285643+0000", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285644+0000", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9999999999999998e-07 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285647+0000", 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5810000000000001e-06 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285662+0000", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4256999999999999e-05 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.285670+0000", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7630000000000006e-06 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286287+0000", 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061706300000000005 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286407+0000", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011989099999999999 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.286530+0000", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000122624 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.289208+0000", 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026778790000000002 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290452+0000", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012447479999999999 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290481+0000", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8659000000000001e-05 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.290512+0000", 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0431999999999999e-05 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2016 4.0 4:029d3efe:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.0771673909999997, 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041567979999999997, 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2016 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486331+0000", 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-07 2024-04-22T19:56:10.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486335+0000", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2090000000000001e-06 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486344+0000", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.149e-06 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486349+0000", 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.135e-06 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.486949+0000", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059992900000000002 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487030+0000", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0740000000000003e-05 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.487130+0000", 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100052 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.488590+0000", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001460598 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490441+0000", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018504459999999999 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490468+0000", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7756999999999999e-05 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.490488+0000", 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9208e-05 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2129 4.19 4:996a006b:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7262563330000003, 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064033040000000003, 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2129 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837242+0000", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6499999999999999e-07 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837246+0000", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2770000000000001e-06 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837255+0000", 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3200000000000006e-06 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837261+0000", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.75e-06 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837317+0000", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6369000000000002e-05 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837393+0000", 2024-04-22T19:56:10.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5364999999999994e-05 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837489+0000", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6553999999999997e-05 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838446+0000", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095680699999999995 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843547+0000", 2024-04-22T19:56:10.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051014950000000002 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843600+0000", 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3068000000000001e-05 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.843645+0000", 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4833999999999998e-05 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.668 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2132 4.14 4:2ad31bec:::.dir.eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7262127120000006, 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041151340000000003, 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2132 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:10.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837286+0000", 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9500000000000002e-07 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:10.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837289+0000", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8030000000000001e-06 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837296+0000", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.396e-06 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837302+0000", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3369999999999999e-06 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:10.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837359+0000", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7045e-05 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837481+0000", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012242500000000001 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.837578+0000", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7291000000000001e-05 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.838434+0000", 2024-04-22T19:56:10.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085555400000000002 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841314+0000", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028799329999999999 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841367+0000", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2615999999999999e-05 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:01.841401+0000", 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4139e-05 2024-04-22T19:56:10.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.674 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:10.674 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:10.674 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:10.675 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:10.676 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:10.674+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:10.776 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:10.774+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:10.790 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:56:10.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:56:10.791 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-22T19:56:10.791 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-22T19:56:10.827 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:10.827 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:10.827 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:10.827 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:10.844 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:10.877 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:10.874+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:10.976 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:10.976 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:10.976 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:10.977 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:10.977 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:10.978 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:10.974+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:10.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:11.079 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:11.078+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-22T19:56:11.134 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.78114812699999, 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014985906, 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348091+0000", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348094+0000", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5429999999999998e-06 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348113+0000", 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8202e-05 2024-04-22T19:56:11.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348155+0000", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2712e-05 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348180+0000", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4368000000000001e-05 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348403+0000", 2024-04-22T19:56:11.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022336200000000001 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.348432+0000", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8717e-05 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350741+0000", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023092199999999998 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.350765+0000", 2024-04-22T19:56:11.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4377999999999999e-05 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.362776+0000", 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010926999999999 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:15.363077+0000", 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000300477 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.139 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.84251242, 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:11.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:11.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:11.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.813669723, 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.147 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.864132875999999, 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:11.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:11.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:11.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:11.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2232 3.1 e75/20 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.486945+0000", 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.64229387999999998, 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015655328999999999, 2024-04-22T19:56:11.153 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.486945+0000", 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.486945+0000", 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.486948+0000", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7429999999999998e-06 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.491645+0000", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046972979999999999 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.491680+0000", 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4826000000000002e-05 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.491696+0000", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6195999999999999e-05 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.491817+0000", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120889 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.491857+0000", 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9906e-05 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.502468+0000", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010611153 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.502600+0000", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132318 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2234 3.1a 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.61912266100000002, 2024-04-22T19:56:11.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021079243000000001, 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510120+0000", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514283+0000", 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041627849999999996 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514319+0000", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6279000000000003e-05 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514337+0000", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000002e-05 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514465+0000", 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012822500000000001 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514759+0000", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029401200000000002 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.515064+0000", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000305369 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.529369+0000", 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014304546 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.530884+0000", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015148340000000001 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531063+0000", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179144 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531195+0000", 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013279200000000001 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2238 3.13 e75/20 3:ca4ea4f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_47:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.56392448699999997, 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014669830999999999, 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565317+0000", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7070000000000001e-06 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.568126+0000", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028089220000000002 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.568175+0000", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8535999999999997e-05 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.568207+0000", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2529e-05 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.568385+0000", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178188 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.568454+0000", 2024-04-22T19:56:11.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8569e-05 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.579850+0000", 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011395888999999999 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.579984+0000", 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013449100000000001 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2241 3.3 3:c17523d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.53688953500000003, 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018309130999999999, 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2241 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592353+0000", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596511+0000", 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004157689 2024-04-22T19:56:11.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596549+0000", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7722999999999998e-05 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596566+0000", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7232999999999999e-05 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596756+0000", 2024-04-22T19:56:11.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019029100000000001 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597011+0000", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025448199999999999 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597239+0000", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022798100000000001 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.606429+0000", 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00918975 2024-04-22T19:56:11.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610330+0000", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039011200000000001 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610517+0000", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018694 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610659+0000", 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141812 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.171 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2243 3.e e75/20 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.51065352100000005, 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019719670000000002, 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:11.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618588+0000", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2359999999999999e-06 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.622983+0000", 2024-04-22T19:56:11.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043956560000000004 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623022+0000", 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8509e-05 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623042+0000", 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9984e-05 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623164+0000", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012174400000000001 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623200+0000", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.65e-05 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638135+0000", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014935313 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638305+0000", 2024-04-22T19:56:11.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016972800000000001 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.50605369499999997, 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.176 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:11.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:11.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:11.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:11.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2247 3.e e75/20 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.47103348, 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016026911000000001, 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658208+0000", 2024-04-22T19:56:11.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7690000000000001e-06 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661839+0000", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036309699999999999 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661891+0000", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1969999999999999e-05 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661914+0000", 2024-04-22T19:56:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3142999999999998e-05 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662073+0000", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015902099999999999 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662129+0000", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6135999999999999e-05 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674095+0000", 2024-04-22T19:56:11.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011965567 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674232+0000", 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013733500000000001 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2250 3.14 3:29315fda:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.448508399, 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016152612, 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.185 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:11.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680733+0000", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7839999999999999e-06 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684720+0000", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039870230000000001 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684755+0000", 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5021000000000002e-05 2024-04-22T19:56:11.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684773+0000", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7445e-05 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684881+0000", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010862900000000001 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685091+0000", 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210087 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685270+0000", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017822000000000001 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.693447+0000", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081774489999999998 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696742+0000", 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032943740000000001 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696821+0000", 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9773999999999999e-05 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696883+0000", 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1805999999999997e-05 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.190 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2257 3.9 3:92bc5c25:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.750746+0000", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.37849315500000003, 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015712338999999999, 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2257 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.750746+0000", 2024-04-22T19:56:11.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.750746+0000", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.750748+0000", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.818e-06 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754626+0000", 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003878224 2024-04-22T19:56:11.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754647+0000", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0828000000000001e-05 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754656+0000", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7920000000000004e-06 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754719+0000", 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2694000000000007e-05 2024-04-22T19:56:11.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754838+0000", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011880200000000001 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.754955+0000", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116909 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.761347+0000", 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063920180000000002 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.766348+0000", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050011650000000001 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.766399+0000", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0954e-05 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.766458+0000", 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9135000000000002e-05 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.195 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2260 3.f e75/20 3:f1b188d4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_69:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.787067+0000", 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.34217192699999999, 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013914352, 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.787067+0000", 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.787067+0000", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.787070+0000", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6460000000000002e-06 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789554+0000", 2024-04-22T19:56:11.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024839570000000002 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789597+0000", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2923000000000002e-05 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789618+0000", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1416e-05 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789764+0000", 2024-04-22T19:56:11.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145601 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789822+0000", 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8009e-05 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.800873+0000", 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011051307999999999 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.800981+0000", 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108492 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2264 3.2c e75/20 3:36fdbcdb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_73:head v 75'5, mlcod=71'3)", 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.827463+0000", 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.30177591799999998, 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015551094, 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827463+0000", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827463+0000", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827466+0000", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7829999999999999e-06 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.829879+0000", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024133340000000001 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.829915+0000", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6372999999999999e-05 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.829933+0000", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7346999999999998e-05 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.830093+0000", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160443 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.830162+0000", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8355999999999994e-05 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.842947+0000", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012785024000000001 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843014+0000", 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7434000000000005e-05 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2266 3.1a 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.287518571, 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017647817999999999, 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2266 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841723+0000", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.818e-06 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845729+0000", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040059120000000004 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845758+0000", 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8439999999999999e-05 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845777+0000", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9211999999999998e-05 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845874+0000", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6872000000000004e-05 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846027+0000", 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015361899999999999 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846163+0000", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013575800000000001 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.851816+0000", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056529600000000003 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859284+0000", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679780000000001 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859327+0000", 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3432e-05 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859368+0000", 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0816999999999999e-05 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2268 3.29 e75/20 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.866204+0000", 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.26303462799999999, 2024-04-22T19:56:11.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013683020000000001, 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.866204+0000", 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.866204+0000", 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.866206+0000", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.567e-06 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.870996+0000", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047899259999999999 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.871015+0000", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8810000000000001e-05 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.871024+0000", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.842e-06 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.871092+0000", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7500000000000001e-05 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.871112+0000", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9898000000000002e-05 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.879826+0000", 2024-04-22T19:56:11.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087146270000000008 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.879887+0000", 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0850000000000002e-05 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2270 3.9 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.24525112800000001, 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019065421999999999, 2024-04-22T19:56:11.213 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883990+0000", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887966+0000", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039765670000000003 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887995+0000", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8694e-05 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888008+0000", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2658e-05 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888095+0000", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7727999999999998e-05 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888228+0000", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132605 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888362+0000", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013399000000000001 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.894120+0000", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00575845 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902908+0000", 2024-04-22T19:56:11.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087880549999999995 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902985+0000", 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6637999999999994e-05 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.903053+0000", 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8089999999999994e-05 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2277 3.31 e75/20 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head v 75'3, mlcod=72'1)", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.958142+0000", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.171096576, 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015037283, 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.958142+0000", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.958142+0000", 2024-04-22T19:56:11.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.958144+0000", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.962086+0000", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039418659999999996 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.962110+0000", 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4349999999999999e-05 2024-04-22T19:56:11.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.962121+0000", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0587999999999999e-05 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.962251+0000", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130383 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.962318+0000", 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6878999999999994e-05 2024-04-22T19:56:11.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.973093+0000", 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010775257999999999 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.973180+0000", 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6119000000000007e-05 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2287 3.13 e75/20 3:caa9670a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_96:head v 75'5, mlcod=75'3)", 2024-04-22T19:56:11.222 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.068967+0000", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.060272316999999999, 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013972248, 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.068967+0000", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.068967+0000", 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.068968+0000", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.071485+0000", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025168740000000001 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.071519+0000", 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4548999999999997e-05 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.071542+0000", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2569999999999999e-05 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.071735+0000", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019326400000000001 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.071778+0000", 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2256000000000003e-05 2024-04-22T19:56:11.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.082798+0000", 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011020211 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.082939+0000", 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014107400000000001 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.226 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.227 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:11.228 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 75, 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "fsid": "ac92bbc9-e567-4064-a7f4-2e610e35d3cc", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "created": "2024-04-22T19:53:42.573687+0000", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "modified": "2024-04-22T19:56:08.479455+0000", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "last_up_change": "2024-04-22T19:53:54.653127+0000", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "last_in_change": "2024-04-22T19:53:45.731500+0000", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-22T19:56:11.229 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_num": 5806080, 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_set": [ 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "nodeep-scrub", 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "noscrub", 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "pglog_hardlimit", 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "purged_snapdirs", 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_deletes", 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "sortbitwise" 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_version": 4, 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "full_ratio": 0.94999998807907104, 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-22T19:56:11.230 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_snapshot": "", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_max": 8, 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "max_osd": 8, 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "require_min_compat_client": "luminous", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "min_compat_client": "luminous", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "require_osd_release": "squid", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "allow_crimson": false, 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "pools": [ 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 1, 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": ".mgr", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:53:55.362814+0000", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.231 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 1, 2024-04-22T19:56:11.232 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "16", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.233 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.234 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.235 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_max": 32, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_min": 1 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": {} 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 8, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 8, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 0.25, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 2, 2024-04-22T19:56:11.236 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 2, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 2, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "rbd", 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:01.541706+0000", 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.237 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 8, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 8, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 8, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 8, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 8, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.238 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "19", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.239 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.240 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd": {} 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.9900000095367432, 2024-04-22T19:56:11.241 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.9900000095367432, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 0.87999999523162842, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 3, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.buckets.data", 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:07.985692+0000", 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.242 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 64, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 64, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 64, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 64, 2024-04-22T19:56:11.243 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 64, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "22", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.244 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.245 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.246 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.3799999952316284, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.3799999952316284, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.3799999952316284, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.3799999952316284, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.247 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 4, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.buckets.index", 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:09.656252+0000", 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.248 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 64, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 64, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 64, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 64, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 64, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.249 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "24", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.250 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.251 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.252 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 2, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 2, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 2, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 2, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 5, 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": ".rgw.root", 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:11.591758+0000", 2024-04-22T19:56:11.253 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:56:11.254 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "26", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.255 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.256 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.257 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.25, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.25, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.25, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.25, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 6, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.log", 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:13.498929+0000", 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.259 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "28", 2024-04-22T19:56:11.260 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.261 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.262 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.75, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.75, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:56:11.263 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 7, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.control", 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:15.382119+0000", 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.264 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.265 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "30", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.266 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.267 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.268 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.75, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.75, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.75, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.75, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 8, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "default.rgw.meta", 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-22T19:54:17.508620+0000", 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-22T19:56:11.270 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-22T19:56:11.271 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "32", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-22T19:56:11.272 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-22T19:56:11.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-22T19:56:11.274 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_bias": 4 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "rgw": {} 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "read_balance": { 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "score_type": "Fair distribution", 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "score_acting": 1.5, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "score_stable": 1.5, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "optimal_score": 1, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_acting": 1.5, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "raw_score_stable": 1.5, 2024-04-22T19:56:11.275 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity_weighted": 1, 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity": 1, 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "average_primary_affinity_weighted": 1 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "osds": [ 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "996ea3c2-f75d-41f0-9267-69befdc4ab4d", 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.276 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 39, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6824", 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6825", 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6826", 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6827", 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6830", 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6831", 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6828", 2024-04-22T19:56:11.280 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6829", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1848271487 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6825/1848271487", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6827/1848271487", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6831/1848271487", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6829/1848271487", 2024-04-22T19:56:11.281 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "277fd7fa-608c-48e4-800d-c26294428dd8", 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.282 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6810", 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6813", 2024-04-22T19:56:11.283 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6816", 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6819", 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.284 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6822", 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6823", 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6820", 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6821", 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1193123721 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6813/1193123721", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6819/1193123721", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6823/1193123721", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6821/1193123721", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "bac442e5-3a55-4562-8665-70da37ab5ff7", 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.287 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 67, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6800", 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6801", 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6802", 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.289 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6803", 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6806", 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6807", 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6804", 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.291 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6805", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2226119870 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6801/2226119870", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6803/2226119870", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6807/2226119870", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6805/2226119870", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "3195716c-c2fb-4f8d-916a-dc0525a8c456", 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 64, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.293 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6808", 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6809", 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6811", 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6812", 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6817", 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6818", 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.296 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6814", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6815", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4032621477 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6809/4032621477", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6812/4032621477", 2024-04-22T19:56:11.297 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6818/4032621477", 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6815/4032621477", 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 4, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "cbf466e6-386f-4838-ad24-52702ac92370", 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.298 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6800", 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6801", 2024-04-22T19:56:11.299 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6802", 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6803", 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6806", 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6807", 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6804", 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6805", 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1643232987 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6801/1643232987", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6803/1643232987", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6807/1643232987", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6805/1643232987", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 5, 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "5813db8d-fb71-4489-af1f-2e8223206f66", 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.303 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6808", 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.304 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6809", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6810", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6811", 2024-04-22T19:56:11.305 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6814", 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6815", 2024-04-22T19:56:11.306 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6812", 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6813", 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1294966407 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.307 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6809/1294966407", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6811/1294966407", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6815/1294966407", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6813/1294966407", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 6, 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "4117bfb9-ad8e-4b51-a9e0-f858a7402a5b", 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.308 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6824", 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6825", 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6826", 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.310 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6827", 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6830", 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.311 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6831", 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6828", 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6829", 2024-04-22T19:56:11.312 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 2579086149 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6825/2579086149", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6827/2579086149", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6831/2579086149", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6829/2579086149", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 7, 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "a91542a5-1ccd-4fb1-95be-7d51aa24f193", 2024-04-22T19:56:11.313 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 0, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 0, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 13, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 30, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 0, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.314 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6816", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6817", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6818", 2024-04-22T19:56:11.315 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6819", 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6822", 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6823", 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v2", 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6820", 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.138:6821", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1077004569 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.138:6817/1077004569", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.138:6819/1077004569", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.138:6823/1077004569", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.138:6821/1077004569", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_xinfo": [ 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:50.775866+0000", 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.319 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.087145+0000", 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.320 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.270011+0000", 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.250163+0000", 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 4, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.201467+0000", 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 5, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.322 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.185857+0000", 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 6, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:50.789318+0000", 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 7, 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540701547738038271, 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-22T19:53:51.273134+0000", 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap": [], 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap_items": [ 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.21", 2024-04-22T19:56:11.324 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 5, 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 1 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.27", 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 3, 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.2f", 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 5, 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "3.37", 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.326 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 7, 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "4.f", 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 1, 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 2 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.327 INFO:teuthology.orchestra.run.smithi111.stdout: "pgid": "4.2f", 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "mappings": [ 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "from": 3, 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "to": 5 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap_primaries": [], 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_temp": [], 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_temp": [], 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "blocklist": {}, 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "range_blocklist": {}, 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profiles": { 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "default": { 2024-04-22T19:56:11.328 INFO:teuthology.orchestra.run.smithi111.stdout: "crush-failure-domain": "osd", 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "k": "2", 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "m": "1", 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "plugin": "jerasure", 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "technique": "reed_sol_van" 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps_queue": [], 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "new_removed_snaps": [], 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "new_purged_snaps": [], 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_node_flags": {}, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "device_class_flags": {}, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode": { 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_enabled": false, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_bucket_count": 0, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "degraded_stretch_mode": 0, 2024-04-22T19:56:11.329 INFO:teuthology.orchestra.run.smithi111.stdout: "recovering_stretch_mode": 0, 2024-04-22T19:56:11.330 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_bucket": 0 2024-04-22T19:56:11.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:11.330 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:11.331 INFO:tasks.thrashosds.thrasher:j is {'epoch': 75, 'fsid': 'ac92bbc9-e567-4064-a7f4-2e610e35d3cc', 'created': '2024-04-22T19:53:42.573687+0000', 'modified': '2024-04-22T19:56:08.479455+0000', 'last_up_change': '2024-04-22T19:53:54.653127+0000', 'last_in_change': '2024-04-22T19:53:45.731500+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T19:53:55.362814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-22T19:54:01.541706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-04-22T19:54:07.985692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-04-22T19:54:09.656252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-04-22T19:54:11.591758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-04-22T19:54:13.498929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-04-22T19:54:15.382119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-04-22T19:54:17.508620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '996ea3c2-f75d-41f0-9267-69befdc4ab4d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6824', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6825', 'nonce': 1848271487}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6826', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6827', 'nonce': 1848271487}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6830', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6831', 'nonce': 1848271487}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6828', 'nonce': 1848271487}, {'type': 'v1', 'addr': '172.21.15.111:6829', 'nonce': 1848271487}]}, 'public_addr': '172.21.15.111:6825/1848271487', 'cluster_addr': '172.21.15.111:6827/1848271487', 'heartbeat_back_addr': '172.21.15.111:6831/1848271487', 'heartbeat_front_addr': '172.21.15.111:6829/1848271487', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '277fd7fa-608c-48e4-800d-c26294428dd8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6810', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6813', 'nonce': 1193123721}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6816', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 1193123721}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6822', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6823', 'nonce': 1193123721}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6820', 'nonce': 1193123721}, {'type': 'v1', 'addr': '172.21.15.111:6821', 'nonce': 1193123721}]}, 'public_addr': '172.21.15.111:6813/1193123721', 'cluster_addr': '172.21.15.111:6819/1193123721', 'heartbeat_back_addr': '172.21.15.111:6823/1193123721', 'heartbeat_front_addr': '172.21.15.111:6821/1193123721', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bac442e5-3a55-4562-8665-70da37ab5ff7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 67, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 2226119870}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 2226119870}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 2226119870}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 2226119870}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 2226119870}]}, 'public_addr': '172.21.15.111:6801/2226119870', 'cluster_addr': '172.21.15.111:6803/2226119870', 'heartbeat_back_addr': '172.21.15.111:6807/2226119870', 'heartbeat_front_addr': '172.21.15.111:6805/2226119870', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3195716c-c2fb-4f8d-916a-dc0525a8c456', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 64, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6808', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6809', 'nonce': 4032621477}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6811', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6812', 'nonce': 4032621477}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6817', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 4032621477}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6814', 'nonce': 4032621477}, {'type': 'v1', 'addr': '172.21.15.111:6815', 'nonce': 4032621477}]}, 'public_addr': '172.21.15.111:6809/4032621477', 'cluster_addr': '172.21.15.111:6812/4032621477', 'heartbeat_back_addr': '172.21.15.111:6818/4032621477', 'heartbeat_front_addr': '172.21.15.111:6815/4032621477', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbf466e6-386f-4838-ad24-52702ac92370', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6800', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6801', 'nonce': 1643232987}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6802', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6803', 'nonce': 1643232987}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6806', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6807', 'nonce': 1643232987}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6804', 'nonce': 1643232987}, {'type': 'v1', 'addr': '172.21.15.138:6805', 'nonce': 1643232987}]}, 'public_addr': '172.21.15.138:6801/1643232987', 'cluster_addr': '172.21.15.138:6803/1643232987', 'heartbeat_back_addr': '172.21.15.138:6807/1643232987', 'heartbeat_front_addr': '172.21.15.138:6805/1643232987', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5813db8d-fb71-4489-af1f-2e8223206f66', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6808', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6809', 'nonce': 1294966407}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6810', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6811', 'nonce': 1294966407}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6814', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6815', 'nonce': 1294966407}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6812', 'nonce': 1294966407}, {'type': 'v1', 'addr': '172.21.15.138:6813', 'nonce': 1294966407}]}, 'public_addr': '172.21.15.138:6809/1294966407', 'cluster_addr': '172.21.15.138:6811/1294966407', 'heartbeat_back_addr': '172.21.15.138:6815/1294966407', 'heartbeat_front_addr': '172.21.15.138:6813/1294966407', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4117bfb9-ad8e-4b51-a9e0-f858a7402a5b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6824', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6825', 'nonce': 2579086149}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6826', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6827', 'nonce': 2579086149}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6830', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6831', 'nonce': 2579086149}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6828', 'nonce': 2579086149}, {'type': 'v1', 'addr': '172.21.15.138:6829', 'nonce': 2579086149}]}, 'public_addr': '172.21.15.138:6825/2579086149', 'cluster_addr': '172.21.15.138:6827/2579086149', 'heartbeat_back_addr': '172.21.15.138:6831/2579086149', 'heartbeat_front_addr': '172.21.15.138:6829/2579086149', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a91542a5-1ccd-4fb1-95be-7d51aa24f193', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6816', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6817', 'nonce': 1077004569}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6818', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6819', 'nonce': 1077004569}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6822', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6823', 'nonce': 1077004569}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6820', 'nonce': 1077004569}, {'type': 'v1', 'addr': '172.21.15.138:6821', 'nonce': 1077004569}]}, 'public_addr': '172.21.15.138:6817/1077004569', 'cluster_addr': '172.21.15.138:6819/1077004569', 'heartbeat_back_addr': '172.21.15.138:6823/1077004569', 'heartbeat_front_addr': '172.21.15.138:6821/1077004569', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:50.775866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.087145+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.270011+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.250163+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.201467+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.185857+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:50.789318+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-22T19:53:51.273134+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.27', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.2f', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.37', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.2f', 'mappings': [{'from': 3, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-22T19:56:11.331 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.37 2024-04-22T19:56:11.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.37 2024-04-22T19:56:11.332 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:11.226+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:11.333 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:11.334+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:11.434 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:11.434+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:11.476 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:11.476 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:11.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:11.513 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:56:11.534 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:11.530+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:11.636 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:11.634+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:11.680 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:11.680 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:11.680 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:11.680 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:11.680 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:11.700 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:11.736 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:11.734+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:11.837 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:11.834+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1328 3.d e71/20 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:11.881 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.578243041, 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018439563999999999, 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302182+0000", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0199999999999999e-06 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307605+0000", 2024-04-22T19:56:11.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054233349999999996 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307646+0000", 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0252e-05 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307663+0000", 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307796+0000", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013284399999999999 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307831+0000", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5503000000000002e-05 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320466+0000", 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01263479 2024-04-22T19:56:11.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320619+0000", 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015249 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.2472974889999999, 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:11.886 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:11.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:11.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.237051313, 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.892 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:11.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2248 3.2 e75/20 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:11.896 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.663861+0000", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.216561274, 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014869469999999999, 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.663861+0000", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.663861+0000", 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.663864+0000", 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1769999999999998e-06 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.668043+0000", 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041785859999999998 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.668083+0000", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0133999999999999e-05 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.668105+0000", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2433999999999999e-05 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.668273+0000", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016801000000000001 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.668332+0000", 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9392000000000003e-05 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.678652+0000", 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010319731 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.678730+0000", 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8005999999999998e-05 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2249 3.22 3:47d934ca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.670957+0000", 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.209465359, 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016601543, 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.901 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2249 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.670957+0000", 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.670957+0000", 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.670980+0000", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3737999999999999e-05 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.675432+0000", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044513829999999997 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.675475+0000", 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3642e-05 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.675500+0000", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4539999999999999e-05 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.675767+0000", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000267046 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.676169+0000", 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000402264 2024-04-22T19:56:11.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.676586+0000", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041717399999999997 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684000+0000", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074132180000000001 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.687396+0000", 2024-04-22T19:56:11.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00339632 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.687489+0000", 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2923000000000005e-05 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.687558+0000", 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9295000000000007e-05 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2252 3.1c 3:3a12301e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.1800011960000001, 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017446916, 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2252 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700424+0000", 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1760000000000002e-06 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704431+0000", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040072049999999998 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704466+0000", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4669999999999998e-05 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704482+0000", 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6269999999999998e-05 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704584+0000", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010172 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704719+0000", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013505799999999999 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704840+0000", 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121363 2024-04-22T19:56:11.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.714157+0000", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093168030000000002 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717777+0000", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036203009999999998 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717825+0000", 2024-04-22T19:56:11.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7509000000000002e-05 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717868+0000", 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2840999999999999e-05 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2258 3.1d 3:b81f92cf:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.760508+0000", 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.119913607, 2024-04-22T19:56:11.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016693390999999998, 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2258 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.760508+0000", 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.760508+0000", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.760512+0000", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9199999999999997e-06 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765164+0000", 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046520709999999998 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765207+0000", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2197000000000003e-05 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765226+0000", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9283000000000002e-05 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765324+0000", 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8197999999999997e-05 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765449+0000", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012480799999999999 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.765559+0000", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010991 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.776194+0000", 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010635085000000001 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777040+0000", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00084594499999999997 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777124+0000", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4345000000000006e-05 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777202+0000", 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7628999999999998e-05 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2283 3.1c 3:3a96be44:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.022618+0000", 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.857803706, 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015839974999999999, 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2283 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.918 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.022618+0000", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.022618+0000", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.022621+0000", 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4499999999999998e-06 2024-04-22T19:56:11.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026443+0000", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038225759999999998 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026470+0000", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6534e-05 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026488+0000", 2024-04-22T19:56:11.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8131999999999999e-05 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026604+0000", 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116419 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026771+0000", 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016674699999999999 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.026951+0000", 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017994500000000001 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.032108+0000", 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005156702 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.038276+0000", 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061677900000000003 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.038381+0000", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010516100000000001 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.038458+0000", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7519000000000001e-05 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2300 3.2a 3:54d6eb90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.206073+0000", 2024-04-22T19:56:11.923 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.67434940799999998, 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015990774999999999, 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2300 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.206073+0000", 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.206073+0000", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.206076+0000", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6030000000000001e-06 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.210750+0000", 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046742179999999999 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.210787+0000", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6158999999999997e-05 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.210807+0000", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0772999999999999e-05 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.210914+0000", 2024-04-22T19:56:11.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106273 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.211051+0000", 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013784600000000001 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.211175+0000", 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012307600000000001 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.220704+0000", 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095292980000000003 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.221989+0000", 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285584 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.222031+0000", 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1090999999999997e-05 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.222063+0000", 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2854000000000001e-05 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2301 3.c 3:318bad61:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.217581+0000", 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.662840824, 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016503174999999998, 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2301 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.217581+0000", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.217581+0000", 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.217585+0000", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.473e-06 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.221758+0000", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041732920000000003 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.221789+0000", 2024-04-22T19:56:11.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.221805+0000", 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5553000000000002e-05 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.221889+0000", 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4383999999999997e-05 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.222026+0000", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013703700000000001 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.222138+0000", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111958 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.228336+0000", 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061981600000000003 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.233903+0000", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055671729999999999 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.234010+0000", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106697 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.234084+0000", 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4468000000000006e-05 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.934 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2303 3.1d 3:b853a5d4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.6441462, 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020957687999999999, 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2303 2024-04-22T19:56:11.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236279+0000", 2024-04-22T19:56:11.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8669999999999998e-06 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240613+0000", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043339429999999998 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240655+0000", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799000000000001e-05 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240696+0000", 2024-04-22T19:56:11.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0423000000000002e-05 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240813+0000", 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011725100000000001 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240970+0000", 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015661399999999999 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.241102+0000", 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195200000000001 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.254210+0000", 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013108585000000001 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257131+0000", 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029205009999999998 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257182+0000", 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1622000000000001e-05 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257234+0000", 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1131000000000002e-05 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.940 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2305 3.1c 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.62446368200000002, 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021365184999999998, 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2305 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255961+0000", 2024-04-22T19:56:11.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6809999999999998e-06 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260167+0000", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042057170000000003 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260200+0000", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3552e-05 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260217+0000", 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6824e-05 2024-04-22T19:56:11.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260307+0000", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0367999999999999e-05 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260460+0000", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000152516 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260592+0000", 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013156600000000001 2024-04-22T19:56:11.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273702+0000", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013110335000000001 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277161+0000", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034595170000000001 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277255+0000", 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3205e-05 2024-04-22T19:56:11.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277324+0000", 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8904000000000003e-05 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2308 3.38 e75/64 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head v 75'5, mlcod=75'3)", 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.286058+0000", 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.59436450600000001, 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015214167000000001, 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.946 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.286058+0000", 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.286058+0000", 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.286061+0000", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0699999999999998e-06 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291361+0000", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053005229999999997 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291390+0000", 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9335999999999998e-05 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291407+0000", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6509999999999999e-05 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291563+0000", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015576399999999999 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291628+0000", 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919000000000006e-05 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.301139+0000", 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095116929999999999 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.301272+0000", 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132352 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.950 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2311 3.28 3:14ad4f8a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.56623534900000005, 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016815739, 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2311 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314190+0000", 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3919999999999999e-06 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318126+0000", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039359900000000003 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318164+0000", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7586999999999998e-05 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318183+0000", 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9347999999999998e-05 2024-04-22T19:56:11.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318314+0000", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013121300000000001 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318549+0000", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023495999999999999 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318747+0000", 2024-04-22T19:56:11.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019791399999999999 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.329114+0000", 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010366449999999999 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330720+0000", 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064849999999999 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330844+0000", 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123647 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.331002+0000", 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158753 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2315 3.28 3:14e71d18:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:11.956 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.52396444099999995, 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020619276999999998, 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2315 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:11.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356462+0000", 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3630000000000004e-06 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360817+0000", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043554479999999996 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360844+0000", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6146999999999999e-05 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360860+0000", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6676000000000001e-05 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360957+0000", 2024-04-22T19:56:11.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6328000000000003e-05 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361165+0000", 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020848000000000001 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361379+0000", 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213914 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.367709+0000", 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063305009999999997 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.376921+0000", 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.009211403 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377011+0000", 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9883000000000007e-05 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377077+0000", 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6134000000000001e-05 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2320 3.30 3:0d06bc62:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.413207+0000", 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.467214978, 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015789725000000001, 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.962 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2320 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.413207+0000", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.413207+0000", 2024-04-22T19:56:11.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.413210+0000", 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8260000000000001e-06 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417084+0000", 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00387449 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417113+0000", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8966999999999999e-05 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417125+0000", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1717e-05 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417211+0000", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5552999999999999e-05 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417348+0000", 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013768499999999999 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.417484+0000", 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013554800000000001 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.421699+0000", 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042151319999999999 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.428822+0000", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071228710000000002 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.428930+0000", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108063 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.428997+0000", 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6872999999999995e-05 2024-04-22T19:56:11.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.45735126599999998, 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.968 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:11.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2332 3.37 e76/39 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.33020323000000001, 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017890809000000001, 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3700000000000001e-07 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557792+0000", 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007573321 2024-04-22T19:56:11.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557814+0000", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1715000000000001e-05 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557863+0000", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8578000000000001e-05 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557939+0000", 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6124000000000005e-05 2024-04-22T19:56:11.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557963+0000", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4189000000000002e-05 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568037+0000", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010073799 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568110+0000", 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2745999999999998e-05 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2333 3.30 3:0d2f0eb3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.327088235, 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017849171, 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2333 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553336+0000", 2024-04-22T19:56:11.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.655e-06 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559089+0000", 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057529419999999996 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559107+0000", 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7414e-05 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559117+0000", 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013999999999999e-05 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559193+0000", 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5691000000000004e-05 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559322+0000", 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012922000000000001 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559432+0000", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110497 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568620+0000", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091877509999999992 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571024+0000", 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024038990000000001 2024-04-22T19:56:11.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571121+0000", 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6779000000000003e-05 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571183+0000", 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2309000000000003e-05 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2345 3.1c 3:39c48d41:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:11.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.203989964, 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019952768999999999, 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2345 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676435+0000", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0230000000000001e-06 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681376+0000", 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049407640000000003 2024-04-22T19:56:11.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681419+0000", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3612000000000002e-05 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681439+0000", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681580+0000", 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014139799999999999 2024-04-22T19:56:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681844+0000", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026375200000000002 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.682082+0000", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238104 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.694828+0000", 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012746435 2024-04-22T19:56:11.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696216+0000", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013878429999999999 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696316+0000", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9652000000000001e-05 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696385+0000", 2024-04-22T19:56:11.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8938999999999998e-05 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:11.989 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:11.990 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:11.991 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:11.986+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:12.091 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:12.090+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:12.170 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:12.170 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:12.188 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:12.191 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:12.190+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:12.292 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:12.290+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:12.313 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:12.313 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:12.313 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:12.313 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:12.313 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:12.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:12.393 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:12.390+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:12.461 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:12.461 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.105656053, 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:56:12.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:56:12.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:12.469 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.182912514, 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:56:12.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:56:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:12.475 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.151695825000001, 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1325 3.34 e71/20 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.189272153999999, 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020645097000000001, 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.481 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271353+0000", 2024-04-22T19:56:12.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7740000000000001e-06 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277264+0000", 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059106089999999998 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277313+0000", 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9465999999999997e-05 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277329+0000", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5722999999999998e-05 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277471+0000", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014166100000000001 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277515+0000", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4224999999999998e-05 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291789+0000", 2024-04-22T19:56:12.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014274152999999999 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291997+0000", 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207486 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2259 3.10 3:09469309:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.688411415, 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017484422999999999, 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.485 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2259 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772215+0000", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2160000000000002e-06 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777238+0000", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050229070000000001 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777278+0000", 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9993000000000001e-05 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777295+0000", 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6475999999999999e-05 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777391+0000", 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6475e-05 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777568+0000", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017636400000000001 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777727+0000", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158892 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.785819+0000", 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080919900000000003 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789571+0000", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037520090000000002 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789641+0000", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0073000000000005e-05 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789697+0000", 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6028e-05 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.490 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2264 3.2c 3:36fdbcdb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.63774274, 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020806587000000001, 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2264 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822884+0000", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1530000000000001e-06 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826221+0000", 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033373140000000001 2024-04-22T19:56:12.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826248+0000", 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7075000000000001e-05 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826272+0000", 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3867e-05 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826507+0000", 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023510100000000001 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826972+0000", 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046434999999999998 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827228+0000", 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025634600000000002 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.840423+0000", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013194602999999999 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843417+0000", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029944450000000001 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843576+0000", 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158746 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843687+0000", 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111587 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2267 3.a 3:532fdb49:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.608042671, 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017062766, 2024-04-22T19:56:12.497 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852584+0000", 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7240000000000001e-06 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856673+0000", 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004089606 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856703+0000", 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9717999999999999e-05 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856718+0000", 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5265e-05 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856845+0000", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012673 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857108+0000", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026259500000000002 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857356+0000", 2024-04-22T19:56:12.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024816600000000002 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869498+0000", 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012142484 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869516+0000", 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8224e-05 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869589+0000", 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2747e-05 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869644+0000", 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4506999999999998e-05 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2269 3.20 3:07d561ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.5869033880000001, 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017180925, 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2269 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.504 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873723+0000", 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3920000000000001e-06 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.877999+0000", 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042760860000000001 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878022+0000", 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2966e-05 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878032+0000", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0541e-05 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878112+0000", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9371999999999998e-05 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878268+0000", 2024-04-22T19:56:12.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015625799999999999 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878409+0000", 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.884923+0000", 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065140069999999996 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890804+0000", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005880817 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890851+0000", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7521000000000001e-05 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890901+0000", 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9867999999999998e-05 2024-04-22T19:56:12.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2274 3.26 3:665ba539:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.5354702929999999, 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360837, 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:12.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925157+0000", 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2799999999999999e-06 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929565+0000", 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044081490000000001 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929606+0000", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0876e-05 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929625+0000", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9729999999999999e-05 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929750+0000", 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124287 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929883+0000", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013329800000000001 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929992+0000", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109344 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.936305+0000", 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006312504 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941417+0000", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124330000000004 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941466+0000", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9075e-05 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941514+0000", 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7861000000000001e-05 2024-04-22T19:56:12.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.4188165879999999, 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:56:12.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2291 3.35 3:afa6f2d5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.3536093760000001, 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019163485000000001, 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2291 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107018+0000", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111911+0000", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048925219999999998 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111951+0000", 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0649000000000003e-05 2024-04-22T19:56:12.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111970+0000", 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8206000000000002e-05 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112133+0000", 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016344800000000001 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112392+0000", 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025913999999999999 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112622+0000", 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022955600000000001 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.124629+0000", 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012007489999999999 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.125926+0000", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012970119999999999 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126069+0000", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014246899999999999 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126178+0000", 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109113 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.527 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.234043722, 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:56:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.533 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.214835809, 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2307 3.35 3:ae2903f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.186468308, 2024-04-22T19:56:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017656267999999999, 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2307 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274159+0000", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8190000000000002e-06 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278648+0000", 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044892999999999999 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278673+0000", 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4791999999999999e-05 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278691+0000", 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7632e-05 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278808+0000", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117217 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279108+0000", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029989600000000002 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279479+0000", 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037135800000000002 2024-04-22T19:56:12.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.290910+0000", 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011431021 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291646+0000", 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073550099999999995 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291740+0000", 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3846999999999998e-05 2024-04-22T19:56:12.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291812+0000", 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1884999999999994e-05 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2309 3.2c 3:3534673a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.167803417, 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019997352999999999, 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2309 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292824+0000", 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.473e-06 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297694+0000", 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048700979999999998 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297747+0000", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3301999999999999e-05 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297774+0000", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6804999999999998e-05 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297959+0000", 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000185563 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298242+0000", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282353 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298483+0000", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024071300000000001 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312076+0000", 2024-04-22T19:56:12.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013593449000000001 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312659+0000", 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058341999999999997 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312750+0000", 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0661000000000005e-05 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312818+0000", 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7515999999999995e-05 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2352 3.34 e76/20 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.70823625000000001, 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016493677000000002, 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:12.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752388+0000", 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8799999999999999e-07 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755703+0000", 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033158549999999999 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755734+0000", 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0905999999999999e-05 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755750+0000", 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755839+0000", 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8243000000000002e-05 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755861+0000", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2540000000000001e-05 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768802+0000", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01294056 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768881+0000", 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9334999999999999e-05 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.557 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2353 3.a 3:5232dbf7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.756528+0000", 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.70409601600000005, 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016095971000000001, 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2353 2024-04-22T19:56:12.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.756528+0000", 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.756528+0000", 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.756530+0000", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.514e-06 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.760601+0000", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040708059999999997 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.760633+0000", 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.222e-05 2024-04-22T19:56:12.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.760652+0000", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8386e-05 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.760745+0000", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3091999999999996e-05 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.760886+0000", 2024-04-22T19:56:12.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141765 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.761016+0000", 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012960399999999999 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.770915+0000", 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098989869999999997 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.772462+0000", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015474600000000001 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.772549+0000", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6279000000000005e-05 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.772624+0000", 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4857999999999994e-05 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.563 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.531666474, 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:56:12.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:56:12.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:12.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2379 3.10 3:0bd50452:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.42575520500000003, 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019345125000000001, 2024-04-22T19:56:12.569 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2379 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034872+0000", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.58e-06 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041263+0000", 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063912040000000002 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041299+0000", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5434e-05 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041316+0000", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7295e-05 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041445+0000", 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000128837 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041699+0000", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025379899999999997 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041926+0000", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022783300000000001 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.050013+0000", 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080870379999999995 2024-04-22T19:56:12.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054035+0000", 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040219050000000001 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054135+0000", 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9533999999999999e-05 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054214+0000", 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8665999999999995e-05 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2392 3.10 3:0b3f212b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.22746467300000001, 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017044683000000001, 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:12.575 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2392 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233161+0000", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.792e-06 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237419+0000", 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042579519999999997 2024-04-22T19:56:12.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237443+0000", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4511999999999998e-05 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237453+0000", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0020999999999999e-05 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237522+0000", 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-22T19:56:12.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237656+0000", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013409000000000001 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237770+0000", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011434699999999999 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.244689+0000", 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069184390000000002 2024-04-22T19:56:12.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250116+0000", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054270389999999998 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250165+0000", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9307000000000001e-05 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250204+0000", 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8652000000000002e-05 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:12.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:12.581 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:12.582 INFO:teuthology.orchestra.run.smithi111.stderr:clear 3.37 pg_upmap_items mapping 2024-04-22T19:56:12.583 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:12.583 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:12.578+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:12.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:12.683 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:12.682+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:12.747 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:12.783 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:12.782+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:12.861 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:12.879 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:12.879 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:12.884 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:12.882+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:12.901 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:12.901 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:12.922 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:12.922 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:12.934 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:12.934 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:12.934 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:12.934 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:12.934 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:12.941 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:12.942 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:12.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:12.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:12.960 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:12.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:12.979 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:12.985 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:12.982+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:12.988 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 1Gb. 2024-04-22T19:56:12.989 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:56:12.989 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:12.989 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-22T19:56:12.989 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:12.999 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:12.999 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:13.069 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.069 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.086 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:13.086 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:13.082+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:13.186 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:13.182+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:13.214 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.214 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.220 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:56:13.220 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:13.229 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:13.323 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:13.322+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:13.388 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:13.386+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:13.391 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.391 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:13.491 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:13.490+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:13.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:56:13.584 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.584 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.589 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:13.586+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:13.606 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:13.691 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:13.690+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:13.764 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.764 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.780 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:13.790 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:13.790+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:13.890 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:13.886+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:13.938 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:13.938 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:13.954 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:13.995 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:13.994+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:14.092 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:14.090+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:14.107 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.107 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.123 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:14.193 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:14.194+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:14.241 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.241 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:14.294 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:14.294+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:14.371 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.371 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:14.394 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:14.394+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:14.495 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:14.494+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:14.499 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.499 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.515 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:14.527 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:56:14.596 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:14.594+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:14.640 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.640 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:14.697 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:14.698+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:14.768 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.768 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.784 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:14.798 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:14.798+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:14.892 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:14.892 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:14.899 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:14.898+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:14.905 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:15.000 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:14.998+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:15.017 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:15.035 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:15.035 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:15.049 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:15.101 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:15.102+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:15.161 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:15.161 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:15.166 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:15.167 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:15.176 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:15.177 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:15.181 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:15.192 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:15.202 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:15.198+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:15.207 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:15.207 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:15.223 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:15.223 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:15.241 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:15.241 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:15.259 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:15.259 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:15.276 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:15.303 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:15.302+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:15.346 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.058604817999999, 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:15.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.029762121000001, 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.080225274, 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:15.355 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2234 3.1a 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.8352150590000003, 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021079243000000001, 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.361 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510120+0000", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514283+0000", 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041627849999999996 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514319+0000", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6279000000000003e-05 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514337+0000", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000002e-05 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514465+0000", 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012822500000000001 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514759+0000", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029401200000000002 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.515064+0000", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000305369 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.529369+0000", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014304546 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.530884+0000", 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015148340000000001 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531063+0000", 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179144 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531195+0000", 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013279200000000001 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2241 3.3 3:c17523d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.752981933, 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018309130999999999, 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2241 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592353+0000", 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596511+0000", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004157689 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596549+0000", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7722999999999998e-05 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596566+0000", 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7232999999999999e-05 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596756+0000", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019029100000000001 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597011+0000", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025448199999999999 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597239+0000", 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022798100000000001 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.606429+0000", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00918975 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610330+0000", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039011200000000001 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610517+0000", 2024-04-22T19:56:15.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018694 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610659+0000", 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141812 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2243 3.e e75/20 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.7267459189999999, 2024-04-22T19:56:15.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019719670000000002, 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618588+0000", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2359999999999999e-06 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.622983+0000", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043956560000000004 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623022+0000", 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8509e-05 2024-04-22T19:56:15.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623042+0000", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9984e-05 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623164+0000", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012174400000000001 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623200+0000", 2024-04-22T19:56:15.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.65e-05 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638135+0000", 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014935313 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638305+0000", 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016972800000000001 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.7221460930000001, 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.377 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2247 3.e e75/20 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6871258779999998, 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016026911000000001, 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658208+0000", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7690000000000001e-06 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661839+0000", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036309699999999999 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661891+0000", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1969999999999999e-05 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661914+0000", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3142999999999998e-05 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662073+0000", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015902099999999999 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662129+0000", 2024-04-22T19:56:15.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6135999999999999e-05 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674095+0000", 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011965567 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674232+0000", 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013733500000000001 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2250 3.14 3:29315fda:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6646007970000003, 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016152612, 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680733+0000", 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7839999999999999e-06 2024-04-22T19:56:15.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684720+0000", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039870230000000001 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684755+0000", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5021000000000002e-05 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684773+0000", 2024-04-22T19:56:15.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7445e-05 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684881+0000", 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010862900000000001 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685091+0000", 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210087 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685270+0000", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017822000000000001 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.693447+0000", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081774489999999998 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696742+0000", 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032943740000000001 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696821+0000", 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9773999999999999e-05 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696883+0000", 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1805999999999997e-05 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.392 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2266 3.1a 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.5036109690000004, 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017647817999999999, 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2266 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841723+0000", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.818e-06 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845729+0000", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040059120000000004 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845758+0000", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8439999999999999e-05 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845777+0000", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9211999999999998e-05 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845874+0000", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6872000000000004e-05 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846027+0000", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015361899999999999 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846163+0000", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013575800000000001 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.851816+0000", 2024-04-22T19:56:15.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056529600000000003 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859284+0000", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679780000000001 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859327+0000", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3432e-05 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859368+0000", 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0816999999999999e-05 2024-04-22T19:56:15.397 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2270 3.9 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4613435260000003, 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019065421999999999, 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883990+0000", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887966+0000", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039765670000000003 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887995+0000", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8694e-05 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888008+0000", 2024-04-22T19:56:15.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2658e-05 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888095+0000", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7727999999999998e-05 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888228+0000", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132605 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888362+0000", 2024-04-22T19:56:15.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013399000000000001 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.894120+0000", 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00575845 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902908+0000", 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087880549999999995 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902985+0000", 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6637999999999994e-05 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.903053+0000", 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8089999999999994e-05 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0923866950000001, 2024-04-22T19:56:15.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.407 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2305 3.1c e75/20 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head v 75'3, mlcod=75'1)", 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0845567169999999, 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016090595999999999, 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260776+0000", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263929+0000", 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031526039999999998 2024-04-22T19:56:15.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263948+0000", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8885e-05 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263961+0000", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3662999999999999e-05 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264089+0000", 2024-04-22T19:56:15.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127136 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264135+0000", 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6845999999999998e-05 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276754+0000", 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012618430999999999 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276865+0000", 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011136100000000001 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2342 3.14 3:29b9f9a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.6993861670000001, 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017148498000000002, 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2342 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645948+0000", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.627e-06 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651334+0000", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053864910000000002 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651371+0000", 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6523000000000003e-05 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651389+0000", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7969e-05 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651477+0000", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7876999999999999e-05 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651609+0000", 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013271499999999999 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651731+0000", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121841 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.659086+0000", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073550250000000003 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.662886+0000", 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037994399999999998 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663019+0000", 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013331399999999999 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663094+0000", 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4676000000000001e-05 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.5976393780000002, 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2355 3.9 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.5691239370000001, 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02047042, 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2355 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776211+0000", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1839999999999999e-06 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780333+0000", 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041225819999999996 2024-04-22T19:56:15.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780367+0000", 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3606999999999999e-05 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780384+0000", 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7316000000000002e-05 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780464+0000", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9896999999999998e-05 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780591+0000", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012743699999999999 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780703+0000", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011181 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.785122+0000", 2024-04-22T19:56:15.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044187890000000002 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796555+0000", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011433103999999999 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796625+0000", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9935e-05 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796678+0000", 2024-04-22T19:56:15.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2759000000000001e-05 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2376 3.3 3:c3eda47a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.3426481900000002, 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016352073000000002, 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.429 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2376 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002688+0000", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8099999999999997e-06 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006957+0000", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042690239999999997 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006994+0000", 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7149e-05 2024-04-22T19:56:15.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007013+0000", 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8674000000000001e-05 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007109+0000", 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6372999999999994e-05 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007246+0000", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729700000000001 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007367+0000", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121041 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.014424+0000", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070568849999999997 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018824+0000", 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044000100000000002 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018964+0000", 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013976099999999999 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.019035+0000", 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1049000000000004e-05 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2388 3.9 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.186061364, 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018974290000000001, 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2388 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.435 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159272+0000", 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.447e-06 2024-04-22T19:56:15.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163089+0000", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038161340000000001 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163109+0000", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0554999999999999e-05 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163122+0000", 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2947e-05 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163270+0000", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147527 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163518+0000", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024866299999999999 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163763+0000", 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024473000000000002 2024-04-22T19:56:15.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.177631+0000", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013868096999999999 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178080+0000", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044913199999999998 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178174+0000", 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3602000000000003e-05 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178244+0000", 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0456000000000004e-05 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2393 3.9 3:904d522a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.0913788929999999, 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016110073999999999, 2024-04-22T19:56:15.440 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2393 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:15.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253954+0000", 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9819999999999998e-06 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258156+0000", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042015799999999999 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258184+0000", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258196+0000", 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2363e-05 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258307+0000", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011117500000000001 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258436+0000", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012931499999999999 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258547+0000", 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110759 2024-04-22T19:56:15.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.263618+0000", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050708230000000003 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269890+0000", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062723550000000003 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269988+0000", 2024-04-22T19:56:15.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8059000000000004e-05 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.270062+0000", 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4119e-05 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:15.446 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.6371915430000001, 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:15.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:15.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:15.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.452 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:15.453 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:15.454 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:15.454+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:15.554 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:15.550+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:15.627 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:15.628 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:15.628 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:15.628 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:15.643 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:15.655 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:15.650+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:15.755 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:15.754+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:15.761 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:15.762 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:15.776 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:15.861 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:15.862+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:15.946 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1328 3.d e71/20 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.642240025, 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018439563999999999, 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.947 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302182+0000", 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0199999999999999e-06 2024-04-22T19:56:15.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307605+0000", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054233349999999996 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307646+0000", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0252e-05 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307663+0000", 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307796+0000", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013284399999999999 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307831+0000", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5503000000000002e-05 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320466+0000", 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01263479 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320619+0000", 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015249 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3112944730000002, 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.951 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:15.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3010482970000004, 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:15.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2252 3.1c 3:3a12301e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2439981800000002, 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017446916, 2024-04-22T19:56:15.961 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2252 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700424+0000", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1760000000000002e-06 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704431+0000", 2024-04-22T19:56:15.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040072049999999998 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704466+0000", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4669999999999998e-05 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704482+0000", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6269999999999998e-05 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704584+0000", 2024-04-22T19:56:15.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010172 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704719+0000", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013505799999999999 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704840+0000", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121363 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.714157+0000", 2024-04-22T19:56:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093168030000000002 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717777+0000", 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036203009999999998 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717825+0000", 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7509000000000002e-05 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717868+0000", 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2840999999999999e-05 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2303 3.1d 3:b853a5d4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.7081431839999999, 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020957687999999999, 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2303 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236279+0000", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8669999999999998e-06 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240613+0000", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043339429999999998 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240655+0000", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799000000000001e-05 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240696+0000", 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0423000000000002e-05 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240813+0000", 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011725100000000001 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240970+0000", 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015661399999999999 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.241102+0000", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195200000000001 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.254210+0000", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013108585000000001 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257131+0000", 2024-04-22T19:56:15.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029205009999999998 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257182+0000", 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1622000000000001e-05 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257234+0000", 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1131000000000002e-05 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2305 3.1c 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6884606660000001, 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021365184999999998, 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2305 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255961+0000", 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6809999999999998e-06 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260167+0000", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042057170000000003 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260200+0000", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3552e-05 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260217+0000", 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6824e-05 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260307+0000", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0367999999999999e-05 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260460+0000", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000152516 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260592+0000", 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013156600000000001 2024-04-22T19:56:15.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273702+0000", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013110335000000001 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277161+0000", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034595170000000001 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277255+0000", 2024-04-22T19:56:15.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3205e-05 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277324+0000", 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8904000000000003e-05 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2311 3.28 3:14ad4f8a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6302323330000004, 2024-04-22T19:56:15.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016815739, 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2311 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314190+0000", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3919999999999999e-06 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318126+0000", 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039359900000000003 2024-04-22T19:56:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318164+0000", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7586999999999998e-05 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318183+0000", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9347999999999998e-05 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318314+0000", 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013121300000000001 2024-04-22T19:56:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318549+0000", 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023495999999999999 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318747+0000", 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019791399999999999 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.329114+0000", 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010366449999999999 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330720+0000", 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064849999999999 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330844+0000", 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123647 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.331002+0000", 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158753 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2315 3.28 3:14e71d18:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.5879614249999996, 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020619276999999998, 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2315 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356462+0000", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3630000000000004e-06 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360817+0000", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043554479999999996 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360844+0000", 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6146999999999999e-05 2024-04-22T19:56:15.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360860+0000", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6676000000000001e-05 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360957+0000", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6328000000000003e-05 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361165+0000", 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020848000000000001 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361379+0000", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213914 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.367709+0000", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063305009999999997 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.376921+0000", 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.009211403 2024-04-22T19:56:15.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377011+0000", 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9883000000000007e-05 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377077+0000", 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6134000000000001e-05 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.52134825, 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:15.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:15.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2332 3.37 e76/39 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3942002139999996, 2024-04-22T19:56:15.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017890809000000001, 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3700000000000001e-07 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557792+0000", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007573321 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557814+0000", 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1715000000000001e-05 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557863+0000", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8578000000000001e-05 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557939+0000", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6124000000000005e-05 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557963+0000", 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4189000000000002e-05 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568037+0000", 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010073799 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568110+0000", 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2745999999999998e-05 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2333 3.30 3:0d2f0eb3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:15.999 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3910852189999998, 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017849171, 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2333 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553336+0000", 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.655e-06 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559089+0000", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057529419999999996 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559107+0000", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7414e-05 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559117+0000", 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013999999999999e-05 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559193+0000", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5691000000000004e-05 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559322+0000", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012922000000000001 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559432+0000", 2024-04-22T19:56:16.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110497 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568620+0000", 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091877509999999992 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571024+0000", 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024038990000000001 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571121+0000", 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6779000000000003e-05 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571183+0000", 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2309000000000003e-05 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2345 3.1c 3:39c48d41:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.005 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.2679869479999999, 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019952768999999999, 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2345 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676435+0000", 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0230000000000001e-06 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681376+0000", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049407640000000003 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681419+0000", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3612000000000002e-05 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681439+0000", 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681580+0000", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014139799999999999 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681844+0000", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026375200000000002 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.682082+0000", 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238104 2024-04-22T19:56:16.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.694828+0000", 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012746435 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696216+0000", 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013878429999999999 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696316+0000", 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9652000000000001e-05 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696385+0000", 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8938999999999998e-05 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2364 3.30 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:16.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0705852570000003, 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020715262000000002, 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2364 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873837+0000", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.877978+0000", 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041410359999999998 2024-04-22T19:56:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878023+0000", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5633000000000002e-05 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878042+0000", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700000000000001e-05 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878133+0000", 2024-04-22T19:56:16.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0780999999999997e-05 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878277+0000", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014450500000000001 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878401+0000", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123841 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.888646+0000", 2024-04-22T19:56:16.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010244754 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894224+0000", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055782699999999998 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894414+0000", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018939400000000001 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894549+0000", 2024-04-22T19:56:16.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013541200000000001 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2375 3.2a 3:56043921:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.9515386910000001, 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020847931, 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2375 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992883+0000", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9270000000000001e-06 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996896+0000", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040128200000000003 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996931+0000", 2024-04-22T19:56:16.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5077999999999999e-05 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996948+0000", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6609e-05 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.997132+0000", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018460800000000001 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.997568+0000", 2024-04-22T19:56:16.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043578999999999997 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.998013+0000", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000444678 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013263+0000", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015250118 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013553+0000", 2024-04-22T19:56:16.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028962600000000002 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013644+0000", 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1058999999999997e-05 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013728+0000", 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4617999999999995e-05 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.022 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2385 3.c 3:3354ce27:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.825010818, 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021052076999999999, 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.023 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2385 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119412+0000", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.41e-06 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123480+0000", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040681529999999997 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123515+0000", 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4780000000000002e-05 2024-04-22T19:56:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123532+0000", 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7465999999999998e-05 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123613+0000", 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1169999999999997e-05 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123742+0000", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129061 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123852+0000", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010954 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.127840+0000", 2024-04-22T19:56:16.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039878309999999998 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140374+0000", 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012534422999999999 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140423+0000", 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9286999999999998e-05 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140460+0000", 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6956000000000003e-05 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2391 3.5 3:a2d3eba9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.7297836049999997, 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017587538999999999, 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2391 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214639+0000", 2024-04-22T19:56:16.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.242e-06 2024-04-22T19:56:16.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218467+0000", 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003828091 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218485+0000", 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8389999999999998e-05 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218495+0000", 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0040999999999999e-05 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218570+0000", 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4429000000000002e-05 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218702+0000", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013223299999999999 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218814+0000", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112663 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.223915+0000", 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051004090000000002 2024-04-22T19:56:16.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232127+0000", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082121820000000002 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232175+0000", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7790000000000002e-05 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232223+0000", 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8068999999999997e-05 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.036 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2418 3.2a 3:5539521c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.2725477139999999, 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019147775999999998, 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2418 2024-04-22T19:56:16.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671888+0000", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6722999999999999e-05 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679091+0000", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007202483 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679124+0000", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3420000000000002e-05 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679140+0000", 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6430999999999999e-05 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679227+0000", 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6611000000000001e-05 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679366+0000", 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013864300000000001 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679486+0000", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012067500000000001 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.686192+0000", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006705267 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.690792+0000", 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046003390000000002 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.690907+0000", 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115485 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.691019+0000", 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111699 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.2481550650000002, 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:56:16.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:56:16.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.0859535650000001, 2024-04-22T19:56:16.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:56:16.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2435 3.1c 3:3898cd42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.0762711519999999, 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018339015, 2024-04-22T19:56:16.054 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2435 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868151+0000", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.723e-06 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871946+0000", 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037951370000000001 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871973+0000", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7237999999999999e-05 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871990+0000", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6585000000000001e-05 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872086+0000", 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6794999999999997e-05 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872228+0000", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014126699999999999 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872363+0000", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013531200000000001 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886195+0000", 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013832392000000001 2024-04-22T19:56:16.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886276+0000", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0432000000000005e-05 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886368+0000", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2669000000000003e-05 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886487+0000", 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118465 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.059 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.060 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.060 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.060 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.060 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:16.061 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:16.062 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:16.062+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:16.162 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:16.158+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:16.231 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:16.232 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:16.246 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:16.293 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:16.294+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:16.365 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:16.362+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:16.368 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:16.368 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:16.368 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:16.368 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:16.369 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:16.383 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:16.466 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:16.462+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 119.191049906, 2024-04-22T19:56:16.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:56:16.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:56:16.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.557 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.268306367000001, 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.558 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:16.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:56:16.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:16.564 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.237089678, 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:56:16.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:56:16.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1325 3.34 e71/20 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:16.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.274666007, 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020645097000000001, 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271353+0000", 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7740000000000001e-06 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277264+0000", 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059106089999999998 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277313+0000", 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9465999999999997e-05 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277329+0000", 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5722999999999998e-05 2024-04-22T19:56:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277471+0000", 2024-04-22T19:56:16.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014166100000000001 2024-04-22T19:56:16.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277515+0000", 2024-04-22T19:56:16.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4224999999999998e-05 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291789+0000", 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014274152999999999 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291997+0000", 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207486 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.578 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2259 3.10 3:09469309:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7738052680000003, 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017484422999999999, 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.579 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2259 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772215+0000", 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2160000000000002e-06 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777238+0000", 2024-04-22T19:56:16.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050229070000000001 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777278+0000", 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9993000000000001e-05 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777295+0000", 2024-04-22T19:56:16.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6475999999999999e-05 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777391+0000", 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6475e-05 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777568+0000", 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017636400000000001 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777727+0000", 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158892 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.785819+0000", 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080919900000000003 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789571+0000", 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037520090000000002 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789641+0000", 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0073000000000005e-05 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789697+0000", 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6028e-05 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2264 3.2c 3:36fdbcdb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7231365929999996, 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020806587000000001, 2024-04-22T19:56:16.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2264 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:16.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822884+0000", 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1530000000000001e-06 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826221+0000", 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033373140000000001 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826248+0000", 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7075000000000001e-05 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826272+0000", 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3867e-05 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826507+0000", 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023510100000000001 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826972+0000", 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046434999999999998 2024-04-22T19:56:16.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827228+0000", 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025634600000000002 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.840423+0000", 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013194602999999999 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843417+0000", 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029944450000000001 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843576+0000", 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158746 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843687+0000", 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111587 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2267 3.a 3:532fdb49:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.693436524, 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017062766, 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.593 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:16.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852584+0000", 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7240000000000001e-06 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856673+0000", 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004089606 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856703+0000", 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9717999999999999e-05 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856718+0000", 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5265e-05 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856845+0000", 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012673 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857108+0000", 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026259500000000002 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857356+0000", 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024816600000000002 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869498+0000", 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012142484 2024-04-22T19:56:16.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869516+0000", 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8224e-05 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869589+0000", 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2747e-05 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869644+0000", 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4506999999999998e-05 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2269 3.20 3:07d561ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6722972409999999, 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017180925, 2024-04-22T19:56:16.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2269 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873723+0000", 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3920000000000001e-06 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.877999+0000", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042760860000000001 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878022+0000", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2966e-05 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878032+0000", 2024-04-22T19:56:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0541e-05 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878112+0000", 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9371999999999998e-05 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878268+0000", 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015625799999999999 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878409+0000", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.884923+0000", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065140069999999996 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890804+0000", 2024-04-22T19:56:16.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005880817 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890851+0000", 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7521000000000001e-05 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890901+0000", 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9867999999999998e-05 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2274 3.26 3:665ba539:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6208641459999997, 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360837, 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925157+0000", 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2799999999999999e-06 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929565+0000", 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044081490000000001 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929606+0000", 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0876e-05 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929625+0000", 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9729999999999999e-05 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929750+0000", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124287 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929883+0000", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013329800000000001 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929992+0000", 2024-04-22T19:56:16.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109344 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.936305+0000", 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006312504 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941417+0000", 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124330000000004 2024-04-22T19:56:16.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941466+0000", 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9075e-05 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941514+0000", 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7861000000000001e-05 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.5042104409999997, 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:56:16.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:56:16.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2291 3.35 3:afa6f2d5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.4390032289999999, 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019163485000000001, 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2291 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107018+0000", 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111911+0000", 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048925219999999998 2024-04-22T19:56:16.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111951+0000", 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0649000000000003e-05 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111970+0000", 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8206000000000002e-05 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112133+0000", 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016344800000000001 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112392+0000", 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025913999999999999 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112622+0000", 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022955600000000001 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.124629+0000", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012007489999999999 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.125926+0000", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012970119999999999 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126069+0000", 2024-04-22T19:56:16.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014246899999999999 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126178+0000", 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109113 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.626 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3194375750000003, 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.627 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:56:16.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3002296619999996, 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.633 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:56:16.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:56:16.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2307 3.35 3:ae2903f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:16.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2718621609999996, 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017656267999999999, 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2307 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274159+0000", 2024-04-22T19:56:16.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8190000000000002e-06 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278648+0000", 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044892999999999999 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278673+0000", 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4791999999999999e-05 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278691+0000", 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7632e-05 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278808+0000", 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117217 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279108+0000", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029989600000000002 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279479+0000", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037135800000000002 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.290910+0000", 2024-04-22T19:56:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011431021 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291646+0000", 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073550099999999995 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291740+0000", 2024-04-22T19:56:16.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3846999999999998e-05 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291812+0000", 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1884999999999994e-05 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.646 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2309 3.2c 3:3534673a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2531972700000003, 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019997352999999999, 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2309 2024-04-22T19:56:16.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292824+0000", 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.473e-06 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297694+0000", 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048700979999999998 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297747+0000", 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3301999999999999e-05 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297774+0000", 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6804999999999998e-05 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297959+0000", 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000185563 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298242+0000", 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282353 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298483+0000", 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024071300000000001 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312076+0000", 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013593449000000001 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312659+0000", 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058341999999999997 2024-04-22T19:56:16.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312750+0000", 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0661000000000005e-05 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312818+0000", 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7515999999999995e-05 2024-04-22T19:56:16.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2352 3.34 e76/20 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.7936301029999999, 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016493677000000002, 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752388+0000", 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8799999999999999e-07 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755703+0000", 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033158549999999999 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755734+0000", 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0905999999999999e-05 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755750+0000", 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755839+0000", 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8243000000000002e-05 2024-04-22T19:56:16.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755861+0000", 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2540000000000001e-05 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768802+0000", 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01294056 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768881+0000", 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9334999999999999e-05 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6170603269999999, 2024-04-22T19:56:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:56:16.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:56:16.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:56:16.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2379 3.10 3:0bd50452:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.511149058, 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019345125000000001, 2024-04-22T19:56:16.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2379 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034872+0000", 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.58e-06 2024-04-22T19:56:16.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041263+0000", 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063912040000000002 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041299+0000", 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5434e-05 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041316+0000", 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7295e-05 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041445+0000", 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000128837 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041699+0000", 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025379899999999997 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041926+0000", 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022783300000000001 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.050013+0000", 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080870379999999995 2024-04-22T19:56:16.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054035+0000", 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040219050000000001 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054135+0000", 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9533999999999999e-05 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054214+0000", 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8665999999999995e-05 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2392 3.10 3:0b3f212b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3128585260000003, 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017044683000000001, 2024-04-22T19:56:16.673 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2392 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:16.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233161+0000", 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.792e-06 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237419+0000", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042579519999999997 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237443+0000", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4511999999999998e-05 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237453+0000", 2024-04-22T19:56:16.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0020999999999999e-05 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237522+0000", 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237656+0000", 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013409000000000001 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237770+0000", 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011434699999999999 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.244689+0000", 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069184390000000002 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250116+0000", 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054270389999999998 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250165+0000", 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9307000000000001e-05 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250204+0000", 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8652000000000002e-05 2024-04-22T19:56:16.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2403 3.10 3:0a172ffa:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.1057157999999996, 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018364482000000001, 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:16.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2403 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:16.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440304+0000", 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.526e-06 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444141+0000", 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038364620000000001 2024-04-22T19:56:16.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444170+0000", 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9804000000000001e-05 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444185+0000", 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4630999999999999e-05 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444263+0000", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7657999999999994e-05 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444409+0000", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014669999999999999 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444566+0000", 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156305 2024-04-22T19:56:16.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.451574+0000", 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070081650000000002 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458556+0000", 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069819449999999998 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458616+0000", 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0358e-05 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458666+0000", 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9928e-05 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:16.687 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:16.687 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:16.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:56:16.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:16.689 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:16.686+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:16.789 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:16.790+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:16.860 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:16.860 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:16.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:16.917 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:16.918+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:16.991 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:16.986+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:17.039 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:17.040 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:17.040 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:17.040 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:17.040 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:17.054 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:17.091 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:17.090+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:17.175 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.24216126499999, 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.24208852199999, 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:56:17.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:56:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:56:17.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.24177671800001, 2024-04-22T19:56:17.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:17.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:56:17.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:56:17.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:56:17.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.241711245, 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:56:17.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:56:17.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.241650972, 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:56:17.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.241491626, 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:56:17.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:56:17.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:56:17.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:56:17.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:56:17.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 140.241418447, 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:56:17.209 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:56:17.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:56:17.214 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.877610345000001, 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.215 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2238 3.13 3:ca4ea4f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6146854800000003, 2024-04-22T19:56:17.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021851855, 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558729+0000", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0502e-05 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564422+0000", 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056929909999999997 2024-04-22T19:56:17.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564454+0000", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1958999999999997e-05 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564476+0000", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564633+0000", 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015726499999999999 2024-04-22T19:56:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564895+0000", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026218299999999998 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565129+0000", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023351599999999999 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.575133+0000", 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010003975999999999 2024-04-22T19:56:17.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580360+0000", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052269700000000001 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580459+0000", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9392e-05 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580550+0000", 2024-04-22T19:56:17.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1534999999999997e-05 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.5598222010000002, 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.226 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:56:17.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:56:17.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.542185677, 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.235 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.5213828400000002, 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.236 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.241 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2261 3.39 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.3816459390000002, 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021247716999999999, 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2261 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791741+0000", 2024-04-22T19:56:17.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.841e-06 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795697+0000", 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039563790000000003 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795720+0000", 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2758000000000001e-05 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795733+0000", 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3266e-05 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795878+0000", 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014489099999999999 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796222+0000", 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034329100000000002 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796815+0000", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059360900000000004 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.810758+0000", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013942540999999999 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812817+0000", 2024-04-22T19:56:17.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020592399999999999 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812908+0000", 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0768999999999998e-05 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812986+0000", 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8132000000000003e-05 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.238588451, 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:56:17.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:56:17.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:56:17.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:56:17.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.0571993119999998, 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:56:17.253 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.258 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6101293429999997, 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.259 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2380 3.39 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:17.265 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.1183959420000003, 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022144246999999999, 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2380 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:17.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054991+0000", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9069999999999999e-06 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059070+0000", 2024-04-22T19:56:17.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040787549999999999 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059112+0000", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1983000000000001e-05 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059130+0000", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8626000000000001e-05 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059235+0000", 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104183 2024-04-22T19:56:17.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059436+0000", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201755 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059625+0000", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018879300000000001 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.066370+0000", 2024-04-22T19:56:17.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067448760000000003 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077038+0000", 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010668230000000001 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077089+0000", 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0535000000000003e-05 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077132+0000", 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3603999999999998e-05 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2395 3.f 3:f222607a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.875460125, 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020909325999999999, 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2395 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297928+0000", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0400000000000003e-06 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302284+0000", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043558319999999996 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302322+0000", 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8250000000000001e-05 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302347+0000", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5205999999999999e-05 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302481+0000", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013369200000000001 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302733+0000", 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025226900000000001 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302982+0000", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024906599999999999 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.310851+0000", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078683950000000003 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318664+0000", 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078128610000000008 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318764+0000", 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010083599999999999 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318833+0000", 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8879000000000002e-05 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2423 3.39 3:9f6dcc47:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:17.276 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4385472850000003, 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019804914, 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2423 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734840+0000", 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9969999999999999e-06 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740450+0000", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056097660000000004 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740490+0000", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.015e-05 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740510+0000", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9979999999999998e-05 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740613+0000", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103186 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740791+0000", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178419 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740953+0000", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016120500000000001 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:17.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.747673+0000", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067207430000000004 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754572+0000", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068985660000000001 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754610+0000", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8217999999999999e-05 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754642+0000", 2024-04-22T19:56:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1683999999999997e-05 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3104526639999996, 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:56:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:56:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:56:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:17.286 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:17.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:17.288 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:17.286+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:17.292 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:17.388 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:17.386+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:17.420 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:17.421 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:17.434 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:17.478 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:17.478 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:17.488 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:17.486+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:17.495 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:17.495 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:17.511 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:17.512 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:17.528 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:17.528 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:17.539 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:56:17.548 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:17.548 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:17.554 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:17.554 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:17.569 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:17.575 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:17.575 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:17.597 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:17.597 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:17.597 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:17.594+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:17.617 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:17.617 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:17.686 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:17.686 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:17.690 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:17.690+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:17.699 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:17.791 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:17.790+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:17.821 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:17.822 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:17.835 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:17.892 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:17.890+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:17.952 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:17.952 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:17.966 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:17.993 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:17.994+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:18.094 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:18.090+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:18.125 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.125 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.138 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:18.227 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:18.226+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:18.295 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:18.294+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:18.303 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.303 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.317 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:18.396 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:18.394+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:18.480 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.480 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.494 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:18.497 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:18.498+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:18.598 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:18.598+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:18.612 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.612 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:18.700 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:18.698+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:18.747 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.747 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:18.807 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:18.806+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:18.884 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:18.884 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:18.899 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:18.901 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:18.902+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:19.002 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:19.002+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:19.067 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.067 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:19.129 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:19.130+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:19.203 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:19.202+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:19.211 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.211 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:19.304 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:19.302+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:19.398 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.398 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.405 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:19.402+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:19.413 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:19.506 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:19.502+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:19.531 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.531 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.548 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:19.571 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:56:19.615 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:19.614+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:19.634 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:19.671 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.671 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.685 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:19.729 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:19.730+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:19.780 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:19.797 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:19.797 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:19.808 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:19.808 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:19.811 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:19.810+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:19.813 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:19.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:19.829 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:19.829 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:19.846 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:19.847 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:19.866 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:19.867 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:19.884 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:19.884 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:19.902 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:19.902 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:19.913 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:19.910+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1328 3.d e71/20 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 21.687313858, 2024-04-22T19:56:19.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018439563999999999, 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302179+0000", 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.302182+0000", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0199999999999999e-06 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307605+0000", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054233349999999996 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307646+0000", 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0252e-05 2024-04-22T19:56:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307663+0000", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307796+0000", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013284399999999999 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.307831+0000", 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5503000000000002e-05 2024-04-22T19:56:19.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320466+0000", 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01263479 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320619+0000", 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015249 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3563683060000002, 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:19.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3461221299999995, 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.002 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:20.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:20.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2252 3.1c 3:3a12301e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2890720130000002, 2024-04-22T19:56:20.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017446916, 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2252 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700421+0000", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.700424+0000", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1760000000000002e-06 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704431+0000", 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040072049999999998 2024-04-22T19:56:20.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704466+0000", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4669999999999998e-05 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704482+0000", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6269999999999998e-05 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704584+0000", 2024-04-22T19:56:20.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010172 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704719+0000", 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013505799999999999 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.704840+0000", 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121363 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.714157+0000", 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093168030000000002 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717777+0000", 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036203009999999998 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717825+0000", 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7509000000000002e-05 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.717868+0000", 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2840999999999999e-05 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2303 3.1d 3:b853a5d4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.7532170170000008, 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020957687999999999, 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2303 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236276+0000", 2024-04-22T19:56:20.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.236279+0000", 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8669999999999998e-06 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240613+0000", 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043339429999999998 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240655+0000", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799000000000001e-05 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240696+0000", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0423000000000002e-05 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240813+0000", 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011725100000000001 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.240970+0000", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015661399999999999 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.241102+0000", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195200000000001 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.254210+0000", 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013108585000000001 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257131+0000", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029205009999999998 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257182+0000", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1622000000000001e-05 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.257234+0000", 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1131000000000002e-05 2024-04-22T19:56:20.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2305 3.1c 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.7335344989999992, 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021365184999999998, 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2305 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255958+0000", 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.255961+0000", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6809999999999998e-06 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260167+0000", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042057170000000003 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260200+0000", 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3552e-05 2024-04-22T19:56:20.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260217+0000", 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6824e-05 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260307+0000", 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0367999999999999e-05 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260460+0000", 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000152516 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260592+0000", 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013156600000000001 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273702+0000", 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013110335000000001 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277161+0000", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034595170000000001 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277255+0000", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3205e-05 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.277324+0000", 2024-04-22T19:56:20.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8904000000000003e-05 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2311 3.28 3:14ad4f8a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6753061660000004, 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016815739, 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2311 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314187+0000", 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.314190+0000", 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3919999999999999e-06 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318126+0000", 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039359900000000003 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318164+0000", 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7586999999999998e-05 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318183+0000", 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9347999999999998e-05 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318314+0000", 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013121300000000001 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318549+0000", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023495999999999999 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.318747+0000", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019791399999999999 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.329114+0000", 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010366449999999999 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330720+0000", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016064849999999999 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.330844+0000", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123647 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.331002+0000", 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158753 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2315 3.28 3:14e71d18:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6330352579999996, 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020619276999999998, 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.030 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2315 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356458+0000", 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.356462+0000", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3630000000000004e-06 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360817+0000", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043554479999999996 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360844+0000", 2024-04-22T19:56:20.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6146999999999999e-05 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360860+0000", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6676000000000001e-05 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.360957+0000", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6328000000000003e-05 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361165+0000", 2024-04-22T19:56:20.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020848000000000001 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.361379+0000", 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213914 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.367709+0000", 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063305009999999997 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.376921+0000", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.009211403 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377011+0000", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9883000000000007e-05 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.377077+0000", 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6134000000000001e-05 2024-04-22T19:56:20.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5664220829999991, 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.036 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.041 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2332 3.37 e76/39 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.4392740469999996, 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017890809000000001, 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.550219+0000", 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3700000000000001e-07 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557792+0000", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007573321 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557814+0000", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1715000000000001e-05 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557863+0000", 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8578000000000001e-05 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557939+0000", 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6124000000000005e-05 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.557963+0000", 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4189000000000002e-05 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568037+0000", 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010073799 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568110+0000", 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2745999999999998e-05 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2333 3.30 3:0d2f0eb3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:20.046 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.4361590520000007, 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017849171, 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2333 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553334+0000", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.553336+0000", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.655e-06 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559089+0000", 2024-04-22T19:56:20.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057529419999999996 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559107+0000", 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7414e-05 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559117+0000", 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013999999999999e-05 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559193+0000", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5691000000000004e-05 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559322+0000", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012922000000000001 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.559432+0000", 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110497 2024-04-22T19:56:20.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.568620+0000", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091877509999999992 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571024+0000", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024038990000000001 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571121+0000", 2024-04-22T19:56:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6779000000000003e-05 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.571183+0000", 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2309000000000003e-05 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2345 3.1c 3:39c48d41:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.3130607810000008, 2024-04-22T19:56:20.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019952768999999999, 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2345 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676432+0000", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.676435+0000", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0230000000000001e-06 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681376+0000", 2024-04-22T19:56:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049407640000000003 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681419+0000", 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3612000000000002e-05 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681439+0000", 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681580+0000", 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014139799999999999 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.681844+0000", 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026375200000000002 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.682082+0000", 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238104 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.694828+0000", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012746435 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696216+0000", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013878429999999999 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696316+0000", 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9652000000000001e-05 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.696385+0000", 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8938999999999998e-05 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2364 3.30 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1156590899999994, 2024-04-22T19:56:20.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020715262000000002, 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2364 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873834+0000", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.873837+0000", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.877978+0000", 2024-04-22T19:56:20.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041410359999999998 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878023+0000", 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5633000000000002e-05 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878042+0000", 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700000000000001e-05 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878133+0000", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0780999999999997e-05 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878277+0000", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014450500000000001 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.878401+0000", 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123841 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.888646+0000", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010244754 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894224+0000", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055782699999999998 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894414+0000", 2024-04-22T19:56:20.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018939400000000001 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.894549+0000", 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013541200000000001 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2375 3.2a 3:56043921:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9966125239999997, 2024-04-22T19:56:20.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020847931, 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2375 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:20.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992880+0000", 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.992883+0000", 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9270000000000001e-06 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996896+0000", 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040128200000000003 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996931+0000", 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5077999999999999e-05 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.996948+0000", 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6609e-05 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.997132+0000", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018460800000000001 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.997568+0000", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043578999999999997 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.998013+0000", 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000444678 2024-04-22T19:56:20.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013263+0000", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015250118 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013553+0000", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028962600000000002 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013644+0000", 2024-04-22T19:56:20.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1058999999999997e-05 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.013728+0000", 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4617999999999995e-05 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2385 3.c 3:3354ce27:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.070 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.870084651, 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021052076999999999, 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2385 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119408+0000", 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.119412+0000", 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.41e-06 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123480+0000", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040681529999999997 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123515+0000", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4780000000000002e-05 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123532+0000", 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7465999999999998e-05 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123613+0000", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1169999999999997e-05 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123742+0000", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129061 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.123852+0000", 2024-04-22T19:56:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010954 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.127840+0000", 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039878309999999998 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140374+0000", 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012534422999999999 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140423+0000", 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9286999999999998e-05 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.140460+0000", 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6956000000000003e-05 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2391 3.5 3:a2d3eba9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:20.076 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.7748574379999997, 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017587538999999999, 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2391 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214635+0000", 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.214639+0000", 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.242e-06 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218467+0000", 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003828091 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218485+0000", 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8389999999999998e-05 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218495+0000", 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0040999999999999e-05 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218570+0000", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4429000000000002e-05 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218702+0000", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013223299999999999 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.218814+0000", 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112663 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.223915+0000", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051004090000000002 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232127+0000", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082121820000000002 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232175+0000", 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7790000000000002e-05 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.232223+0000", 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8068999999999997e-05 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2418 3.2a 3:5539521c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.3176215469999999, 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019147775999999998, 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2418 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671871+0000", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.671888+0000", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6722999999999999e-05 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679091+0000", 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007202483 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679124+0000", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3420000000000002e-05 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679140+0000", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6430999999999999e-05 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679227+0000", 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6611000000000001e-05 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679366+0000", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013864300000000001 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.679486+0000", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012067500000000001 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.686192+0000", 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006705267 2024-04-22T19:56:20.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.690792+0000", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046003390000000002 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.690907+0000", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115485 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.691019+0000", 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111699 2024-04-22T19:56:20.087 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.2932288979999997, 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.088 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:56:20.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:56:20.093 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.1310273979999996, 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:56:20.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2435 3.1c 3:3898cd42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.1213449850000003, 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018339015, 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2435 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:20.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868148+0000", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.868151+0000", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.723e-06 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871946+0000", 2024-04-22T19:56:20.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037951370000000001 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871973+0000", 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7237999999999999e-05 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.871990+0000", 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6585000000000001e-05 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872086+0000", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6794999999999997e-05 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872228+0000", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014126699999999999 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.872363+0000", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013531200000000001 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886195+0000", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013832392000000001 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886276+0000", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0432000000000005e-05 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886368+0000", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2669000000000003e-05 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.886487+0000", 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118465 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.105 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:20.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:20.107 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:20.102+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:20.208 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:20.206+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:20.232 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:20.232 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:20.232 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:20.232 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:20.246 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:20.333 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:20.334+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:20.408 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:20.406+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:20.411 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:20.412 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:20.426 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:20.513 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:20.514+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:20.540 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:56:20.600 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:20.600 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:20.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:20.600 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 123.24229535800001, 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:56:20.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:56:20.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.607 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.319551819000001, 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:56:20.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:20.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.28833513, 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:56:20.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:56:20.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1325 3.34 e71/20 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.325911459, 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020645097000000001, 2024-04-22T19:56:20.619 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271353+0000", 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7740000000000001e-06 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277264+0000", 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059106089999999998 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277313+0000", 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9465999999999997e-05 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277329+0000", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5722999999999998e-05 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277471+0000", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014166100000000001 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277515+0000", 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4224999999999998e-05 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291789+0000", 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014274152999999999 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291997+0000", 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207486 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2259 3.10 3:09469309:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.623 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8250507200000001, 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017484422999999999, 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2259 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772215+0000", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2160000000000002e-06 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777238+0000", 2024-04-22T19:56:20.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050229070000000001 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777278+0000", 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9993000000000001e-05 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777295+0000", 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6475999999999999e-05 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777391+0000", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6475e-05 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777568+0000", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017636400000000001 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777727+0000", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158892 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.785819+0000", 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080919900000000003 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789571+0000", 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037520090000000002 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789641+0000", 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0073000000000005e-05 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789697+0000", 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6028e-05 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2264 3.2c 3:36fdbcdb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.7743820449999994, 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020806587000000001, 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.629 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2264 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:20.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822884+0000", 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1530000000000001e-06 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826221+0000", 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033373140000000001 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826248+0000", 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7075000000000001e-05 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826272+0000", 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3867e-05 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826507+0000", 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023510100000000001 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826972+0000", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046434999999999998 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827228+0000", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025634600000000002 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.840423+0000", 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013194602999999999 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843417+0000", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029944450000000001 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843576+0000", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158746 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843687+0000", 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111587 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2267 3.a 3:532fdb49:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.7446819760000007, 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017062766, 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-22T19:56:20.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852584+0000", 2024-04-22T19:56:20.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7240000000000001e-06 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856673+0000", 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004089606 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856703+0000", 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9717999999999999e-05 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856718+0000", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5265e-05 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856845+0000", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012673 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857108+0000", 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026259500000000002 2024-04-22T19:56:20.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857356+0000", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024816600000000002 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869498+0000", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012142484 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869516+0000", 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8224e-05 2024-04-22T19:56:20.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869589+0000", 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2747e-05 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869644+0000", 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4506999999999998e-05 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2269 3.20 3:07d561ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.7235426930000006, 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017180925, 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2269 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873723+0000", 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3920000000000001e-06 2024-04-22T19:56:20.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.877999+0000", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042760860000000001 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878022+0000", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2966e-05 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878032+0000", 2024-04-22T19:56:20.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0541e-05 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878112+0000", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9371999999999998e-05 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878268+0000", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015625799999999999 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878409+0000", 2024-04-22T19:56:20.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.884923+0000", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065140069999999996 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890804+0000", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005880817 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890851+0000", 2024-04-22T19:56:20.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7521000000000001e-05 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890901+0000", 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9867999999999998e-05 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2274 3.26 3:665ba539:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:20.646 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6721095980000005, 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360837, 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925157+0000", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2799999999999999e-06 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929565+0000", 2024-04-22T19:56:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044081490000000001 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929606+0000", 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0876e-05 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929625+0000", 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9729999999999999e-05 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929750+0000", 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124287 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929883+0000", 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013329800000000001 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929992+0000", 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109344 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.936305+0000", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006312504 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941417+0000", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124330000000004 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941466+0000", 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9075e-05 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941514+0000", 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7861000000000001e-05 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.5554558929999995, 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:56:20.652 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:56:20.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:56:20.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:56:20.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:56:20.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2291 3.35 3:afa6f2d5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.4902486810000006, 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019163485000000001, 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2291 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107018+0000", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111911+0000", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048925219999999998 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111951+0000", 2024-04-22T19:56:20.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0649000000000003e-05 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111970+0000", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8206000000000002e-05 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112133+0000", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016344800000000001 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112392+0000", 2024-04-22T19:56:20.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025913999999999999 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112622+0000", 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022955600000000001 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.124629+0000", 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012007489999999999 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.125926+0000", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012970119999999999 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126069+0000", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014246899999999999 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126178+0000", 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109113 2024-04-22T19:56:20.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3706830270000001, 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.664 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:56:20.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:56:20.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3514751139999994, 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.670 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:56:20.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2307 3.35 3:ae2903f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3231076129999995, 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017656267999999999, 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2307 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274159+0000", 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8190000000000002e-06 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278648+0000", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044892999999999999 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278673+0000", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4791999999999999e-05 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278691+0000", 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7632e-05 2024-04-22T19:56:20.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278808+0000", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117217 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279108+0000", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029989600000000002 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279479+0000", 2024-04-22T19:56:20.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037135800000000002 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.290910+0000", 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011431021 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291646+0000", 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073550099999999995 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291740+0000", 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3846999999999998e-05 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291812+0000", 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1884999999999994e-05 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2309 3.2c 3:3534673a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:20.681 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3044427219999992, 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019997352999999999, 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2309 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292824+0000", 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.473e-06 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297694+0000", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048700979999999998 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297747+0000", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3301999999999999e-05 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297774+0000", 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6804999999999998e-05 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297959+0000", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000185563 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298242+0000", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282353 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298483+0000", 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024071300000000001 2024-04-22T19:56:20.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312076+0000", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013593449000000001 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312659+0000", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058341999999999997 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312750+0000", 2024-04-22T19:56:20.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0661000000000005e-05 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312818+0000", 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7515999999999995e-05 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2352 3.34 e76/20 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8448755549999998, 2024-04-22T19:56:20.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016493677000000002, 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752388+0000", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8799999999999999e-07 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755703+0000", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033158549999999999 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755734+0000", 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0905999999999999e-05 2024-04-22T19:56:20.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755750+0000", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755839+0000", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8243000000000002e-05 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755861+0000", 2024-04-22T19:56:20.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2540000000000001e-05 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768802+0000", 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01294056 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768881+0000", 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9334999999999999e-05 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6683057790000007, 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.692 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:56:20.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.697 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2379 3.10 3:0bd50452:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5623945100000007, 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019345125000000001, 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2379 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034872+0000", 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.58e-06 2024-04-22T19:56:20.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041263+0000", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063912040000000002 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041299+0000", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5434e-05 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041316+0000", 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7295e-05 2024-04-22T19:56:20.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041445+0000", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000128837 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041699+0000", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025379899999999997 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041926+0000", 2024-04-22T19:56:20.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022783300000000001 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.050013+0000", 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080870379999999995 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054035+0000", 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040219050000000001 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054135+0000", 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9533999999999999e-05 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054214+0000", 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8665999999999995e-05 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2392 3.10 3:0b3f212b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.3641039779999993, 2024-04-22T19:56:20.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017044683000000001, 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2392 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233161+0000", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.792e-06 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237419+0000", 2024-04-22T19:56:20.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042579519999999997 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237443+0000", 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4511999999999998e-05 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237453+0000", 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0020999999999999e-05 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237522+0000", 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237656+0000", 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013409000000000001 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237770+0000", 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011434699999999999 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.244689+0000", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069184390000000002 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250116+0000", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054270389999999998 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250165+0000", 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9307000000000001e-05 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250204+0000", 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8652000000000002e-05 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2403 3.10 3:0a172ffa:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1569612520000003, 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018364482000000001, 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:20.709 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2403 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:20.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440304+0000", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.526e-06 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444141+0000", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038364620000000001 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:20.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444170+0000", 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9804000000000001e-05 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444185+0000", 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4630999999999999e-05 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444263+0000", 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7657999999999994e-05 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444409+0000", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014669999999999999 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444566+0000", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156305 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.451574+0000", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070081650000000002 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:20.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458556+0000", 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069819449999999998 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458616+0000", 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0358e-05 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458666+0000", 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9928e-05 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.715 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:20.715 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:20.715 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:20.716 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:20.717 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:20.714+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:20.817 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:20.814+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:20.889 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:20.889 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:20.889 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:20.889 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:20.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:20.918 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:20.914+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:21.019 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:21.018+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:21.027 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:21.027 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:21.041 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:21.120 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:21.118+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23280247400001, 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.167 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:56:21.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:56:21.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.173 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23272973100001, 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:56:21.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:56:21.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.179 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.232417927, 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:56:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:56:21.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23235245399999, 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:56:21.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23229218099999, 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:56:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.197 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23213283499999, 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:56:21.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:56:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 144.23205965599999, 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.204 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:56:21.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.868251554, 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:56:21.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.215 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2238 3.13 3:ca4ea4f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.605326689, 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021851855, 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558729+0000", 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0502e-05 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564422+0000", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056929909999999997 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564454+0000", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1958999999999997e-05 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564476+0000", 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-22T19:56:21.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564633+0000", 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015726499999999999 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564895+0000", 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026218299999999998 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565129+0000", 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023351599999999999 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.575133+0000", 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010003975999999999 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580360+0000", 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052269700000000001 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580459+0000", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9392e-05 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580550+0000", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1534999999999997e-05 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.550463410000001, 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:56:21.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:56:21.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.532826886, 2024-04-22T19:56:21.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:56:21.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.231 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.512024049000001, 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.232 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:56:21.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2261 3.39 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.372287148, 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021247716999999999, 2024-04-22T19:56:21.238 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2261 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791741+0000", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.841e-06 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795697+0000", 2024-04-22T19:56:21.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039563790000000003 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795720+0000", 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2758000000000001e-05 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795733+0000", 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3266e-05 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795878+0000", 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014489099999999999 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796222+0000", 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034329100000000002 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796815+0000", 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059360900000000004 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.810758+0000", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013942540999999999 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812817+0000", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020592399999999999 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812908+0000", 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0768999999999998e-05 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812986+0000", 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8132000000000003e-05 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.22922966, 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:56:21.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.047840520999999, 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.250 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:56:21.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:56:21.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:56:21.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6007705520000002, 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:56:21.255 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:56:21.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:56:21.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2380 3.39 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1090371510000008, 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022144246999999999, 2024-04-22T19:56:21.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2380 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054991+0000", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9069999999999999e-06 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059070+0000", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040787549999999999 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059112+0000", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1983000000000001e-05 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059130+0000", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8626000000000001e-05 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059235+0000", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104183 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059436+0000", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201755 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059625+0000", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018879300000000001 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.066370+0000", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067448760000000003 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077038+0000", 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010668230000000001 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077089+0000", 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0535000000000003e-05 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077132+0000", 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3603999999999998e-05 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.267 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2395 3.f 3:f222607a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8661013339999997, 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020909325999999999, 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2395 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297928+0000", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0400000000000003e-06 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302284+0000", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043558319999999996 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302322+0000", 2024-04-22T19:56:21.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8250000000000001e-05 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302347+0000", 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5205999999999999e-05 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302481+0000", 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013369200000000001 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302733+0000", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025226900000000001 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302982+0000", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024906599999999999 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.310851+0000", 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078683950000000003 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318664+0000", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078128610000000008 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318764+0000", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010083599999999999 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318833+0000", 2024-04-22T19:56:21.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8879000000000002e-05 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2423 3.39 3:9f6dcc47:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.4291884939999999, 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019804914, 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:21.274 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2423 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734840+0000", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9969999999999999e-06 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740450+0000", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056097660000000004 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740490+0000", 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.015e-05 2024-04-22T19:56:21.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740510+0000", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9979999999999998e-05 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740613+0000", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103186 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740791+0000", 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178419 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740953+0000", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016120500000000001 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.747673+0000", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067207430000000004 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754572+0000", 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068985660000000001 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754610+0000", 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8217999999999999e-05 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754642+0000", 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1683999999999997e-05 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:56:21.279 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.3010938729999992, 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:21.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:56:21.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:21.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:21.284 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:21.286 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:21.286+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:21.286 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:21.387 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:21.382+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:21.422 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:21.422 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:21.422 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:21.422 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:21.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:21.527 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:21.526+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:21.588 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:21.586+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:21.608 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:21.608 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:21.608 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:21.608 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:21.609 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:21.622 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:21.707 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:21.706+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2226 3.30 e75/20 3:0e41a5ab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_35:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.359459844, 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014642652000000001, 2024-04-22T19:56:21.790 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427166+0000", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8649999999999999e-06 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431291+0000", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041244200000000002 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431327+0000", 2024-04-22T19:56:21.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6878999999999997e-05 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431343+0000", 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5316e-05 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431430+0000", 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6951000000000001e-05 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431457+0000", 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6869999999999999e-05 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441737+0000", 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010280131 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441807+0000", 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0220000000000002e-05 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2232 3.1 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.30223005, 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018281961999999999, 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2232 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.795 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484397+0000", 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3249999999999999e-06 2024-04-22T19:56:21.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486033+0000", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001635919 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486059+0000", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5469e-05 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486072+0000", 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2961e-05 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486150+0000", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8040000000000005e-05 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486274+0000", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012424199999999999 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486422+0000", 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014772299999999999 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.492789+0000", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063669970000000001 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502547+0000", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097584539999999997 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502623+0000", 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5778999999999994e-05 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502676+0000", 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3053000000000002e-05 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2236 3.1f 3:f8d31c71:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.249531964999999, 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016339066999999999, 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.800 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2236 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537095+0000", 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.117e-06 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538185+0000", 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001089631 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538216+0000", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538230+0000", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4059999999999999e-05 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538316+0000", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5987000000000002e-05 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538475+0000", 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158851 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538638+0000", 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016274200000000001 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546237+0000", 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075988269999999998 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553308+0000", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070717230000000002 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553374+0000", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5926999999999994e-05 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553431+0000", 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7030000000000001e-05 2024-04-22T19:56:21.805 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.146593118, 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.806 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:56:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2261 3.39 e75/20 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.989942187, 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015355292, 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796684+0000", 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0590000000000001e-06 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801376+0000", 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046924169999999999 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801411+0000", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4557999999999997e-05 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801426+0000", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5003e-05 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801515+0000", 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9222999999999996e-05 2024-04-22T19:56:21.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801539+0000", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4167000000000001e-05 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.811974+0000", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010434819999999999 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812037+0000", 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3045000000000004e-05 2024-04-22T19:56:21.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2278 3.1b 3:d9d4b47f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.819509077999999, 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015375801999999999, 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.816 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2278 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967117+0000", 2024-04-22T19:56:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968673+0000", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015559180000000001 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968701+0000", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7773999999999999e-05 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968713+0000", 2024-04-22T19:56:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2097e-05 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968773+0000", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9416000000000002e-05 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968878+0000", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105058 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968981+0000", 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:21.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.974340+0000", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053588689999999996 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982384+0000", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080438660000000002 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982427+0000", 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-04-22T19:56:21.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982491+0000", 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3707000000000005e-05 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2280 3.1b 3:db01396f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.797068763, 2024-04-22T19:56:21.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015968164999999999, 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2280 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989557+0000", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9700000000000002e-06 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990909+0000", 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00135172 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990932+0000", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2648999999999999e-05 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990942+0000", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9599999999999995e-06 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991026+0000", 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4308999999999995e-05 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991189+0000", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016345699999999999 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991341+0000", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151626 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.997154+0000", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005812696 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005402+0000", 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082480120000000007 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005470+0000", 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7866000000000004e-05 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005524+0000", 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3900000000000002e-05 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2285 3.20 e75/20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.739872222000001, 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018531975999999999, 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046753+0000", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4750000000000001e-06 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051077+0000", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043240420000000002 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051099+0000", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1775000000000001e-05 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051109+0000", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3989999999999993e-06 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051183+0000", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4388999999999995e-05 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051209+0000", 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6364e-05 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065217+0000", 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014007779999999999 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065284+0000", 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6752000000000001e-05 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2294 3.2b 3:d7f84201:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.650476060999999, 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015118481, 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2294 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136151+0000", 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7329999999999999e-06 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138609+0000", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002458591 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138631+0000", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1654999999999998e-05 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138644+0000", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3193999999999999e-05 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138713+0000", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8536999999999998e-05 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138873+0000", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015986599999999999 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.139001+0000", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012877 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.147109+0000", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081072379999999993 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151126+0000", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040168490000000003 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151208+0000", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2696999999999998e-05 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151267+0000", 2024-04-22T19:56:21.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8350999999999997e-05 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2334 3.39 e76/20 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head v 76'2, mlcod=0'0)", 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.216373209, 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017984908000000001, 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575079+0000", 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048271210000000002 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575102+0000", 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3176999999999998e-05 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575112+0000", 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-04-22T19:56:21.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575191+0000", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9210999999999998e-05 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575220+0000", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258999999999999e-05 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588191+0000", 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012970534000000001 2024-04-22T19:56:21.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588236+0000", 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2336 3.1b 3:da298d83:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.201189854000001, 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015250207, 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2336 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585437+0000", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9000000000000002e-06 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587056+0000", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001618731 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587081+0000", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.55e-05 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587096+0000", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4842e-05 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587167+0000", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0573000000000003e-05 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587312+0000", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014513899999999999 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587415+0000", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010298699999999999 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.593331+0000", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059162049999999999 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600558+0000", 2024-04-22T19:56:21.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072266539999999999 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600629+0000", 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1328999999999994e-05 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600685+0000", 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5346999999999997e-05 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2348 3.1 3:8222c369:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.08072999, 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015550125999999999, 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2348 2024-04-22T19:56:21.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705897+0000", 2024-04-22T19:56:21.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9170000000000002e-06 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707596+0000", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001699407 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707619+0000", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2058000000000001e-05 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707629+0000", 2024-04-22T19:56:21.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707699+0000", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707819+0000", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120559 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707912+0000", 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2405999999999996e-05 2024-04-22T19:56:21.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.713992+0000", 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060801960000000004 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721352+0000", 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073600139999999998 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721404+0000", 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2298e-05 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721444+0000", 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9892999999999999e-05 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2356 3.12 3:49f6adf5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:21.851 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.001430212000001, 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01483187, 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2356 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785197+0000", 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9840000000000001e-06 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787010+0000", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018132910000000001 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787037+0000", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6393e-05 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787055+0000", 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8377e-05 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787135+0000", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9966e-05 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787309+0000", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017395799999999999 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787461+0000", 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151786 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799502+0000", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01204146 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799903+0000", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040125000000000002 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799973+0000", 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9954000000000001e-05 2024-04-22T19:56:21.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.800026+0000", 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2451000000000003e-05 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2364 3.30 e76/20 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head v 76'5, mlcod=75'3)", 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9080858210000002, 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014877286, 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878541+0000", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199999999999999e-06 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882594+0000", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040533210000000004 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882632+0000", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7889999999999998e-05 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882649+0000", 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7198999999999999e-05 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882726+0000", 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6824999999999997e-05 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882757+0000", 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0620999999999997e-05 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893346+0000", 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010588735 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893416+0000", 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0074999999999996e-05 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2368 3.1f 3:fa2c368a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.8701642130000007, 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017814888000000001, 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2368 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916462+0000", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2299999999999998e-06 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918229+0000", 2024-04-22T19:56:21.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001767088 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918246+0000", 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6466000000000001e-05 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918254+0000", 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3950000000000001e-06 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918326+0000", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2191000000000001e-05 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918518+0000", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019120899999999999 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918685+0000", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016718700000000001 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.925569+0000", 2024-04-22T19:56:21.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068842970000000002 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934151+0000", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085817800000000007 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934214+0000", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3602999999999994e-05 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934275+0000", 2024-04-22T19:56:21.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0442000000000002e-05 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2371 3.2b 3:d7666e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.8386013699999992, 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014548161, 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2371 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948026+0000", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2820000000000001e-06 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949594+0000", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001568411 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949619+0000", 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4530999999999999e-05 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949629+0000", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079e-05 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949714+0000", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4704999999999996e-05 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949902+0000", 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018778800000000001 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.950071+0000", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016991700000000001 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.955358+0000", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052866689999999999 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962475+0000", 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071165120000000002 2024-04-22T19:56:21.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962526+0000", 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0899000000000002e-05 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962571+0000", 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5368000000000003e-05 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.872 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2380 3.39 e76/20 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head v 76'4, mlcod=76'2)", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.7271363720000004, 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016934601000000001, 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:21.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059490+0000", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063273+0000", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037835519999999999 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063301+0000", 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7693999999999999e-05 2024-04-22T19:56:21.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063314+0000", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2584e-05 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063438+0000", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124599 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063491+0000", 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2547999999999999e-05 2024-04-22T19:56:21.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076357+0000", 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012866481000000001 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076422+0000", 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5112999999999998e-05 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2384 3.17 3:eadd9673:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:21.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.6821186289999996, 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016101606000000001, 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2384 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104509+0000", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.54e-06 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108900+0000", 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043907529999999998 2024-04-22T19:56:21.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108939+0000", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9116000000000003e-05 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108956+0000", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7337e-05 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109059+0000", 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102713 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109242+0000", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018301799999999999 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109410+0000", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168126 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.118325+0000", 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089148109999999999 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120469+0000", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002144207 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120555+0000", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5434999999999998e-05 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120607+0000", 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2549999999999997e-05 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2409 3.2b 3:d6021423:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2297122980000008, 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018020067000000001, 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2409 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556916+0000", 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2459999999999997e-06 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559633+0000", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027169910000000002 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559659+0000", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5958000000000001e-05 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559674+0000", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559794+0000", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012010600000000001 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560001+0000", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020678499999999999 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560185+0000", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018441200000000001 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.567773+0000", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075876750000000003 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574761+0000", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069878800000000001 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574857+0000", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5891999999999996e-05 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574932+0000", 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5399000000000001e-05 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2428 3.2b 3:d690c0a1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.9976456979999995, 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016031986000000002, 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:21.887 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2428 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:21.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788981+0000", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8720000000000002e-06 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791238+0000", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002256989 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:21.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791259+0000", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1038000000000001e-05 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791272+0000", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791355+0000", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3331000000000006e-05 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791540+0000", 2024-04-22T19:56:21.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018519200000000001 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791700+0000", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015992799999999999 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.798641+0000", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069413629999999999 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804881+0000", 2024-04-22T19:56:21.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062399229999999997 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804952+0000", 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0640000000000001e-05 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.805010+0000", 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8458000000000002e-05 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:21.892 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:21.893 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:21.893 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:21.786+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:21.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:21.919 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:21.936 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:21.934+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:21.995 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:21.994+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:22.061 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:22.062 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:22.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:22.090 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:22.091 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:22.107 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:22.108 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:22.108 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:22.106+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:22.124 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:22.141 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:22.141 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:22.162 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:22.162 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:22.182 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:22.183 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:22.197 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:22.194+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:22.203 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:22.203 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:22.204 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.204 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.218 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:22.224 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:22.224 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:22.298 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:22.298+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:22.351 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.351 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:22.411 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:22.410+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:22.488 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.488 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.500 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:22.498+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:22.503 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:22.569 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:56:22.600 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:22.598+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:22.676 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.676 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:22.701 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:22.702+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:22.802 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:22.802+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:22.809 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.810 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.823 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:22.903 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:22.898+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:22.943 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:22.943 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:22.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:23.004 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:23.002+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:23.105 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:23.102+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:23.126 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.126 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:23.206 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:23.206+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.307 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:23.306+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:23.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:23.408 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:23.406+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:23.453 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.453 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.468 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:23.509 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:23.506+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:23.580 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:56:23.590 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.591 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:23.647 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:23.646+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:23.711 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:23.710+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:23.727 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.727 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.741 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:23.812 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:23.810+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:23.909 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:23.913 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:23.914+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:23.923 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:24.014 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:24.010+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:24.082 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:24.083 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:24.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:24.115 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:24.114+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:24.216 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:24.214+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:24.217 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:24.217 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:24.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:24.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:24.317 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:24.314+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:24.395 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:24.396 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:24.396 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:24.396 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:24.412 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:24.413 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:24.413 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:24.417 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:24.414+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:24.429 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:24.429 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:24.446 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:24.446 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:24.464 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:24.464 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:24.481 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:24.481 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:24.501 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:24.501 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:24.519 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:24.518+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:24.521 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:24.521 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:24.537 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:24.538 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:24.538 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:24.538 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:24.538 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:24.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:24.637 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:24.638+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:24.718 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 127.36058483399999, 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.719 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:56:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:56:24.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:56:24.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:56:24.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:56:24.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.437841294999998, 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.406624606000001, 2024-04-22T19:56:24.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:56:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:56:24.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1325 3.34 e71/20 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.444200935000001, 2024-04-22T19:56:24.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020645097000000001, 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271351+0000", 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271353+0000", 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7740000000000001e-06 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277264+0000", 2024-04-22T19:56:24.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059106089999999998 2024-04-22T19:56:24.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277313+0000", 2024-04-22T19:56:24.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9465999999999997e-05 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277329+0000", 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5722999999999998e-05 2024-04-22T19:56:24.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277471+0000", 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014166100000000001 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.277515+0000", 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4224999999999998e-05 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291789+0000", 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014274152999999999 2024-04-22T19:56:24.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.291997+0000", 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207486 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2259 3.10 3:09469309:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.943340195999999, 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017484422999999999, 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.746 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2259 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772212+0000", 2024-04-22T19:56:24.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.772215+0000", 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2160000000000002e-06 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777238+0000", 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050229070000000001 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777278+0000", 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9993000000000001e-05 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777295+0000", 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6475999999999999e-05 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777391+0000", 2024-04-22T19:56:24.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6475e-05 2024-04-22T19:56:24.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777568+0000", 2024-04-22T19:56:24.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017636400000000001 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.777727+0000", 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158892 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.785819+0000", 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080919900000000003 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789571+0000", 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037520090000000002 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789641+0000", 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0073000000000005e-05 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.789697+0000", 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6028e-05 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2264 3.2c 3:36fdbcdb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.892671521, 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020806587000000001, 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2264 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822881+0000", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.822884+0000", 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1530000000000001e-06 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826221+0000", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033373140000000001 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826248+0000", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7075000000000001e-05 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826272+0000", 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3867e-05 2024-04-22T19:56:24.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826507+0000", 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023510100000000001 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.826972+0000", 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046434999999999998 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.827228+0000", 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025634600000000002 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.840423+0000", 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013194602999999999 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843417+0000", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029944450000000001 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843576+0000", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158746 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.843687+0000", 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111587 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.760 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2267 3.a 3:532fdb49:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.862971452, 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017062766, 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.761 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852581+0000", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.852584+0000", 2024-04-22T19:56:24.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7240000000000001e-06 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856673+0000", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004089606 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856703+0000", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9717999999999999e-05 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856718+0000", 2024-04-22T19:56:24.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5265e-05 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.856845+0000", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012673 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857108+0000", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026259500000000002 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.857356+0000", 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024816600000000002 2024-04-22T19:56:24.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869498+0000", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012142484 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869516+0000", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8224e-05 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869589+0000", 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2747e-05 2024-04-22T19:56:24.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.869644+0000", 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4506999999999998e-05 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2269 3.20 3:07d561ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.841832169, 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017180925, 2024-04-22T19:56:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2269 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873720+0000", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.873723+0000", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3920000000000001e-06 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.877999+0000", 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042760860000000001 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878022+0000", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2966e-05 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878032+0000", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0541e-05 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878112+0000", 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9371999999999998e-05 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878268+0000", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015625799999999999 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.878409+0000", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014109699999999999 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.884923+0000", 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065140069999999996 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890804+0000", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005880817 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890851+0000", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7521000000000001e-05 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.890901+0000", 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9867999999999998e-05 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2274 3.26 3:665ba539:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.790399074, 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360837, 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925153+0000", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.925157+0000", 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2799999999999999e-06 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929565+0000", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044081490000000001 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929606+0000", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0876e-05 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929625+0000", 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9729999999999999e-05 2024-04-22T19:56:24.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929750+0000", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124287 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929883+0000", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013329800000000001 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.929992+0000", 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109344 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.936305+0000", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006312504 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941417+0000", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051124330000000004 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941466+0000", 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9075e-05 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.941514+0000", 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7861000000000001e-05 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.673745369000001, 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.777 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:56:24.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:56:24.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.782 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2291 3.35 3:afa6f2d5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.608538157, 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019163485000000001, 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2291 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107014+0000", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.107018+0000", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111911+0000", 2024-04-22T19:56:24.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048925219999999998 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111951+0000", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0649000000000003e-05 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.111970+0000", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8206000000000002e-05 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112133+0000", 2024-04-22T19:56:24.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016344800000000001 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112392+0000", 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025913999999999999 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.112622+0000", 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022955600000000001 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.124629+0000", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012007489999999999 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.125926+0000", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012970119999999999 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126069+0000", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014246899999999999 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.126178+0000", 2024-04-22T19:56:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109113 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.488972502999999, 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.793 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.46976459, 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:24.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:56:24.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:56:24.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:56:24.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:56:24.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.799 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2307 3.35 3:ae2903f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:24.800 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.441397089000001, 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017656267999999999, 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.801 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2307 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274155+0000", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274159+0000", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8190000000000002e-06 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278648+0000", 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044892999999999999 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278673+0000", 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4791999999999999e-05 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278691+0000", 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7632e-05 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.278808+0000", 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117217 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279108+0000", 2024-04-22T19:56:24.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029989600000000002 2024-04-22T19:56:24.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:24.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.279479+0000", 2024-04-22T19:56:24.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037135800000000002 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.290910+0000", 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011431021 2024-04-22T19:56:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291646+0000", 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073550099999999995 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291740+0000", 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3846999999999998e-05 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.291812+0000", 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1884999999999994e-05 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2309 3.2c 3:3534673a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.422732198, 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019997352999999999, 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.809 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2309 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292820+0000", 2024-04-22T19:56:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.292824+0000", 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.473e-06 2024-04-22T19:56:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297694+0000", 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048700979999999998 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297747+0000", 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3301999999999999e-05 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297774+0000", 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6804999999999998e-05 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.297959+0000", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000185563 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298242+0000", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282353 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.298483+0000", 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024071300000000001 2024-04-22T19:56:24.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312076+0000", 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013593449000000001 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312659+0000", 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058341999999999997 2024-04-22T19:56:24.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312750+0000", 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0661000000000005e-05 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.312818+0000", 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7515999999999995e-05 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2352 3.34 e76/20 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.963165030999999, 2024-04-22T19:56:24.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016493677000000002, 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752387+0000", 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752388+0000", 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8799999999999999e-07 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755703+0000", 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033158549999999999 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755734+0000", 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0905999999999999e-05 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755750+0000", 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755839+0000", 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8243000000000002e-05 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.755861+0000", 2024-04-22T19:56:24.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2540000000000001e-05 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768802+0000", 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01294056 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.768881+0000", 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9334999999999999e-05 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.826 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.786595255, 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:56:24.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:56:24.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:56:24.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2379 3.10 3:0bd50452:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.680683986, 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019345125000000001, 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2379 2024-04-22T19:56:24.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034868+0000", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.034872+0000", 2024-04-22T19:56:24.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.58e-06 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041263+0000", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063912040000000002 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041299+0000", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5434e-05 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041316+0000", 2024-04-22T19:56:24.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7295e-05 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041445+0000", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000128837 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041699+0000", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025379899999999997 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.041926+0000", 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022783300000000001 2024-04-22T19:56:24.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.050013+0000", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080870379999999995 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054035+0000", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040219050000000001 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054135+0000", 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9533999999999999e-05 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054214+0000", 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8665999999999995e-05 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2392 3.10 3:0b3f212b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.482393454, 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017044683000000001, 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.838 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2392 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233159+0000", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.233161+0000", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.792e-06 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237419+0000", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042579519999999997 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237443+0000", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4511999999999998e-05 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237453+0000", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0020999999999999e-05 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237522+0000", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237656+0000", 2024-04-22T19:56:24.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013409000000000001 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.237770+0000", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011434699999999999 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.244689+0000", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069184390000000002 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250116+0000", 2024-04-22T19:56:24.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054270389999999998 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250165+0000", 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9307000000000001e-05 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.250204+0000", 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8652000000000002e-05 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2403 3.10 3:0a172ffa:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.275250728, 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018364482000000001, 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2403 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:24.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440302+0000", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.440304+0000", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.526e-06 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444141+0000", 2024-04-22T19:56:24.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038364620000000001 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444170+0000", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9804000000000001e-05 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444185+0000", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4630999999999999e-05 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444263+0000", 2024-04-22T19:56:24.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7657999999999994e-05 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444409+0000", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014669999999999999 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.444566+0000", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156305 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.451574+0000", 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070081650000000002 2024-04-22T19:56:24.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458556+0000", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069819449999999998 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458616+0000", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0358e-05 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.458666+0000", 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9928e-05 2024-04-22T19:56:24.848 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:24.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:24.849 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:24.850 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:24.850 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:24.850+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:24.951 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:24.950+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:25.024 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:25.024 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:25.024 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:25.024 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:25.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:25.085 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:25.086+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:25.153 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:25.150+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:25.156 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:25.156 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:25.156 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:25.156 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:25.156 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:25.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:25.254 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:25.250+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.341 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.406628461, 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.342 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.40655571799999, 2024-04-22T19:56:25.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.40624391399999, 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.353 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:25.358 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.40617844100001, 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:56:25.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.40611816800001, 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:56:25.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:56:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.369 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.405958822, 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.370 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:56:25.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:56:25.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:56:25.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 148.405885643, 2024-04-22T19:56:25.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.042077541000001, 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.381 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:56:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:56:25.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:56:25.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2238 3.13 3:ca4ea4f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.779152676000001, 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021851855, 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558729+0000", 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0502e-05 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564422+0000", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056929909999999997 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564454+0000", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1958999999999997e-05 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564476+0000", 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564633+0000", 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015726499999999999 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564895+0000", 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026218299999999998 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565129+0000", 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023351599999999999 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.575133+0000", 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010003975999999999 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580360+0000", 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052269700000000001 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580459+0000", 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9392e-05 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580550+0000", 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1534999999999997e-05 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.392 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.724289397, 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.706652872999999, 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.398 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:56:25.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.402 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.685850036, 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:56:25.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2261 3.39 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.408 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.546113135000001, 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021247716999999999, 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2261 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791741+0000", 2024-04-22T19:56:25.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.841e-06 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795697+0000", 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039563790000000003 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795720+0000", 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2758000000000001e-05 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795733+0000", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3266e-05 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795878+0000", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014489099999999999 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796222+0000", 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034329100000000002 2024-04-22T19:56:25.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796815+0000", 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059360900000000004 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.810758+0000", 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013942540999999999 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812817+0000", 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020592399999999999 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812908+0000", 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0768999999999998e-05 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812986+0000", 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8132000000000003e-05 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.403055647, 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:56:25.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:56:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:56:25.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:25.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.221666508, 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:56:25.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:56:25.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:25.429 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.774596539000001, 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:25.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:56:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2380 3.39 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.282863138, 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022144246999999999, 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.436 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2380 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054991+0000", 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9069999999999999e-06 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059070+0000", 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040787549999999999 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059112+0000", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1983000000000001e-05 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059130+0000", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8626000000000001e-05 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059235+0000", 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104183 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059436+0000", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201755 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059625+0000", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018879300000000001 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.066370+0000", 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067448760000000003 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077038+0000", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010668230000000001 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077089+0000", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0535000000000003e-05 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077132+0000", 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3603999999999998e-05 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.441 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2395 3.f 3:f222607a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.039927321, 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020909325999999999, 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.442 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2395 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297928+0000", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0400000000000003e-06 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302284+0000", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043558319999999996 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302322+0000", 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8250000000000001e-05 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302347+0000", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5205999999999999e-05 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302481+0000", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013369200000000001 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302733+0000", 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025226900000000001 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302982+0000", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024906599999999999 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.310851+0000", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078683950000000003 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318664+0000", 2024-04-22T19:56:25.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078128610000000008 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318764+0000", 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010083599999999999 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318833+0000", 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8879000000000002e-05 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2423 3.39 3:9f6dcc47:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.603014481000001, 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019804914, 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2423 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734840+0000", 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9969999999999999e-06 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740450+0000", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056097660000000004 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740490+0000", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.015e-05 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740510+0000", 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9979999999999998e-05 2024-04-22T19:56:25.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740613+0000", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103186 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740791+0000", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178419 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740953+0000", 2024-04-22T19:56:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016120500000000001 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.747673+0000", 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067207430000000004 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754572+0000", 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068985660000000001 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754610+0000", 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8217999999999999e-05 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754642+0000", 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1683999999999997e-05 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.47491986, 2024-04-22T19:56:25.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:25.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:56:25.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:56:25.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:25.457 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:25.459 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:25.457+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:25.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:25.560 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:25.558+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:25.592 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:25.593 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:25.593 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:25.593 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:25.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:56:25.608 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:25.661 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:25.657+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:25.761 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:25.761+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:25.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:25.771 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:25.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:25.862 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:25.861+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:25.904 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:25.904 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:25.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:25.904 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:25.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2226 3.30 e75/20 3:0e41a5ab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_35:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.474436851, 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014642652000000001, 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427166+0000", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8649999999999999e-06 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431291+0000", 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041244200000000002 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431327+0000", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6878999999999997e-05 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431343+0000", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5316e-05 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431430+0000", 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6951000000000001e-05 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431457+0000", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6869999999999999e-05 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441737+0000", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010280131 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441807+0000", 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0220000000000002e-05 2024-04-22T19:56:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2232 3.1 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.417207057000001, 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018281961999999999, 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2232 2024-04-22T19:56:25.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484397+0000", 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3249999999999999e-06 2024-04-22T19:56:25.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486033+0000", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001635919 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486059+0000", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5469e-05 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486072+0000", 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2961e-05 2024-04-22T19:56:25.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486150+0000", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8040000000000005e-05 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486274+0000", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012424199999999999 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486422+0000", 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014772299999999999 2024-04-22T19:56:25.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.492789+0000", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063669970000000001 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502547+0000", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097584539999999997 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502623+0000", 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5778999999999994e-05 2024-04-22T19:56:25.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502676+0000", 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3053000000000002e-05 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2236 3.1f 3:f8d31c71:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.364508971999999, 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016339066999999999, 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2236 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537095+0000", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.117e-06 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538185+0000", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001089631 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538216+0000", 2024-04-22T19:56:25.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538230+0000", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4059999999999999e-05 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538316+0000", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5987000000000002e-05 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538475+0000", 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158851 2024-04-22T19:56:25.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538638+0000", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016274200000000001 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546237+0000", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075988269999999998 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553308+0000", 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070717230000000002 2024-04-22T19:56:25.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553374+0000", 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5926999999999994e-05 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553431+0000", 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7030000000000001e-05 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.261570125, 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2261 3.39 e75/20 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.104919194000001, 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015355292, 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796684+0000", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0590000000000001e-06 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801376+0000", 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046924169999999999 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801411+0000", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4557999999999997e-05 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801426+0000", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5003e-05 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801515+0000", 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9222999999999996e-05 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801539+0000", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4167000000000001e-05 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.811974+0000", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010434819999999999 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812037+0000", 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3045000000000004e-05 2024-04-22T19:56:25.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2278 3.1b 3:d9d4b47f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.934486085, 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015375801999999999, 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2278 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967117+0000", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968673+0000", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015559180000000001 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968701+0000", 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7773999999999999e-05 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968713+0000", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2097e-05 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968773+0000", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9416000000000002e-05 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968878+0000", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105058 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968981+0000", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.974340+0000", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053588689999999996 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982384+0000", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080438660000000002 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982427+0000", 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982491+0000", 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3707000000000005e-05 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2280 3.1b 3:db01396f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:25.934 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.912045770000001, 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015968164999999999, 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2280 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989557+0000", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9700000000000002e-06 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990909+0000", 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00135172 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990932+0000", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2648999999999999e-05 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990942+0000", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9599999999999995e-06 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991026+0000", 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4308999999999995e-05 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991189+0000", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016345699999999999 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991341+0000", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151626 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.997154+0000", 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005812696 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005402+0000", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082480120000000007 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005470+0000", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7866000000000004e-05 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005524+0000", 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3900000000000002e-05 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2285 3.20 e75/20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.854849228999999, 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018531975999999999, 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046753+0000", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4750000000000001e-06 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051077+0000", 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043240420000000002 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051099+0000", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1775000000000001e-05 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051109+0000", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3989999999999993e-06 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051183+0000", 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4388999999999995e-05 2024-04-22T19:56:25.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051209+0000", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6364e-05 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065217+0000", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014007779999999999 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065284+0000", 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6752000000000001e-05 2024-04-22T19:56:25.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2294 3.2b 3:d7f84201:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.765453067999999, 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015118481, 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2294 2024-04-22T19:56:25.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136151+0000", 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7329999999999999e-06 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138609+0000", 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002458591 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138631+0000", 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1654999999999998e-05 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138644+0000", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3193999999999999e-05 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138713+0000", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8536999999999998e-05 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138873+0000", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015986599999999999 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.139001+0000", 2024-04-22T19:56:25.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012877 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.147109+0000", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081072379999999993 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151126+0000", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040168490000000003 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151208+0000", 2024-04-22T19:56:25.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2696999999999998e-05 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151267+0000", 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8350999999999997e-05 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2334 3.39 e76/20 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head v 76'2, mlcod=0'0)", 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.331350216000001, 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017984908000000001, 2024-04-22T19:56:25.949 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575079+0000", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048271210000000002 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575102+0000", 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3176999999999998e-05 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575112+0000", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575191+0000", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9210999999999998e-05 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575220+0000", 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258999999999999e-05 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588191+0000", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012970534000000001 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588236+0000", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2336 3.1b 3:da298d83:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:25.953 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.316166860999999, 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015250207, 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2336 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585437+0000", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9000000000000002e-06 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587056+0000", 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001618731 2024-04-22T19:56:25.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587081+0000", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.55e-05 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587096+0000", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4842e-05 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587167+0000", 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0573000000000003e-05 2024-04-22T19:56:25.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587312+0000", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014513899999999999 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587415+0000", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010298699999999999 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.593331+0000", 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059162049999999999 2024-04-22T19:56:25.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600558+0000", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072266539999999999 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600629+0000", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1328999999999994e-05 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600685+0000", 2024-04-22T19:56:25.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5346999999999997e-05 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2348 3.1 3:8222c369:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.195706997, 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015550125999999999, 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.959 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2348 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705897+0000", 2024-04-22T19:56:25.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9170000000000002e-06 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707596+0000", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001699407 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707619+0000", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2058000000000001e-05 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707629+0000", 2024-04-22T19:56:25.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707699+0000", 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707819+0000", 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120559 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:25.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707912+0000", 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2405999999999996e-05 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.713992+0000", 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060801960000000004 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721352+0000", 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073600139999999998 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721404+0000", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2298e-05 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721444+0000", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9892999999999999e-05 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2356 3.12 3:49f6adf5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:25.964 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.116407218999999, 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01483187, 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2356 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785197+0000", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9840000000000001e-06 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787010+0000", 2024-04-22T19:56:25.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018132910000000001 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787037+0000", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6393e-05 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787055+0000", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8377e-05 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787135+0000", 2024-04-22T19:56:25.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9966e-05 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787309+0000", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017395799999999999 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787461+0000", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151786 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799502+0000", 2024-04-22T19:56:25.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01204146 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799903+0000", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040125000000000002 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799973+0000", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9954000000000001e-05 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.800026+0000", 2024-04-22T19:56:25.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2451000000000003e-05 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2364 3.30 e76/20 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head v 76'5, mlcod=75'3)", 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.023062828, 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014877286, 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.970 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878541+0000", 2024-04-22T19:56:25.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199999999999999e-06 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882594+0000", 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040533210000000004 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882632+0000", 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7889999999999998e-05 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882649+0000", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7198999999999999e-05 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882726+0000", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6824999999999997e-05 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882757+0000", 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0620999999999997e-05 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893346+0000", 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010588735 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893416+0000", 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0074999999999996e-05 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2368 3.1f 3:fa2c368a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.985141219999999, 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017814888000000001, 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2368 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916462+0000", 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2299999999999998e-06 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918229+0000", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001767088 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918246+0000", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6466000000000001e-05 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918254+0000", 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3950000000000001e-06 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918326+0000", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2191000000000001e-05 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918518+0000", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019120899999999999 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918685+0000", 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016718700000000001 2024-04-22T19:56:25.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.925569+0000", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068842970000000002 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934151+0000", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085817800000000007 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934214+0000", 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3602999999999994e-05 2024-04-22T19:56:25.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934275+0000", 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0442000000000002e-05 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2371 3.2b 3:d7666e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.953578376999999, 2024-04-22T19:56:25.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014548161, 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2371 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948026+0000", 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2820000000000001e-06 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949594+0000", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001568411 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949619+0000", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4530999999999999e-05 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949629+0000", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079e-05 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949714+0000", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4704999999999996e-05 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949902+0000", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018778800000000001 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.950071+0000", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016991700000000001 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.955358+0000", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052866689999999999 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962475+0000", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071165120000000002 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962526+0000", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0899000000000002e-05 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962571+0000", 2024-04-22T19:56:25.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5368000000000003e-05 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2380 3.39 e76/20 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head v 76'4, mlcod=76'2)", 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.842113379000001, 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016934601000000001, 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.986 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059490+0000", 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:56:25.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063273+0000", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037835519999999999 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063301+0000", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7693999999999999e-05 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063314+0000", 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2584e-05 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063438+0000", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124599 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063491+0000", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2547999999999999e-05 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076357+0000", 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012866481000000001 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076422+0000", 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5112999999999998e-05 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2384 3.17 3:eadd9673:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.797095636, 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016101606000000001, 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.990 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2384 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104509+0000", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.54e-06 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108900+0000", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043907529999999998 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108939+0000", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9116000000000003e-05 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108956+0000", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7337e-05 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109059+0000", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102713 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109242+0000", 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018301799999999999 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109410+0000", 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168126 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.118325+0000", 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089148109999999999 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120469+0000", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002144207 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120555+0000", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5434999999999998e-05 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120607+0000", 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2549999999999997e-05 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:25.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2409 3.2b 3:d6021423:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.344689304999999, 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018020067000000001, 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2409 2024-04-22T19:56:25.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556916+0000", 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2459999999999997e-06 2024-04-22T19:56:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559633+0000", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027169910000000002 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559659+0000", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5958000000000001e-05 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559674+0000", 2024-04-22T19:56:25.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559794+0000", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012010600000000001 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560001+0000", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020678499999999999 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560185+0000", 2024-04-22T19:56:25.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018441200000000001 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.567773+0000", 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075876750000000003 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574761+0000", 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069878800000000001 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574857+0000", 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5891999999999996e-05 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574932+0000", 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5399000000000001e-05 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2428 3.2b 3:d690c0a1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.112622705, 2024-04-22T19:56:26.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016031986000000002, 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2428 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:26.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788981+0000", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8720000000000002e-06 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791238+0000", 2024-04-22T19:56:26.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002256989 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791259+0000", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1038000000000001e-05 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791272+0000", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791355+0000", 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3331000000000006e-05 2024-04-22T19:56:26.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791540+0000", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018519200000000001 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791700+0000", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015992799999999999 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.798641+0000", 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069413629999999999 2024-04-22T19:56:26.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804881+0000", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062399229999999997 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804952+0000", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0640000000000001e-05 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.805010+0000", 2024-04-22T19:56:26.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8458000000000002e-05 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.007 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:26.008 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:26.009 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:26.005+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:26.109 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:26.109+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:26.134 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:26.134 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:26.134 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:26.135 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:26.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:26.210 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:26.205+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:26.271 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:26.271 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:26.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:26.311 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:26.309+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:26.412 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:26.409+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:56:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 133.105461209, 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:56:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:56:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:56:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2234 3.1a e75/20 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.938218647999999, 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013529701999999999, 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514973+0000", 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.68e-06 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519979+0000", 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050056659999999998 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519995+0000", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6580999999999999e-05 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520005+0000", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8120000000000002e-06 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520085+0000", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0187999999999999e-05 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520109+0000", 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4048000000000001e-05 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528439+0000", 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083296499999999992 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528501+0000", 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2076999999999995e-05 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2239 3.4 3:21f73a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.884580425999999, 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014804291000000001, 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2239 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568613+0000", 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2949999999999998e-06 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570474+0000", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018617060000000001 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570514+0000", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9580999999999999e-05 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570530+0000", 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6175999999999999e-05 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570634+0000", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103566 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570762+0000", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012803399999999999 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570905+0000", 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143079 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582799+0000", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011894175 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583277+0000", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047821099999999998 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583353+0000", 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5809000000000006e-05 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583414+0000", 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0659000000000003e-05 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2253 3.25 3:a7350408:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.745061049, 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011503131, 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2253 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708132+0000", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9960000000000002e-06 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709597+0000", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014653159999999999 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709631+0000", 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4124000000000001e-05 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709647+0000", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5506999999999999e-05 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709736+0000", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9341999999999999e-05 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709889+0000", 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015342 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709984+0000", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4676e-05 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.718852+0000", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088682929999999993 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719498+0000", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064514499999999996 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719571+0000", 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3642999999999999e-05 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719632+0000", 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0668999999999998e-05 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2256 3.31 3:8ce47cb8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.713507629, 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015270647, 2024-04-22T19:56:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2256 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739685+0000", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.948e-06 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740784+0000", 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001098489 2024-04-22T19:56:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740820+0000", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6658e-05 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740836+0000", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5807999999999998e-05 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740915+0000", 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8534000000000004e-05 2024-04-22T19:56:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741039+0000", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012463200000000001 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741143+0000", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103453 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.746502+0000", 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005359351 2024-04-22T19:56:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754828+0000", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083260509999999992 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754900+0000", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2203e-05 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754953+0000", 2024-04-22T19:56:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2519999999999999e-05 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2265 3.0 3:0004f258:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.622323479, 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012197256, 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2265 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830869+0000", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.734e-06 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832813+0000", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019440410000000001 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832846+0000", 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2404999999999999e-05 2024-04-22T19:56:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832862+0000", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6507999999999998e-05 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832951+0000", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8634000000000006e-05 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833072+0000", 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012147899999999999 2024-04-22T19:56:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833175+0000", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102589 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842438+0000", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092631840000000007 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842939+0000", 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050115499999999998 2024-04-22T19:56:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843006+0000", 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6886999999999998e-05 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843064+0000", 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7639999999999997e-05 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2266 3.1a e75/20 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.607208824000001, 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011766982, 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845983+0000", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.850998+0000", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050147000000000004 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851028+0000", 2024-04-22T19:56:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9926000000000001e-05 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851044+0000", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851131+0000", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6959000000000005e-05 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851157+0000", 2024-04-22T19:56:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5854e-05 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857673+0000", 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065160189999999996 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857748+0000", 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5436000000000001e-05 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2277 3.31 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.497516203, 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017512757, 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2277 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955677+0000", 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.92e-06 2024-04-22T19:56:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957378+0000", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001701316 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957391+0000", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2952000000000001e-05 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957397+0000", 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6229999999999999e-06 2024-04-22T19:56:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957456+0000", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8468999999999999e-05 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957572+0000", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116082 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957677+0000", 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105305 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.963176+0000", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054987320000000001 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973068+0000", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098916569999999999 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973135+0000", 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6879999999999997e-05 2024-04-22T19:56:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973186+0000", 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1820999999999997e-05 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2286 3.0 3:0027e6e6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.400810899, 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013313472, 2024-04-22T19:56:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2286 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052382+0000", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1410000000000001e-06 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054416+0000", 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020339830000000001 2024-04-22T19:56:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054444+0000", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7580999999999999e-05 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054455+0000", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1195999999999999e-05 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054532+0000", 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6978999999999996e-05 2024-04-22T19:56:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054649+0000", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117459 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054760+0000", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111061 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.064840+0000", 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010079612999999999 2024-04-22T19:56:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065571+0000", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073068600000000003 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065636+0000", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5467000000000002e-05 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065692+0000", 2024-04-22T19:56:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6305999999999999e-05 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2289 3.4 3:232cb087:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.368685633, 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017538444, 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2289 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084506+0000", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086111+0000", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016043330000000001 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086142+0000", 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411000000000001e-05 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086156+0000", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086231+0000", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4982999999999997e-05 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086388+0000", 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156396 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086574+0000", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186305 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.098446+0000", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011871457 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101948+0000", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035023419999999999 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101995+0000", 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6947999999999998e-05 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.102043+0000", 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7734000000000001e-05 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2306 3.3e 3:7d26d192:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.189113026999999, 2024-04-22T19:56:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012849724999999999, 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2306 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264081+0000", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7589999999999999e-06 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265830+0000", 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017491500000000001 2024-04-22T19:56:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265868+0000", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8056000000000003e-05 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265881+0000", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3529999999999999e-05 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265980+0000", 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8876999999999995e-05 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266173+0000", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019305400000000001 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266357+0000", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018393899999999999 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276434+0000", 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077254000000001 2024-04-22T19:56:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276822+0000", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000387239 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276879+0000", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7501999999999999e-05 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276927+0000", 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7364999999999998e-05 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2310 3.3e 3:7edfea0a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.151604583999999, 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012685073, 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2310 2024-04-22T19:56:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301588+0000", 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2550000000000002e-06 2024-04-22T19:56:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303338+0000", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017496440000000001 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303364+0000", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5677000000000002e-05 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303373+0000", 2024-04-22T19:56:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6639999999999993e-06 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303445+0000", 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1292999999999997e-05 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303578+0000", 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013347700000000001 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303709+0000", 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013108099999999999 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.313555+0000", 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098454960000000005 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314136+0000", 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058124700000000001 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314203+0000", 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6910999999999997e-05 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314270+0000", 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7328000000000003e-05 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2314 3.25 3:a7b71818:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.107702287, 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012726375999999999, 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2314 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345490+0000", 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:56:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347233+0000", 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001743164 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347253+0000", 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452e-05 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347264+0000", 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0385e-05 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347332+0000", 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8471000000000002e-05 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347458+0000", 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012541599999999999 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347588+0000", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012997799999999999 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.357622+0000", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010034022 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358127+0000", 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050533299999999995 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358164+0000", 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6866999999999998e-05 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358214+0000", 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9988000000000003e-05 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2329 3.19 3:9858478a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.941074898, 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015534793, 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2329 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512118+0000", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6350000000000002e-06 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514585+0000", 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002467155 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514602+0000", 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7456999999999999e-05 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514614+0000", 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1528e-05 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515433+0000", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081949699999999998 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515562+0000", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012903200000000001 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515684+0000", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121968 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.522007+0000", 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063230220000000002 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527545+0000", 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055375670000000002 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527601+0000", 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6489000000000001e-05 2024-04-22T19:56:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527650+0000", 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442999999999997e-05 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2335 3.25 3:a6bbb67a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.879805834000001, 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015472677000000001, 2024-04-22T19:56:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2335 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573386+0000", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3300000000000001e-06 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575798+0000", 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024118770000000002 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575820+0000", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1345999999999999e-05 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575830+0000", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0436e-05 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575899+0000", 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9175000000000001e-05 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576003+0000", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576094+0000", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1188999999999997e-05 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588377+0000", 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012282944000000001 2024-04-22T19:56:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588726+0000", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034938100000000001 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588804+0000", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7871e-05 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588857+0000", 2024-04-22T19:56:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2598e-05 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2344 3.4 3:20840935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.787829139999999, 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012283522, 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2344 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665363+0000", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.542e-06 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667312+0000", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019485100000000001 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667328+0000", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6623999999999999e-05 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667336+0000", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4279999999999999e-06 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667400+0000", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3893999999999995e-05 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667553+0000", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015292300000000001 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667655+0000", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102216 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677250+0000", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095952180000000008 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677509+0000", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025870899999999998 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677575+0000", 2024-04-22T19:56:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6026999999999997e-05 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677644+0000", 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9431000000000007e-05 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2381 3.31 3:8d21d2bd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.389157196999999, 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017338782, 2024-04-22T19:56:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2381 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064036+0000", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9110000000000002e-06 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066529+0000", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002493777 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066556+0000", 2024-04-22T19:56:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7144999999999998e-05 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066574+0000", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7107000000000001e-05 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066641+0000", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7895e-05 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066753+0000", 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011113299999999999 2024-04-22T19:56:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066847+0000", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4347999999999999e-05 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076112+0000", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092649340000000007 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081183+0000", 2024-04-22T19:56:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050710979999999996 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081273+0000", 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9538999999999998e-05 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081371+0000", 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8894999999999994e-05 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2386 3.31 3:8f12d370:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.319240641, 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017342527999999999, 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2386 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133953+0000", 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4240000000000002e-06 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136131+0000", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002178195 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136182+0000", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1221999999999998e-05 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136208+0000", 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.58e-05 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136323+0000", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011534700000000001 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136557+0000", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000233694 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136732+0000", 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017486800000000001 2024-04-22T19:56:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.143708+0000", 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069766339999999998 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151107+0000", 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073982800000000001 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151217+0000", 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109962 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151292+0000", 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5102e-05 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2424 3.19 3:99e73f45:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.707694326, 2024-04-22T19:56:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016703743, 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2424 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745500+0000", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.566e-06 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748132+0000", 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026317929999999999 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748167+0000", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4913000000000003e-05 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748181+0000", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4208e-05 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748274+0000", 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2824000000000004e-05 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748457+0000", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182936 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748647+0000", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190037 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.761985+0000", 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013338077 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762008+0000", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2853e-05 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762089+0000", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0996999999999997e-05 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762199+0000", 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011053900000000001 2024-04-22T19:56:26.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2429 3.19 3:99ec54ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.651658081000001, 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013709542999999999, 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:26.559 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2429 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801535+0000", 2024-04-22T19:56:26.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5769999999999998e-06 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803462+0000", 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019265759999999999 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803495+0000", 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2932999999999998e-05 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803507+0000", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1810999999999999e-05 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803582+0000", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5840000000000006e-05 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803785+0000", 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202282 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803968+0000", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018328800000000001 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.809395+0000", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054274340000000001 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815096+0000", 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057001459999999997 2024-04-22T19:56:26.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815180+0000", 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4295999999999994e-05 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815241+0000", 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1359999999999995e-05 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:26.564 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:26.565 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:26.566 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:26.565+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:26.567 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:26.582 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:56:26.666 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:26.665+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:26.707 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:26.707 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:26.707 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:26.707 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:26.723 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:26.730 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:26.730 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:26.747 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:26.747 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:26.763 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:26.763 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:26.768 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:26.765+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:26.779 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:26.779 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:26.799 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:26.799 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:26.818 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:26.818 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:26.834 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:26.834 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:26.838 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:26.838 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:26.850 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:26.859 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:26.859 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:26.876 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:26.873+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:26.970 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:26.969+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:26.972 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:26.972 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:26.987 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:27.071 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:27.069+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:27.106 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.106 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.120 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:27.172 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:27.169+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:27.237 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.237 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:27.295 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:27.293+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:27.368 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.368 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.374 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:27.373+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:27.382 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:27.475 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:27.473+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:27.514 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.515 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.528 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:27.576 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:27.573+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:27.650 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.650 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.666 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:27.677 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:27.673+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:27.778 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:27.773+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:27.790 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.791 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.806 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:27.879 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:27.877+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:27.943 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:27.985 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:27.985+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:28.081 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:28.077+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:28.109 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.109 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:28.181 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:28.177+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:28.282 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:28.281+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:28.288 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.289 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:28.383 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:28.381+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:28.420 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.420 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.434 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:28.484 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:28.481+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:28.552 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.552 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.567 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:28.610 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:28.609+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:28.615 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:56:28.686 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:28.681+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:28.732 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.732 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:28.787 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:28.781+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:28.863 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:28.863 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:28.876 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:28.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:28.925 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:28.925+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:28.988 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:28.985+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:29.003 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:29.003 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:29.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:29.019 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:29.019 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:29.035 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:29.035 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:29.052 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:29.052 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:29.070 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:29.070 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:29.089 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:29.089 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:29.089 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:29.085+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:29.107 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:29.107 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:29.125 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:29.125 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:29.143 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:29.143 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:29.190 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:29.190 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:29.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25663891900001, 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019861653, 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-22T19:56:29.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931223+0000", 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931224+0000", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2640000000000001e-06 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931234+0000", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.039e-05 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931255+0000", 2024-04-22T19:56:29.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0273000000000001e-05 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931272+0000", 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7007000000000002e-05 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942396+0000", 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011124116999999999 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942586+0000", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190428 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.942782+0000", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019557600000000001 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945384+0000", 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026017900000000001 2024-04-22T19:56:29.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950788+0000", 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054039839999999997 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.950951+0000", 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016340199999999999 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951084+0000", 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013342200000000001 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25656617600001, 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020062065, 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931296+0000", 2024-04-22T19:56:29.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931297+0000", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2929999999999999e-06 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931527+0000", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229996 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931573+0000", 2024-04-22T19:56:29.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5929e-05 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931586+0000", 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.362e-05 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943504+0000", 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011917285 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943622+0000", 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011864199999999999 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.943811+0000", 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018855900000000001 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946793+0000", 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029822030000000001 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951110+0000", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043167530000000004 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951241+0000", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131302 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951358+0000", 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116483 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.202 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.256254372, 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019935182999999999, 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.203 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931607+0000", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931608+0000", 2024-04-22T19:56:29.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0699999999999999e-06 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931616+0000", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931649+0000", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3840000000000001e-05 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931658+0000", 2024-04-22T19:56:29.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9460000000000004e-06 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945771+0000", 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014112571000000001 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.945905+0000", 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013421900000000001 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946097+0000", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192308 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949137+0000", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003039754 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951384+0000", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022468919999999999 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951492+0000", 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010785600000000001 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951543+0000", 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0603000000000003e-05 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25618889899999, 2024-04-22T19:56:29.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021119571, 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931673+0000", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931674+0000", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1999999999999998e-07 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931681+0000", 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5900000000000002e-06 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931711+0000", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0153000000000001e-05 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931719+0000", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8529999999999992e-06 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.946925+0000", 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015205857 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947049+0000", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433499999999999 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947232+0000", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018292499999999999 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952442+0000", 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005210073 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952623+0000", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018055600000000001 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952727+0000", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103952 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952792+0000", 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5456999999999993e-05 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.213 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25612862599999, 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021189752999999999, 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931733+0000", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931734+0000", 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7000000000000004e-07 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931857+0000", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123206 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931869+0000", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2150000000000001e-05 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931877+0000", 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0029999999999994e-06 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.947922+0000", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016044698999999999 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948043+0000", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120596 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.948230+0000", 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018750900000000001 2024-04-22T19:56:29.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952580+0000", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043504090000000004 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952811+0000", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023014500000000001 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952876+0000", 2024-04-22T19:56:29.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4919999999999995e-05 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952923+0000", 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7345999999999997e-05 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25596927999999, 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021283072, 2024-04-22T19:56:29.219 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931892+0000", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931893+0000", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4e-07 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931900+0000", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3860000000000004e-06 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931940+0000", 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0243000000000001e-05 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931952+0000", 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1586999999999999e-05 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949240+0000", 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017288363000000001 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949487+0000", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024695099999999997 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.949834+0000", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347067 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953006+0000", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031721029999999999 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953044+0000", 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7599999999999999e-05 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953122+0000", 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8162000000000001e-05 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953176+0000", 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3770000000000002e-05 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 152.25589610099999, 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:56:29.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:56:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:56:29.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.892087999000001, 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:56:29.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2238 3.13 3:ca4ea4f8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:29.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.629163133999999, 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021851855, 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:29.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558699+0000", 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.558729+0000", 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0502e-05 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564422+0000", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056929909999999997 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564454+0000", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1958999999999997e-05 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564476+0000", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564633+0000", 2024-04-22T19:56:29.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015726499999999999 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.564895+0000", 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026218299999999998 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.565129+0000", 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023351599999999999 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.575133+0000", 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010003975999999999 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580360+0000", 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052269700000000001 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580459+0000", 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9392e-05 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.580550+0000", 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1534999999999997e-05 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.574299855, 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:56:29.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.556663330999999, 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.535860494000001, 2024-04-22T19:56:29.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:56:29.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:56:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:56:29.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2261 3.39 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.396123592999999, 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021247716999999999, 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.257 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2261 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791738+0000", 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.791741+0000", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.841e-06 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795697+0000", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039563790000000003 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795720+0000", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2758000000000001e-05 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795733+0000", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3266e-05 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.795878+0000", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014489099999999999 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796222+0000", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034329100000000002 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.796815+0000", 2024-04-22T19:56:29.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059360900000000004 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.810758+0000", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013942540999999999 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812817+0000", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020592399999999999 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812908+0000", 2024-04-22T19:56:29.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0768999999999998e-05 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.812986+0000", 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8132000000000003e-05 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.253066104999998, 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:56:29.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:56:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.071676965999998, 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:56:29.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.624606997000001, 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:56:29.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:56:29.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:56:29.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2380 3.39 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.132873596, 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022144246999999999, 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.279 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2380 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054988+0000", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.054991+0000", 2024-04-22T19:56:29.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9069999999999999e-06 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059070+0000", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040787549999999999 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059112+0000", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1983000000000001e-05 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059130+0000", 2024-04-22T19:56:29.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8626000000000001e-05 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059235+0000", 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104183 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059436+0000", 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201755 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.059625+0000", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018879300000000001 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.066370+0000", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067448760000000003 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077038+0000", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010668230000000001 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077089+0000", 2024-04-22T19:56:29.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0535000000000003e-05 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.077132+0000", 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3603999999999998e-05 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2395 3.f 3:f222607a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.889937779, 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020909325999999999, 2024-04-22T19:56:29.284 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2395 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297924+0000", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.297928+0000", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0400000000000003e-06 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302284+0000", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043558319999999996 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302322+0000", 2024-04-22T19:56:29.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8250000000000001e-05 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302347+0000", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5205999999999999e-05 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302481+0000", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013369200000000001 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302733+0000", 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025226900000000001 2024-04-22T19:56:29.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.302982+0000", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024906599999999999 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.310851+0000", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078683950000000003 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318664+0000", 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078128610000000008 2024-04-22T19:56:29.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318764+0000", 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010083599999999999 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.318833+0000", 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8879000000000002e-05 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2423 3.39 3:9f6dcc47:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:29.289 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.453024938999999, 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019804914, 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2423 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:29.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734837+0000", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.734840+0000", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9969999999999999e-06 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740450+0000", 2024-04-22T19:56:29.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056097660000000004 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740490+0000", 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.015e-05 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740510+0000", 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9979999999999998e-05 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740613+0000", 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103186 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740791+0000", 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178419 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.740953+0000", 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016120500000000001 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.747673+0000", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067207430000000004 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754572+0000", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068985660000000001 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754610+0000", 2024-04-22T19:56:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8217999999999999e-05 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.754642+0000", 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1683999999999997e-05 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.324930318, 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:56:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:29.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:56:29.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:29.299 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:29.300 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:29.201+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:29.301 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:29.301+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:29.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:29.401 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:29.397+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:29.431 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:29.431 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:29.431 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:29.431 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:29.445 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:29.535 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:29.533+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:29.607 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:56:29.608 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:29.605+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:29.614 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:29.614 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:29.614 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:29.614 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:29.615 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:29.629 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:29.715 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:29.713+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:29.791 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:29.791 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2226 3.30 e75/20 3:0e41a5ab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_35:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.361342165, 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014642652000000001, 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427166+0000", 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8649999999999999e-06 2024-04-22T19:56:29.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431291+0000", 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041244200000000002 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431327+0000", 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6878999999999997e-05 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431343+0000", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5316e-05 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431430+0000", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6951000000000001e-05 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431457+0000", 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6869999999999999e-05 2024-04-22T19:56:29.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441737+0000", 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010280131 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441807+0000", 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0220000000000002e-05 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2232 3.1 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.304112370999999, 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018281961999999999, 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2232 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484397+0000", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3249999999999999e-06 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486033+0000", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001635919 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486059+0000", 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5469e-05 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486072+0000", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2961e-05 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486150+0000", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8040000000000005e-05 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486274+0000", 2024-04-22T19:56:29.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012424199999999999 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486422+0000", 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014772299999999999 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.492789+0000", 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063669970000000001 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502547+0000", 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097584539999999997 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502623+0000", 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5778999999999994e-05 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502676+0000", 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3053000000000002e-05 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.802 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2236 3.1f 3:f8d31c71:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.251414285999999, 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016339066999999999, 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2236 2024-04-22T19:56:29.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537095+0000", 2024-04-22T19:56:29.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.117e-06 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538185+0000", 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001089631 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538216+0000", 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538230+0000", 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4059999999999999e-05 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538316+0000", 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5987000000000002e-05 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538475+0000", 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158851 2024-04-22T19:56:29.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538638+0000", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016274200000000001 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546237+0000", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075988269999999998 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553308+0000", 2024-04-22T19:56:29.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070717230000000002 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553374+0000", 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5926999999999994e-05 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553431+0000", 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7030000000000001e-05 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.148475438999998, 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:56:29.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2261 3.39 e75/20 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:29.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.991824508000001, 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015355292, 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796684+0000", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0590000000000001e-06 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801376+0000", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046924169999999999 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801411+0000", 2024-04-22T19:56:29.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4557999999999997e-05 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801426+0000", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5003e-05 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801515+0000", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9222999999999996e-05 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801539+0000", 2024-04-22T19:56:29.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4167000000000001e-05 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.811974+0000", 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010434819999999999 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812037+0000", 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3045000000000004e-05 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2278 3.1b 3:d9d4b47f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.821391398999999, 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015375801999999999, 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2278 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967117+0000", 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968673+0000", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015559180000000001 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968701+0000", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7773999999999999e-05 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968713+0000", 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2097e-05 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968773+0000", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9416000000000002e-05 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968878+0000", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105058 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968981+0000", 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.974340+0000", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053588689999999996 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982384+0000", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080438660000000002 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982427+0000", 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982491+0000", 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3707000000000005e-05 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2280 3.1b 3:db01396f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.798951083999999, 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015968164999999999, 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2280 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:29.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989557+0000", 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9700000000000002e-06 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990909+0000", 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00135172 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990932+0000", 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2648999999999999e-05 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990942+0000", 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9599999999999995e-06 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991026+0000", 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4308999999999995e-05 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991189+0000", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016345699999999999 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991341+0000", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151626 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.997154+0000", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005812696 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005402+0000", 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082480120000000007 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005470+0000", 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7866000000000004e-05 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005524+0000", 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3900000000000002e-05 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.829 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2285 3.20 e75/20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.741754542999999, 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018531975999999999, 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046753+0000", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4750000000000001e-06 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051077+0000", 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043240420000000002 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051099+0000", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1775000000000001e-05 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051109+0000", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3989999999999993e-06 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051183+0000", 2024-04-22T19:56:29.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4388999999999995e-05 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051209+0000", 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6364e-05 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065217+0000", 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014007779999999999 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065284+0000", 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6752000000000001e-05 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2294 3.2b 3:d7f84201:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.652358381999999, 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015118481, 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.834 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2294 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136151+0000", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7329999999999999e-06 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138609+0000", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002458591 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138631+0000", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1654999999999998e-05 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138644+0000", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3193999999999999e-05 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138713+0000", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8536999999999998e-05 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138873+0000", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015986599999999999 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.139001+0000", 2024-04-22T19:56:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012877 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.147109+0000", 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081072379999999993 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151126+0000", 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040168490000000003 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151208+0000", 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2696999999999998e-05 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151267+0000", 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8350999999999997e-05 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2334 3.39 e76/20 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head v 76'2, mlcod=0'0)", 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:29.839 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.21825553, 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017984908000000001, 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575079+0000", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048271210000000002 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575102+0000", 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3176999999999998e-05 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575112+0000", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575191+0000", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9210999999999998e-05 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575220+0000", 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258999999999999e-05 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588191+0000", 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012970534000000001 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588236+0000", 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2336 3.1b 3:da298d83:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.843 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.203072174999999, 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015250207, 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2336 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585437+0000", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9000000000000002e-06 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587056+0000", 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001618731 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587081+0000", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.55e-05 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587096+0000", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4842e-05 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587167+0000", 2024-04-22T19:56:29.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0573000000000003e-05 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587312+0000", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014513899999999999 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587415+0000", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010298699999999999 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.593331+0000", 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059162049999999999 2024-04-22T19:56:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600558+0000", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072266539999999999 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600629+0000", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1328999999999994e-05 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600685+0000", 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5346999999999997e-05 2024-04-22T19:56:29.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2348 3.1 3:8222c369:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.082612310999998, 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015550125999999999, 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2348 2024-04-22T19:56:29.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705897+0000", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9170000000000002e-06 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707596+0000", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001699407 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707619+0000", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2058000000000001e-05 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707629+0000", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707699+0000", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707819+0000", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120559 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:29.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707912+0000", 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2405999999999996e-05 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.713992+0000", 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060801960000000004 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721352+0000", 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073600139999999998 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721404+0000", 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2298e-05 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721444+0000", 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9892999999999999e-05 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2356 3.12 3:49f6adf5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.854 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.003312532999999, 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01483187, 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2356 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:29.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785197+0000", 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9840000000000001e-06 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787010+0000", 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018132910000000001 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787037+0000", 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6393e-05 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787055+0000", 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8377e-05 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787135+0000", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9966e-05 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787309+0000", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017395799999999999 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787461+0000", 2024-04-22T19:56:29.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151786 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799502+0000", 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01204146 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799903+0000", 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040125000000000002 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799973+0000", 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9954000000000001e-05 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.800026+0000", 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2451000000000003e-05 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2364 3.30 e76/20 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head v 76'5, mlcod=75'3)", 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:29.860 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.909968142, 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014877286, 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:29.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878541+0000", 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199999999999999e-06 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882594+0000", 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040533210000000004 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882632+0000", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7889999999999998e-05 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882649+0000", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7198999999999999e-05 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882726+0000", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6824999999999997e-05 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882757+0000", 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0620999999999997e-05 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893346+0000", 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010588735 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893416+0000", 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0074999999999996e-05 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2368 3.1f 3:fa2c368a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.872046533999999, 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017814888000000001, 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2368 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916462+0000", 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2299999999999998e-06 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918229+0000", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001767088 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918246+0000", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6466000000000001e-05 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918254+0000", 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3950000000000001e-06 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918326+0000", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2191000000000001e-05 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918518+0000", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019120899999999999 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918685+0000", 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016718700000000001 2024-04-22T19:56:29.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.925569+0000", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068842970000000002 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934151+0000", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085817800000000007 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934214+0000", 2024-04-22T19:56:29.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3602999999999994e-05 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934275+0000", 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0442000000000002e-05 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2371 3.2b 3:d7666e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.840483690999999, 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014548161, 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2371 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:29.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948026+0000", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2820000000000001e-06 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949594+0000", 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001568411 2024-04-22T19:56:29.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949619+0000", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4530999999999999e-05 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949629+0000", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079e-05 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949714+0000", 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4704999999999996e-05 2024-04-22T19:56:29.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949902+0000", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018778800000000001 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.950071+0000", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016991700000000001 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.955358+0000", 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052866689999999999 2024-04-22T19:56:29.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962475+0000", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071165120000000002 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962526+0000", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0899000000000002e-05 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962571+0000", 2024-04-22T19:56:29.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5368000000000003e-05 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2380 3.39 e76/20 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head v 76'4, mlcod=76'2)", 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.729018693, 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016934601000000001, 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059490+0000", 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063273+0000", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037835519999999999 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063301+0000", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7693999999999999e-05 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063314+0000", 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2584e-05 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063438+0000", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124599 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063491+0000", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2547999999999999e-05 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076357+0000", 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012866481000000001 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076422+0000", 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5112999999999998e-05 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2384 3.17 3:eadd9673:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.684000950000001, 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016101606000000001, 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2384 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104509+0000", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.54e-06 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108900+0000", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043907529999999998 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108939+0000", 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9116000000000003e-05 2024-04-22T19:56:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108956+0000", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7337e-05 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109059+0000", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102713 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109242+0000", 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018301799999999999 2024-04-22T19:56:29.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109410+0000", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168126 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.118325+0000", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089148109999999999 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120469+0000", 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002144207 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120555+0000", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5434999999999998e-05 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120607+0000", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2549999999999997e-05 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2409 3.2b 3:d6021423:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:29.885 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.231594618999999, 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018020067000000001, 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2409 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556916+0000", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2459999999999997e-06 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559633+0000", 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027169910000000002 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559659+0000", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5958000000000001e-05 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559674+0000", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559794+0000", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012010600000000001 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560001+0000", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020678499999999999 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560185+0000", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018441200000000001 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.567773+0000", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075876750000000003 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574761+0000", 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069878800000000001 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574857+0000", 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5891999999999996e-05 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574932+0000", 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5399000000000001e-05 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2428 3.2b 3:d690c0a1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.999528019, 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016031986000000002, 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2428 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788981+0000", 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8720000000000002e-06 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791238+0000", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002256989 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791259+0000", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1038000000000001e-05 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791272+0000", 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791355+0000", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3331000000000006e-05 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791540+0000", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018519200000000001 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791700+0000", 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015992799999999999 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.798641+0000", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069413629999999999 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804881+0000", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062399229999999997 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804952+0000", 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0640000000000001e-05 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:29.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.805010+0000", 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8458000000000002e-05 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:29.896 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:29.898 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:29.898 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:29.897+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:29.998 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:29.993+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:30.061 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:30.061 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:30.074 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:30.099 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:30.097+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:30.200 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:30.197+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:30.237 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.237 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:30.237 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:30.237 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:30.237 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:30.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:30.301 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:30.297+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:30.374 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.374 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:30.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:30.374 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 137.02373211400001, 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2234 3.1a e75/20 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.856489552999999, 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013529701999999999, 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514973+0000", 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.68e-06 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519979+0000", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050056659999999998 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519995+0000", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6580999999999999e-05 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520005+0000", 2024-04-22T19:56:30.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8120000000000002e-06 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520085+0000", 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0187999999999999e-05 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520109+0000", 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4048000000000001e-05 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528439+0000", 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083296499999999992 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528501+0000", 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2076999999999995e-05 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2239 3.4 3:21f73a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.802851330999999, 2024-04-22T19:56:30.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014804291000000001, 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2239 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568613+0000", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2949999999999998e-06 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570474+0000", 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018617060000000001 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570514+0000", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9580999999999999e-05 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570530+0000", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6175999999999999e-05 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570634+0000", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103566 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570762+0000", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012803399999999999 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570905+0000", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143079 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582799+0000", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011894175 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583277+0000", 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047821099999999998 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583353+0000", 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5809000000000006e-05 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583414+0000", 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0659000000000003e-05 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2253 3.25 3:a7350408:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.663331954, 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011503131, 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2253 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708132+0000", 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9960000000000002e-06 2024-04-22T19:56:30.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709597+0000", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014653159999999999 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709631+0000", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4124000000000001e-05 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709647+0000", 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5506999999999999e-05 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709736+0000", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9341999999999999e-05 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709889+0000", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015342 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709984+0000", 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4676e-05 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.718852+0000", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088682929999999993 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719498+0000", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064514499999999996 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719571+0000", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3642999999999999e-05 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719632+0000", 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0668999999999998e-05 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2256 3.31 3:8ce47cb8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.631778533999999, 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015270647, 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2256 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739685+0000", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.948e-06 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740784+0000", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001098489 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740820+0000", 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6658e-05 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740836+0000", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5807999999999998e-05 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740915+0000", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8534000000000004e-05 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741039+0000", 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012463200000000001 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741143+0000", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103453 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.746502+0000", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005359351 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754828+0000", 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083260509999999992 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754900+0000", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2203e-05 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754953+0000", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2519999999999999e-05 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2265 3.0 3:0004f258:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:30.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.540594383999998, 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012197256, 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2265 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:30.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830869+0000", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.734e-06 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832813+0000", 2024-04-22T19:56:30.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019440410000000001 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832846+0000", 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2404999999999999e-05 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832862+0000", 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6507999999999998e-05 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832951+0000", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8634000000000006e-05 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833072+0000", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012147899999999999 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833175+0000", 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102589 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842438+0000", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092631840000000007 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842939+0000", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050115499999999998 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843006+0000", 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6886999999999998e-05 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843064+0000", 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7639999999999997e-05 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2266 3.1a e75/20 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.525479729000001, 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011766982, 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845983+0000", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.850998+0000", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050147000000000004 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851028+0000", 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9926000000000001e-05 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851044+0000", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851131+0000", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6959000000000005e-05 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851157+0000", 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5854e-05 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857673+0000", 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065160189999999996 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857748+0000", 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5436000000000001e-05 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2277 3.31 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.409 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.415787108, 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017512757, 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2277 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955677+0000", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.92e-06 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957378+0000", 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001701316 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957391+0000", 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2952000000000001e-05 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957397+0000", 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6229999999999999e-06 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957456+0000", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8468999999999999e-05 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957572+0000", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116082 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957677+0000", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105305 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.963176+0000", 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054987320000000001 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973068+0000", 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098916569999999999 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973135+0000", 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6879999999999997e-05 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973186+0000", 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1820999999999997e-05 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2286 3.0 3:0027e6e6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.319081804, 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013313472, 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.415 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2286 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052382+0000", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1410000000000001e-06 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054416+0000", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020339830000000001 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054444+0000", 2024-04-22T19:56:30.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7580999999999999e-05 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054455+0000", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1195999999999999e-05 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054532+0000", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6978999999999996e-05 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054649+0000", 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117459 2024-04-22T19:56:30.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054760+0000", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111061 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.064840+0000", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010079612999999999 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065571+0000", 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073068600000000003 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065636+0000", 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5467000000000002e-05 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065692+0000", 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6305999999999999e-05 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2289 3.4 3:232cb087:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.420 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.286956537999998, 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017538444, 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2289 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:30.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084506+0000", 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086111+0000", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016043330000000001 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086142+0000", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411000000000001e-05 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086156+0000", 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086231+0000", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4982999999999997e-05 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086388+0000", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156396 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086574+0000", 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186305 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.098446+0000", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011871457 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101948+0000", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035023419999999999 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101995+0000", 2024-04-22T19:56:30.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6947999999999998e-05 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.102043+0000", 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7734000000000001e-05 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2306 3.3e 3:7d26d192:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.107383932000001, 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012849724999999999, 2024-04-22T19:56:30.426 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2306 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264081+0000", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7589999999999999e-06 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265830+0000", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017491500000000001 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265868+0000", 2024-04-22T19:56:30.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8056000000000003e-05 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265881+0000", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3529999999999999e-05 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265980+0000", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8876999999999995e-05 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266173+0000", 2024-04-22T19:56:30.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019305400000000001 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266357+0000", 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018393899999999999 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276434+0000", 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077254000000001 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276822+0000", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000387239 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276879+0000", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7501999999999999e-05 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276927+0000", 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7364999999999998e-05 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2310 3.3e 3:7edfea0a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.069875489000001, 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012685073, 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2310 2024-04-22T19:56:30.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301588+0000", 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2550000000000002e-06 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303338+0000", 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017496440000000001 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303364+0000", 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5677000000000002e-05 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303373+0000", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6639999999999993e-06 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303445+0000", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1292999999999997e-05 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303578+0000", 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013347700000000001 2024-04-22T19:56:30.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303709+0000", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013108099999999999 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.313555+0000", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098454960000000005 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314136+0000", 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058124700000000001 2024-04-22T19:56:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314203+0000", 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6910999999999997e-05 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314270+0000", 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7328000000000003e-05 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2314 3.25 3:a7b71818:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.025973191999999, 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012726375999999999, 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2314 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345490+0000", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347233+0000", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001743164 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347253+0000", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452e-05 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347264+0000", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0385e-05 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347332+0000", 2024-04-22T19:56:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8471000000000002e-05 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347458+0000", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012541599999999999 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347588+0000", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012997799999999999 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.357622+0000", 2024-04-22T19:56:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010034022 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358127+0000", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050533299999999995 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358164+0000", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6866999999999998e-05 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358214+0000", 2024-04-22T19:56:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9988000000000003e-05 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2329 3.19 3:9858478a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.859345803, 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015534793, 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2329 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512118+0000", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6350000000000002e-06 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514585+0000", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002467155 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514602+0000", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7456999999999999e-05 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514614+0000", 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1528e-05 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515433+0000", 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081949699999999998 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515562+0000", 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012903200000000001 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515684+0000", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121968 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.522007+0000", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063230220000000002 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527545+0000", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055375670000000002 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527601+0000", 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6489000000000001e-05 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527650+0000", 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442999999999997e-05 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2335 3.25 3:a6bbb67a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.798076738999999, 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015472677000000001, 2024-04-22T19:56:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2335 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573386+0000", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3300000000000001e-06 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575798+0000", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024118770000000002 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575820+0000", 2024-04-22T19:56:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1345999999999999e-05 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575830+0000", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0436e-05 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575899+0000", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9175000000000001e-05 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576003+0000", 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576094+0000", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1188999999999997e-05 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588377+0000", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012282944000000001 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588726+0000", 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034938100000000001 2024-04-22T19:56:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588804+0000", 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7871e-05 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588857+0000", 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2598e-05 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2344 3.4 3:20840935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.706100044999999, 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012283522, 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2344 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665363+0000", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.542e-06 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667312+0000", 2024-04-22T19:56:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019485100000000001 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667328+0000", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6623999999999999e-05 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667336+0000", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4279999999999999e-06 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667400+0000", 2024-04-22T19:56:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3893999999999995e-05 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667553+0000", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015292300000000001 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667655+0000", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102216 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677250+0000", 2024-04-22T19:56:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095952180000000008 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677509+0000", 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025870899999999998 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677575+0000", 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6026999999999997e-05 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677644+0000", 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9431000000000007e-05 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2381 3.31 3:8d21d2bd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.307428101999999, 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017338782, 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2381 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064036+0000", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9110000000000002e-06 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066529+0000", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002493777 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066556+0000", 2024-04-22T19:56:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7144999999999998e-05 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066574+0000", 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7107000000000001e-05 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066641+0000", 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7895e-05 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066753+0000", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011113299999999999 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066847+0000", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4347999999999999e-05 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076112+0000", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092649340000000007 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081183+0000", 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050710979999999996 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081273+0000", 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9538999999999998e-05 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081371+0000", 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8894999999999994e-05 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2386 3.31 3:8f12d370:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.237511546, 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017342527999999999, 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2386 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133953+0000", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4240000000000002e-06 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136131+0000", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002178195 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136182+0000", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1221999999999998e-05 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136208+0000", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.58e-05 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136323+0000", 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011534700000000001 2024-04-22T19:56:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136557+0000", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000233694 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136732+0000", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017486800000000001 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.143708+0000", 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069766339999999998 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151107+0000", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073982800000000001 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151217+0000", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109962 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151292+0000", 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5102e-05 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2424 3.19 3:99e73f45:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.625965230999999, 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016703743, 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2424 2024-04-22T19:56:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745500+0000", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.566e-06 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748132+0000", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026317929999999999 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748167+0000", 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4913000000000003e-05 2024-04-22T19:56:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748181+0000", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4208e-05 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748274+0000", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2824000000000004e-05 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748457+0000", 2024-04-22T19:56:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182936 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748647+0000", 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190037 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.761985+0000", 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013338077 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762008+0000", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2853e-05 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762089+0000", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0996999999999997e-05 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762199+0000", 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011053900000000001 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2429 3.19 3:99ec54ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.569928986000001, 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013709542999999999, 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2429 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801535+0000", 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5769999999999998e-06 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803462+0000", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019265759999999999 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803495+0000", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2932999999999998e-05 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803507+0000", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1810999999999999e-05 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803582+0000", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5840000000000006e-05 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803785+0000", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202282 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803968+0000", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018328800000000001 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.809395+0000", 2024-04-22T19:56:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054274340000000001 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815096+0000", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057001459999999997 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815180+0000", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4295999999999994e-05 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815241+0000", 2024-04-22T19:56:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1359999999999995e-05 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.481 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:30.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:30.483 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:30.481+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:30.583 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:30.581+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:30.654 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:30.654 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:30.668 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:30.711 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:30.709+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:30.784 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.784 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:30.784 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:30.784 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:30.785 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:30.785 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:30.781+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:30.799 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:30.887 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:30.885+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.527270089000002, 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.496368653000001, 2024-04-22T19:56:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.423993492000001, 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2240 3.21 3:86cda26a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.387564856000001, 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013495467000000001, 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2240 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581141+0000", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0350000000000002e-06 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582501+0000", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013595 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582522+0000", 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1687000000000001e-05 2024-04-22T19:56:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582537+0000", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4307e-05 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582637+0000", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100796 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582826+0000", 2024-04-22T19:56:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188989 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583023+0000", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019687200000000001 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.590870+0000", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078466939999999995 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594508+0000", 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036385879999999999 2024-04-22T19:56:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594575+0000", 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6137999999999996e-05 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594633+0000", 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8860999999999998e-05 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2262 3.37 3:ed8b2b14:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.168311868, 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015263897, 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2262 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800395+0000", 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8489999999999999e-06 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802740+0000", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023454230000000001 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802767+0000", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7129000000000001e-05 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802781+0000", 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.381e-05 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802877+0000", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5506000000000003e-05 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803053+0000", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000176718 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803214+0000", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016006500000000001 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812100+0000", 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088860469999999993 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815531+0000", 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034318669999999999 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815600+0000", 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8905000000000005e-05 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815655+0000", 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4577999999999998e-05 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2270 3.9 e75/20 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.08042747, 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014069467, 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888277+0000", 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8700000000000001e-06 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892702+0000", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044243420000000004 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892729+0000", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7525000000000002e-05 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892743+0000", 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.416e-05 2024-04-22T19:56:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892822+0000", 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8388999999999998e-05 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892848+0000", 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6441e-05 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902286+0000", 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094381510000000005 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902345+0000", 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8588999999999998e-05 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.029720898000001, 2024-04-22T19:56:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2295 3.3b e75/20 3:df7e9e21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_104:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.815877833999998, 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014042288, 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152835+0000", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7140000000000005e-06 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156743+0000", 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084840000000003 2024-04-22T19:56:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156770+0000", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6305999999999999e-05 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156782+0000", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2605e-05 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156857+0000", 2024-04-22T19:56:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5238e-05 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156877+0000", 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9468999999999999e-05 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166825+0000", 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099478899999999992 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166867+0000", 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2582e-05 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.592427820000001, 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.425893791, 2024-04-22T19:56:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2349 3.27 3:e69aba77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.252780036000001, 2024-04-22T19:56:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015070930999999999, 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2349 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715926+0000", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0429999999999999e-06 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718239+0000", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023127740000000001 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718267+0000", 2024-04-22T19:56:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718281+0000", 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3913e-05 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718367+0000", 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5824999999999999e-05 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718543+0000", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000175985 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718722+0000", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017876599999999999 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.727780+0000", 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090579719999999992 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730887+0000", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031073630000000001 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730930+0000", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3247000000000001e-05 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730994+0000", 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3406999999999998e-05 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2354 3.2e 3:75168009:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.203411289000002, 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013790066, 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2354 2024-04-22T19:56:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765294+0000", 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766753+0000", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014591389999999999 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766783+0000", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550999999999999e-05 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766793+0000", 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0665e-05 2024-04-22T19:56:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766866+0000", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2999999999999999e-05 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767002+0000", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135561 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767096+0000", 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3902999999999999e-05 2024-04-22T19:56:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.772586+0000", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054899889999999998 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.778995+0000", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064092730000000001 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779042+0000", 2024-04-22T19:56:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7017000000000001e-05 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779082+0000", 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9712000000000002e-05 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2355 3.9 e76/20 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.188118122999999, 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015165445, 2024-04-22T19:56:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780586+0000", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.17e-06 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785645+0000", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050587050000000001 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785676+0000", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1853999999999997e-05 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785692+0000", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785774+0000", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2193000000000004e-05 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785801+0000", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6655000000000001e-05 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795682+0000", 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098813749999999995 2024-04-22T19:56:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795750+0000", 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8011999999999999e-05 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.985788198000002, 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2388 3.9 e76/20 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.805002184999999, 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013233333999999999, 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163703+0000", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.768e-06 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168233+0000", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004529239 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168267+0000", 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4224999999999998e-05 2024-04-22T19:56:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168287+0000", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9973999999999999e-05 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168399+0000", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011219500000000001 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168439+0000", 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0244999999999998e-05 2024-04-22T19:56:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176738+0000", 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082984140000000005 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176934+0000", 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000196274 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.693261767999999, 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2398 3.2d e76/20 3:b78c8b50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_207:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.596602229999998, 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013856109, 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372103+0000", 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7810000000000001e-06 2024-04-22T19:56:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376334+0000", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004230368 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376375+0000", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1043e-05 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376394+0000", 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9386999999999999e-05 2024-04-22T19:56:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376542+0000", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014801300000000001 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376585+0000", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2469999999999998e-05 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385821+0000", 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092366589999999995 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385957+0000", 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013538800000000001 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.462851712999999, 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2419 3.3b e77/20 3:dd4443fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_228:head v 77'4, mlcod=75'2)", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.280820894000001, 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013731093, 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687884+0000", 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692213+0000", 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043292979999999997 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692245+0000", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2097000000000001e-05 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692261+0000", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5647000000000001e-05 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692350+0000", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9692999999999997e-05 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692380+0000", 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9977000000000001e-05 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701537+0000", 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091567990000000002 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701613+0000", 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6019999999999994e-05 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2426 3.2e 3:75868e42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.201836649000001, 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572174, 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2426 2024-04-22T19:56:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766869+0000", 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7920000000000001e-06 2024-04-22T19:56:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769331+0000", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024615650000000002 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769366+0000", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5466000000000002e-05 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769382+0000", 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960999999999998e-05 2024-04-22T19:56:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769474+0000", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1580000000000001e-05 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769641+0000", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016693200000000001 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769793+0000", 2024-04-22T19:56:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015276299999999999 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.777202+0000", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074088019999999999 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781296+0000", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040942360000000002 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781376+0000", 2024-04-22T19:56:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9552e-05 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781438+0000", 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2525000000000002e-05 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:31.072 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:31.074 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:31.074 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:31.069+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:31.161 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:31.207 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:31.205+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:31.246 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:31.246 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:31.247 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:31.247 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:31.262 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:31.275 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:31.273+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:31.303 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:31.303 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:31.320 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:31.320 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:31.337 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:31.354 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:31.354 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:31.375 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:31.373+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:31.376 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:31.376 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:31.397 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:31.397 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:31.417 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:31.417 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:31.420 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:31.420 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:31.434 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:31.438 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:31.438 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:31.476 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:31.473+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:31.563 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:31.563 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:31.577 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:31.573+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:31.577 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:31.628 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:56:31.678 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:31.677+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:31.708 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:31.708 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:31.722 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:31.778 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:31.773+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:31.879 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:31.877+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:31.893 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:31.893 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:31.908 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:31.979 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:31.977+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:32.074 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.074 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.080 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:32.077+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:32.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:32.181 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:32.181+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:32.252 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.252 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:32.282 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:32.277+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:32.383 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:32.381+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:32.432 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.432 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.446 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:32.484 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:32.481+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:32.584 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:32.581+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:32.609 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:56:32.617 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.617 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.631 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:32.685 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:32.685+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:32.754 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.754 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:32.810 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:32.809+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:32.887 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:32.885+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:32.934 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:32.934 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:32.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:32.993 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:32.993+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:33.075 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:33.075 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:33.089 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:33.085+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:33.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:33.189 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:33.189+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:33.256 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:33.256 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:33.265 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records in 2024-04-22T19:56:33.265 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records out 2024-04-22T19:56:33.265 INFO:tasks.workunit.client.0.smithi111.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 19.7931 s, 106 MB/s 2024-04-22T19:56:33.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:33.317 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:33.317+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:33.391 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:33.389+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:33.424 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_56_33 2024-04-22T19:56:33.447 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:33.447 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:33.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:33.462 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:33.503 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:33.501+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:33.592 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:33.589+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:33.605 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:33.605 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:33.624 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:33.625 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:33.625 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:33.625 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:33.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:33.646 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:33.646 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:33.664 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:33.664 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:33.684 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:33.685 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:33.693 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:33.689+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:33.704 INFO:tasks.workunit.client.0.smithi111.stdout:bucket quota max size set for the given user: buck_2024_03_22_19_56_33 2024-04-22T19:56:33.705 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:33.705 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:33.723 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:33.742 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:33.743 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:33.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:33.771 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:33.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:33.827 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:33.825+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:33.894 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:33.889+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:33.934 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:33.934 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:33.934 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:33.934 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:33.934 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:33.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:34.035 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:34.033+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:34.096 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:34.093+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:34.118 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:34.118 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:34.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:34.118 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:34.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2226 3.30 e75/20 3:0e41a5ab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_35:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.690092630999999, 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014642652000000001, 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427166+0000", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8649999999999999e-06 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431291+0000", 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041244200000000002 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431327+0000", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6878999999999997e-05 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431343+0000", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5316e-05 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431430+0000", 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6951000000000001e-05 2024-04-22T19:56:34.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431457+0000", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6869999999999999e-05 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441737+0000", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010280131 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441807+0000", 2024-04-22T19:56:34.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0220000000000002e-05 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2232 3.1 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.632862837000001, 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018281961999999999, 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.123 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2232 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484397+0000", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3249999999999999e-06 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486033+0000", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001635919 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486059+0000", 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5469e-05 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486072+0000", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2961e-05 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486150+0000", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8040000000000005e-05 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486274+0000", 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012424199999999999 2024-04-22T19:56:34.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486422+0000", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014772299999999999 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.492789+0000", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063669970000000001 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502547+0000", 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097584539999999997 2024-04-22T19:56:34.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502623+0000", 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5778999999999994e-05 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502676+0000", 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3053000000000002e-05 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2236 3.1f 3:f8d31c71:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.128 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.580164752000002, 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016339066999999999, 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2236 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:34.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537095+0000", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.117e-06 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538185+0000", 2024-04-22T19:56:34.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001089631 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538216+0000", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538230+0000", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4059999999999999e-05 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538316+0000", 2024-04-22T19:56:34.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5987000000000002e-05 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538475+0000", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158851 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538638+0000", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016274200000000001 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546237+0000", 2024-04-22T19:56:34.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075988269999999998 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553308+0000", 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070717230000000002 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553374+0000", 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5926999999999994e-05 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553431+0000", 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7030000000000001e-05 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.477225905000001, 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.134 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:56:34.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:56:34.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:56:34.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.139 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2261 3.39 e75/20 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.320574973999999, 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015355292, 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796684+0000", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0590000000000001e-06 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801376+0000", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046924169999999999 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801411+0000", 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4557999999999997e-05 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801426+0000", 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5003e-05 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801515+0000", 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9222999999999996e-05 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801539+0000", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4167000000000001e-05 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.811974+0000", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010434819999999999 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812037+0000", 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3045000000000004e-05 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2278 3.1b 3:d9d4b47f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.150141864999998, 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015375801999999999, 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2278 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967117+0000", 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-04-22T19:56:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968673+0000", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015559180000000001 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968701+0000", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7773999999999999e-05 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968713+0000", 2024-04-22T19:56:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2097e-05 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968773+0000", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9416000000000002e-05 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968878+0000", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105058 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968981+0000", 2024-04-22T19:56:34.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.974340+0000", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053588689999999996 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982384+0000", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080438660000000002 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982427+0000", 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-04-22T19:56:34.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982491+0000", 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3707000000000005e-05 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2280 3.1b 3:db01396f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.127701550000001, 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015968164999999999, 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2280 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989557+0000", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9700000000000002e-06 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990909+0000", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00135172 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990932+0000", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2648999999999999e-05 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990942+0000", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9599999999999995e-06 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991026+0000", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4308999999999995e-05 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991189+0000", 2024-04-22T19:56:34.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016345699999999999 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991341+0000", 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151626 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.997154+0000", 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005812696 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005402+0000", 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082480120000000007 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005470+0000", 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7866000000000004e-05 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005524+0000", 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3900000000000002e-05 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2285 3.20 e75/20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.070505009000001, 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018531975999999999, 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046753+0000", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4750000000000001e-06 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051077+0000", 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043240420000000002 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051099+0000", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1775000000000001e-05 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051109+0000", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3989999999999993e-06 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051183+0000", 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4388999999999995e-05 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051209+0000", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6364e-05 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065217+0000", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014007779999999999 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065284+0000", 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6752000000000001e-05 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2294 3.2b 3:d7f84201:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.981108848000002, 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015118481, 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2294 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136151+0000", 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7329999999999999e-06 2024-04-22T19:56:34.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138609+0000", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002458591 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138631+0000", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1654999999999998e-05 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138644+0000", 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3193999999999999e-05 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138713+0000", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8536999999999998e-05 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138873+0000", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015986599999999999 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.139001+0000", 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012877 2024-04-22T19:56:34.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.147109+0000", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081072379999999993 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151126+0000", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040168490000000003 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151208+0000", 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2696999999999998e-05 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151267+0000", 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8350999999999997e-05 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2334 3.39 e76/20 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head v 76'2, mlcod=0'0)", 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.547005995999999, 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017984908000000001, 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.164 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:34.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575079+0000", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048271210000000002 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575102+0000", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3176999999999998e-05 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575112+0000", 2024-04-22T19:56:34.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575191+0000", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9210999999999998e-05 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575220+0000", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258999999999999e-05 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588191+0000", 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012970534000000001 2024-04-22T19:56:34.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588236+0000", 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2336 3.1b 3:da298d83:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.531822641000002, 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015250207, 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.168 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2336 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:34.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585437+0000", 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9000000000000002e-06 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587056+0000", 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001618731 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587081+0000", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.55e-05 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587096+0000", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4842e-05 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587167+0000", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0573000000000003e-05 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587312+0000", 2024-04-22T19:56:34.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014513899999999999 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587415+0000", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010298699999999999 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.593331+0000", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059162049999999999 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600558+0000", 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072266539999999999 2024-04-22T19:56:34.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600629+0000", 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1328999999999994e-05 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600685+0000", 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5346999999999997e-05 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2348 3.1 3:8222c369:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.411362777000001, 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015550125999999999, 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2348 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705897+0000", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9170000000000002e-06 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707596+0000", 2024-04-22T19:56:34.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001699407 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707619+0000", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2058000000000001e-05 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707629+0000", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707699+0000", 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:34.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707819+0000", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120559 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707912+0000", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2405999999999996e-05 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.713992+0000", 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060801960000000004 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721352+0000", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073600139999999998 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721404+0000", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2298e-05 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721444+0000", 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9892999999999999e-05 2024-04-22T19:56:34.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2356 3.12 3:49f6adf5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.332062999000001, 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01483187, 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2356 2024-04-22T19:56:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785197+0000", 2024-04-22T19:56:34.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9840000000000001e-06 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787010+0000", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018132910000000001 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787037+0000", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6393e-05 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787055+0000", 2024-04-22T19:56:34.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8377e-05 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787135+0000", 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9966e-05 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787309+0000", 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017395799999999999 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:34.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787461+0000", 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151786 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799502+0000", 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01204146 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799903+0000", 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040125000000000002 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799973+0000", 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9954000000000001e-05 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.800026+0000", 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2451000000000003e-05 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2364 3.30 e76/20 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head v 76'5, mlcod=75'3)", 2024-04-22T19:56:34.184 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.238718607999999, 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014877286, 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878541+0000", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199999999999999e-06 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882594+0000", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040533210000000004 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882632+0000", 2024-04-22T19:56:34.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7889999999999998e-05 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882649+0000", 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7198999999999999e-05 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882726+0000", 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6824999999999997e-05 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882757+0000", 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0620999999999997e-05 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893346+0000", 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010588735 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893416+0000", 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0074999999999996e-05 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2368 3.1f 3:fa2c368a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.200797000000001, 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017814888000000001, 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2368 2024-04-22T19:56:34.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916462+0000", 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2299999999999998e-06 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918229+0000", 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001767088 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918246+0000", 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6466000000000001e-05 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918254+0000", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3950000000000001e-06 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918326+0000", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2191000000000001e-05 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918518+0000", 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019120899999999999 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918685+0000", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016718700000000001 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.925569+0000", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068842970000000002 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934151+0000", 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085817800000000007 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934214+0000", 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3602999999999994e-05 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934275+0000", 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0442000000000002e-05 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2371 3.2b 3:d7666e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.169234156999998, 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014548161, 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2371 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948026+0000", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2820000000000001e-06 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949594+0000", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001568411 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949619+0000", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4530999999999999e-05 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949629+0000", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079e-05 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949714+0000", 2024-04-22T19:56:34.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4704999999999996e-05 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949902+0000", 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018778800000000001 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.950071+0000", 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016991700000000001 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.955358+0000", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052866689999999999 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962475+0000", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071165120000000002 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962526+0000", 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0899000000000002e-05 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962571+0000", 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5368000000000003e-05 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2380 3.39 e76/20 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head v 76'4, mlcod=76'2)", 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.057769158999999, 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016934601000000001, 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.200 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059490+0000", 2024-04-22T19:56:34.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063273+0000", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037835519999999999 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063301+0000", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7693999999999999e-05 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063314+0000", 2024-04-22T19:56:34.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2584e-05 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063438+0000", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124599 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063491+0000", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2547999999999999e-05 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076357+0000", 2024-04-22T19:56:34.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012866481000000001 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076422+0000", 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5112999999999998e-05 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2384 3.17 3:eadd9673:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.012751416, 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016101606000000001, 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.204 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2384 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104509+0000", 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.54e-06 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108900+0000", 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043907529999999998 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108939+0000", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9116000000000003e-05 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108956+0000", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7337e-05 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109059+0000", 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102713 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109242+0000", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018301799999999999 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109410+0000", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168126 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.118325+0000", 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089148109999999999 2024-04-22T19:56:34.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120469+0000", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002144207 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120555+0000", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5434999999999998e-05 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120607+0000", 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2549999999999997e-05 2024-04-22T19:56:34.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2409 3.2b 3:d6021423:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.560345085000002, 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018020067000000001, 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2409 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556916+0000", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2459999999999997e-06 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559633+0000", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027169910000000002 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559659+0000", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5958000000000001e-05 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559674+0000", 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559794+0000", 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012010600000000001 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560001+0000", 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020678499999999999 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560185+0000", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018441200000000001 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.567773+0000", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075876750000000003 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574761+0000", 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069878800000000001 2024-04-22T19:56:34.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574857+0000", 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5891999999999996e-05 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574932+0000", 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5399000000000001e-05 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2428 3.2b 3:d690c0a1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:34.215 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.328278484999998, 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016031986000000002, 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2428 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:34.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788981+0000", 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8720000000000002e-06 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791238+0000", 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002256989 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791259+0000", 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1038000000000001e-05 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791272+0000", 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791355+0000", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3331000000000006e-05 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791540+0000", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018519200000000001 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791700+0000", 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015992799999999999 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.798641+0000", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069413629999999999 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804881+0000", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062399229999999997 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804952+0000", 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0640000000000001e-05 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.805010+0000", 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8458000000000002e-05 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.221 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:34.222 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:34.223 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:34.221+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:34.323 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:34.321+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:34.379 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:34.379 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:34.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:34.435 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:34.433+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:34.509 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:34.510 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:34.510 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:34.510 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:34.510 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:34.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:34.525 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:34.521+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:34.625 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:34.625+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:34.635 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 141.34536357100001, 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:56:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:56:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:56:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2234 3.1a e75/20 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.178121010000002, 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013529701999999999, 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514973+0000", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.68e-06 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519979+0000", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050056659999999998 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519995+0000", 2024-04-22T19:56:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6580999999999999e-05 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520005+0000", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8120000000000002e-06 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520085+0000", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0187999999999999e-05 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520109+0000", 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4048000000000001e-05 2024-04-22T19:56:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528439+0000", 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083296499999999992 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528501+0000", 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2076999999999995e-05 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2239 3.4 3:21f73a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.124482788000002, 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014804291000000001, 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2239 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568613+0000", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2949999999999998e-06 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570474+0000", 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018617060000000001 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570514+0000", 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9580999999999999e-05 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570530+0000", 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6175999999999999e-05 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570634+0000", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103566 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570762+0000", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012803399999999999 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570905+0000", 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143079 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582799+0000", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011894175 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583277+0000", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047821099999999998 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583353+0000", 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5809000000000006e-05 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583414+0000", 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0659000000000003e-05 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2253 3.25 3:a7350408:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.984963410999999, 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011503131, 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2253 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708132+0000", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9960000000000002e-06 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709597+0000", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014653159999999999 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709631+0000", 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4124000000000001e-05 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709647+0000", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5506999999999999e-05 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709736+0000", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9341999999999999e-05 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709889+0000", 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015342 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709984+0000", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4676e-05 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.718852+0000", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088682929999999993 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719498+0000", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064514499999999996 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719571+0000", 2024-04-22T19:56:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3642999999999999e-05 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719632+0000", 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0668999999999998e-05 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2256 3.31 3:8ce47cb8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.953409991000001, 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015270647, 2024-04-22T19:56:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2256 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739685+0000", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.948e-06 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740784+0000", 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001098489 2024-04-22T19:56:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740820+0000", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6658e-05 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740836+0000", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5807999999999998e-05 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740915+0000", 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8534000000000004e-05 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741039+0000", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012463200000000001 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741143+0000", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103453 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.746502+0000", 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005359351 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754828+0000", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083260509999999992 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754900+0000", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2203e-05 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754953+0000", 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2519999999999999e-05 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2265 3.0 3:0004f258:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.862225841000001, 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012197256, 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2265 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830869+0000", 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.734e-06 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832813+0000", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019440410000000001 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832846+0000", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2404999999999999e-05 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832862+0000", 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6507999999999998e-05 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832951+0000", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8634000000000006e-05 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833072+0000", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012147899999999999 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833175+0000", 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102589 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842438+0000", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092631840000000007 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842939+0000", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050115499999999998 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843006+0000", 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6886999999999998e-05 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843064+0000", 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7639999999999997e-05 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2266 3.1a e75/20 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.847111185999999, 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011766982, 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845983+0000", 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.850998+0000", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050147000000000004 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851028+0000", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9926000000000001e-05 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851044+0000", 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851131+0000", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6959000000000005e-05 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851157+0000", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5854e-05 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857673+0000", 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065160189999999996 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857748+0000", 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5436000000000001e-05 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2277 3.31 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.737418564999999, 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017512757, 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2277 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955677+0000", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.92e-06 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957378+0000", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001701316 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957391+0000", 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2952000000000001e-05 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957397+0000", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6229999999999999e-06 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957456+0000", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8468999999999999e-05 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957572+0000", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116082 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957677+0000", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105305 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.963176+0000", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054987320000000001 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973068+0000", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098916569999999999 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973135+0000", 2024-04-22T19:56:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6879999999999997e-05 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973186+0000", 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1820999999999997e-05 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2286 3.0 3:0027e6e6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.640713260999998, 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013313472, 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2286 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052382+0000", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1410000000000001e-06 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054416+0000", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020339830000000001 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054444+0000", 2024-04-22T19:56:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7580999999999999e-05 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054455+0000", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1195999999999999e-05 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054532+0000", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6978999999999996e-05 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054649+0000", 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117459 2024-04-22T19:56:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054760+0000", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111061 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.064840+0000", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010079612999999999 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065571+0000", 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073068600000000003 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065636+0000", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5467000000000002e-05 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065692+0000", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6305999999999999e-05 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2289 3.4 3:232cb087:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.608587995000001, 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017538444, 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2289 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084506+0000", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086111+0000", 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016043330000000001 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086142+0000", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411000000000001e-05 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086156+0000", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086231+0000", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4982999999999997e-05 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086388+0000", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156396 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086574+0000", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186305 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.098446+0000", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011871457 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101948+0000", 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035023419999999999 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101995+0000", 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6947999999999998e-05 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.102043+0000", 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7734000000000001e-05 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2306 3.3e 3:7d26d192:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.429015389, 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012849724999999999, 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2306 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264081+0000", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7589999999999999e-06 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265830+0000", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017491500000000001 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265868+0000", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8056000000000003e-05 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265881+0000", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3529999999999999e-05 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265980+0000", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8876999999999995e-05 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266173+0000", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019305400000000001 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266357+0000", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018393899999999999 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276434+0000", 2024-04-22T19:56:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077254000000001 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276822+0000", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000387239 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276879+0000", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7501999999999999e-05 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276927+0000", 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7364999999999998e-05 2024-04-22T19:56:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2310 3.3e 3:7edfea0a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.391506946, 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012685073, 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2310 2024-04-22T19:56:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301588+0000", 2024-04-22T19:56:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2550000000000002e-06 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303338+0000", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017496440000000001 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303364+0000", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5677000000000002e-05 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303373+0000", 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6639999999999993e-06 2024-04-22T19:56:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303445+0000", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1292999999999997e-05 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303578+0000", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013347700000000001 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303709+0000", 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013108099999999999 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.313555+0000", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098454960000000005 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314136+0000", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058124700000000001 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314203+0000", 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6910999999999997e-05 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314270+0000", 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7328000000000003e-05 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2314 3.25 3:a7b71818:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.347604649000001, 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012726375999999999, 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2314 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345490+0000", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347233+0000", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001743164 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347253+0000", 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452e-05 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347264+0000", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0385e-05 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347332+0000", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8471000000000002e-05 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347458+0000", 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012541599999999999 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347588+0000", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012997799999999999 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.357622+0000", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010034022 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358127+0000", 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050533299999999995 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358164+0000", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6866999999999998e-05 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358214+0000", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9988000000000003e-05 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2329 3.19 3:9858478a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.180977259999999, 2024-04-22T19:56:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015534793, 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2329 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512118+0000", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6350000000000002e-06 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514585+0000", 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002467155 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514602+0000", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7456999999999999e-05 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514614+0000", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1528e-05 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515433+0000", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081949699999999998 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515562+0000", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012903200000000001 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515684+0000", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121968 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.522007+0000", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063230220000000002 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527545+0000", 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055375670000000002 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527601+0000", 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6489000000000001e-05 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527650+0000", 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442999999999997e-05 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2335 3.25 3:a6bbb67a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.119708196000001, 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015472677000000001, 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2335 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573386+0000", 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3300000000000001e-06 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575798+0000", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024118770000000002 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575820+0000", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1345999999999999e-05 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575830+0000", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0436e-05 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575899+0000", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9175000000000001e-05 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576003+0000", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576094+0000", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1188999999999997e-05 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588377+0000", 2024-04-22T19:56:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012282944000000001 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588726+0000", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034938100000000001 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588804+0000", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7871e-05 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588857+0000", 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2598e-05 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2344 3.4 3:20840935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.027731502000002, 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012283522, 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2344 2024-04-22T19:56:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665363+0000", 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.542e-06 2024-04-22T19:56:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667312+0000", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019485100000000001 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667328+0000", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6623999999999999e-05 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667336+0000", 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4279999999999999e-06 2024-04-22T19:56:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667400+0000", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3893999999999995e-05 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667553+0000", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015292300000000001 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667655+0000", 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102216 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677250+0000", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095952180000000008 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677509+0000", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025870899999999998 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677575+0000", 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6026999999999997e-05 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677644+0000", 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9431000000000007e-05 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2381 3.31 3:8d21d2bd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.629059559000002, 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017338782, 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2381 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064036+0000", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9110000000000002e-06 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066529+0000", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002493777 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066556+0000", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7144999999999998e-05 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066574+0000", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7107000000000001e-05 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066641+0000", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7895e-05 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066753+0000", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011113299999999999 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066847+0000", 2024-04-22T19:56:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4347999999999999e-05 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076112+0000", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092649340000000007 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081183+0000", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050710979999999996 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081273+0000", 2024-04-22T19:56:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9538999999999998e-05 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081371+0000", 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8894999999999994e-05 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2386 3.31 3:8f12d370:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.559143002999999, 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017342527999999999, 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2386 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133953+0000", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4240000000000002e-06 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136131+0000", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002178195 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136182+0000", 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1221999999999998e-05 2024-04-22T19:56:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136208+0000", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.58e-05 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136323+0000", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011534700000000001 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136557+0000", 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000233694 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136732+0000", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017486800000000001 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.143708+0000", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069766339999999998 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151107+0000", 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073982800000000001 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151217+0000", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109962 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151292+0000", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5102e-05 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2424 3.19 3:99e73f45:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.947596688000001, 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016703743, 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2424 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745500+0000", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.566e-06 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748132+0000", 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026317929999999999 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748167+0000", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4913000000000003e-05 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748181+0000", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4208e-05 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748274+0000", 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2824000000000004e-05 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748457+0000", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182936 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748647+0000", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190037 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.761985+0000", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013338077 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762008+0000", 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2853e-05 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762089+0000", 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0996999999999997e-05 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762199+0000", 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011053900000000001 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2429 3.19 3:99ec54ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.891560442999999, 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013709542999999999, 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2429 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801535+0000", 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5769999999999998e-06 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803462+0000", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019265759999999999 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803495+0000", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2932999999999998e-05 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803507+0000", 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1810999999999999e-05 2024-04-22T19:56:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803582+0000", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5840000000000006e-05 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803785+0000", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202282 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803968+0000", 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018328800000000001 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.809395+0000", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054274340000000001 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815096+0000", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057001459999999997 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815180+0000", 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4295999999999994e-05 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815241+0000", 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1359999999999995e-05 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:34.796 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:34.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:34.798 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:34.793+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:34.898 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:34.897+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:34.962 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:34.962 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:34.962 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:34.963 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:34.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:35.019 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:35.017+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:35.085 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:35.085 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:35.086 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:35.086 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:35.086 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:35.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:35.099 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:35.097+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:35.200 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:35.197+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.828486977000001, 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.273 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:35.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.797585541, 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:35.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:35.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:35.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:35.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.72521038, 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:35.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2240 3.21 3:86cda26a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.688781744, 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013495467000000001, 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2240 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581141+0000", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0350000000000002e-06 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582501+0000", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013595 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582522+0000", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1687000000000001e-05 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582537+0000", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4307e-05 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582637+0000", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100796 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582826+0000", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188989 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583023+0000", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019687200000000001 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.590870+0000", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078466939999999995 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594508+0000", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036385879999999999 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594575+0000", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6137999999999996e-05 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594633+0000", 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8860999999999998e-05 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2262 3.37 3:ed8b2b14:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.469528755999999, 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015263897, 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2262 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800395+0000", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8489999999999999e-06 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802740+0000", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023454230000000001 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802767+0000", 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7129000000000001e-05 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802781+0000", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.381e-05 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802877+0000", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5506000000000003e-05 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803053+0000", 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000176718 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803214+0000", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016006500000000001 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812100+0000", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088860469999999993 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815531+0000", 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034318669999999999 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815600+0000", 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8905000000000005e-05 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815655+0000", 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4577999999999998e-05 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2270 3.9 e75/20 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.381644357999999, 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014069467, 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888277+0000", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8700000000000001e-06 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892702+0000", 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044243420000000004 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892729+0000", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7525000000000002e-05 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892743+0000", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.416e-05 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892822+0000", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8388999999999998e-05 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892848+0000", 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6441e-05 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902286+0000", 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094381510000000005 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902345+0000", 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8588999999999998e-05 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.330937786, 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2295 3.3b e75/20 3:df7e9e21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_104:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.117094722000001, 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014042288, 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152835+0000", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7140000000000005e-06 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156743+0000", 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084840000000003 2024-04-22T19:56:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156770+0000", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6305999999999999e-05 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156782+0000", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2605e-05 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156857+0000", 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5238e-05 2024-04-22T19:56:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156877+0000", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9468999999999999e-05 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166825+0000", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099478899999999992 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166867+0000", 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2582e-05 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.893644708, 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.727110678999999, 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2349 3.27 3:e69aba77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.553996924, 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015070930999999999, 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2349 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715926+0000", 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0429999999999999e-06 2024-04-22T19:56:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718239+0000", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023127740000000001 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718267+0000", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718281+0000", 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3913e-05 2024-04-22T19:56:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718367+0000", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5824999999999999e-05 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718543+0000", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000175985 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718722+0000", 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017876599999999999 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.727780+0000", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090579719999999992 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730887+0000", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031073630000000001 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730930+0000", 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3247000000000001e-05 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730994+0000", 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3406999999999998e-05 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2354 3.2e 3:75168009:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.504628177000001, 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013790066, 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2354 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765294+0000", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766753+0000", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014591389999999999 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766783+0000", 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550999999999999e-05 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766793+0000", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0665e-05 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766866+0000", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2999999999999999e-05 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767002+0000", 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135561 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767096+0000", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3902999999999999e-05 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.772586+0000", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054899889999999998 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.778995+0000", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064092730000000001 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779042+0000", 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7017000000000001e-05 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779082+0000", 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9712000000000002e-05 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2355 3.9 e76/20 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.489335011000001, 2024-04-22T19:56:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015165445, 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780586+0000", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.17e-06 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785645+0000", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050587050000000001 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785676+0000", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1853999999999997e-05 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785692+0000", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785774+0000", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2193000000000004e-05 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785801+0000", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6655000000000001e-05 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795682+0000", 2024-04-22T19:56:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098813749999999995 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795750+0000", 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8011999999999999e-05 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287005086000001, 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2388 3.9 e76/20 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.106219072999998, 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013233333999999999, 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163703+0000", 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.768e-06 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168233+0000", 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004529239 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168267+0000", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4224999999999998e-05 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168287+0000", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9973999999999999e-05 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168399+0000", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011219500000000001 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168439+0000", 2024-04-22T19:56:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0244999999999998e-05 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176738+0000", 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082984140000000005 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176934+0000", 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000196274 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.994478655999998, 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2398 3.2d e76/20 3:b78c8b50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_207:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.897819118000001, 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013856109, 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372103+0000", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7810000000000001e-06 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376334+0000", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004230368 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376375+0000", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1043e-05 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376394+0000", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9386999999999999e-05 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376542+0000", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014801300000000001 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376585+0000", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2469999999999998e-05 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385821+0000", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092366589999999995 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385957+0000", 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013538800000000001 2024-04-22T19:56:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.764068600999998, 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2419 3.3b e77/20 3:dd4443fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_228:head v 77'4, mlcod=75'2)", 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.582037782, 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013731093, 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687884+0000", 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692213+0000", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043292979999999997 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692245+0000", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2097000000000001e-05 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692261+0000", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5647000000000001e-05 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692350+0000", 2024-04-22T19:56:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9692999999999997e-05 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692380+0000", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9977000000000001e-05 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701537+0000", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091567990000000002 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701613+0000", 2024-04-22T19:56:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6019999999999994e-05 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2426 3.2e 3:75868e42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.503053537, 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572174, 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2426 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766869+0000", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7920000000000001e-06 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769331+0000", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024615650000000002 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769366+0000", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5466000000000002e-05 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769382+0000", 2024-04-22T19:56:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960999999999998e-05 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769474+0000", 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1580000000000001e-05 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769641+0000", 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016693200000000001 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769793+0000", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015276299999999999 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.777202+0000", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074088019999999999 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781296+0000", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040942360000000002 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781376+0000", 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9552e-05 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781438+0000", 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2525000000000002e-05 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.372 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:35.373 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:35.374 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:35.369+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:35.474 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:35.473+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:35.534 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:35.534 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:35.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:35.574 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:35.573+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:56:35.667 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:35.667 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:35.667 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:35.667 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:35.667 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:35.676 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:35.673+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:35.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:35.760 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:35.776 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:35.773+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:35.838 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.311589175999998, 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.175790797000001, 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.844 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:35.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:35.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:35.849 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.973073019000001, 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:35.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:35.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.854 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.711757115000001, 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:35.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.652610871, 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:35.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.553251989, 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:35.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:35.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:35.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.409408322000001, 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.874 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.360567070999998, 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:35.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:35.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:35.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:35.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.302833604, 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.880 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.211191696, 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:35.885 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.890 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.813285175000001, 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:35.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.762592927, 2024-04-22T19:56:35.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.493021170999999, 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:35.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:35.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:35.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:35.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:35.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.409383417000001, 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:35.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:35.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:35.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.372841349000002, 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:35.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:35.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.30780322, 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.918 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:35.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.290067215000001, 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.123235501, 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:35.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:35.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:35.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.118038251000002, 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.933 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:35.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:35.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:35.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:35.938 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.07979074, 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:35.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:35.943 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:35.944 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:35.945 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:35.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:35.945 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:35.946 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:35.946 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:35.946 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:35.941+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:35.946 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:35.947 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:35.963 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:35.963 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:35.982 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:35.982 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:35.999 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:35.999 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:36.017 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:36.017 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:36.036 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:36.036 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:36.045 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:36.041+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:36.085 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.085 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.100 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:36.145 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:36.145+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:36.217 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.217 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:36.274 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:36.273+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:36.347 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:36.345+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:36.400 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.400 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.414 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:36.457 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:36.457+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:36.537 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.537 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.548 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:36.545+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:36.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:36.649 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:36.645+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:36.712 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.712 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:36.769 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:36.769+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:36.847 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:36.847 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:36.851 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:36.845+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:36.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:36.951 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:36.949+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:37.026 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.026 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:37.082 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:37.081+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:37.153 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:37.153+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:37.198 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.198 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.212 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:37.254 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:37.253+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:37.355 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:37.349+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:37.381 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.381 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.396 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:37.456 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:37.453+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:37.519 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.519 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:37.577 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:37.577+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:37.657 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:37.657+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:37.663 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:56:37.700 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.700 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:quota enabled for the bucket: buck_2024_03_22_19_56_33 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 2Gb. 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:37.720 INFO:tasks.workunit.client.0.smithi111.stdout:delete objects successful 2024-04-22T19:56:37.757 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:37.753+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:37.859 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:37.853+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:37.877 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:37.877 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:37.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:37.959 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:37.957+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:38.015 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:38.015 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:38.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:38.052 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:38.080 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:38.077+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:38.161 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:38.157+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:38.196 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:38.196 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:38.213 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:38.217 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:38.217 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:38.235 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:38.252 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:38.252 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:38.262 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:38.257+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:38.269 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:38.269 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:38.290 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:38.290 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:38.311 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:38.311 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2226 3.30 e75/20 3:0e41a5ab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_35:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.903035118999998, 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014642652000000001, 2024-04-22T19:56:38.331 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427164+0000", 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.427166+0000", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8649999999999999e-06 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431291+0000", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041244200000000002 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431327+0000", 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6878999999999997e-05 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431343+0000", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5316e-05 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431430+0000", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6951000000000001e-05 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.431457+0000", 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6869999999999999e-05 2024-04-22T19:56:38.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441737+0000", 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010280131 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441807+0000", 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0220000000000002e-05 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.335 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2232 3.1 3:80cd0128:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.845805325000001, 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018281961999999999, 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2232 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484394+0000", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.484397+0000", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3249999999999999e-06 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486033+0000", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001635919 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486059+0000", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5469e-05 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486072+0000", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2961e-05 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486150+0000", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8040000000000005e-05 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486274+0000", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012424199999999999 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.486422+0000", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014772299999999999 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.492789+0000", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063669970000000001 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502547+0000", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097584539999999997 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502623+0000", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5778999999999994e-05 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.502676+0000", 2024-04-22T19:56:38.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3053000000000002e-05 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2236 3.1f 3:f8d31c71:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.793107240000001, 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016339066999999999, 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.341 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2236 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537092+0000", 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.537095+0000", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.117e-06 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538185+0000", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001089631 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538216+0000", 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538230+0000", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4059999999999999e-05 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538316+0000", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5987000000000002e-05 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538475+0000", 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158851 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.538638+0000", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016274200000000001 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546237+0000", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075988269999999998 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553308+0000", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070717230000000002 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553374+0000", 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5926999999999994e-05 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.553431+0000", 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7030000000000001e-05 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.690168393, 2024-04-22T19:56:38.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2261 3.39 e75/20 3:9c850b90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_70:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.533517461999999, 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015355292, 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:38.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796682+0000", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.796684+0000", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0590000000000001e-06 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801376+0000", 2024-04-22T19:56:38.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046924169999999999 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801411+0000", 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4557999999999997e-05 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801426+0000", 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5003e-05 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801515+0000", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9222999999999996e-05 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.801539+0000", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4167000000000001e-05 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.811974+0000", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010434819999999999 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812037+0000", 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3045000000000004e-05 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2278 3.1b 3:d9d4b47f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.363084353000001, 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015375801999999999, 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2278 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967115+0000", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.967117+0000", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968673+0000", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015559180000000001 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968701+0000", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7773999999999999e-05 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968713+0000", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2097e-05 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968773+0000", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9416000000000002e-05 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968878+0000", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105058 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.968981+0000", 2024-04-22T19:56:38.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.974340+0000", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053588689999999996 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982384+0000", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080438660000000002 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982427+0000", 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-04-22T19:56:38.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.982491+0000", 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3707000000000005e-05 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2280 3.1b 3:db01396f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.340644038000001, 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015968164999999999, 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.361 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2280 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989555+0000", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.989557+0000", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9700000000000002e-06 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990909+0000", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00135172 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990932+0000", 2024-04-22T19:56:38.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2648999999999999e-05 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.990942+0000", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9599999999999995e-06 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991026+0000", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4308999999999995e-05 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991189+0000", 2024-04-22T19:56:38.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016345699999999999 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.991341+0000", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151626 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.997154+0000", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005812696 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005402+0000", 2024-04-22T19:56:38.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082480120000000007 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005470+0000", 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7866000000000004e-05 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.005524+0000", 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3900000000000002e-05 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.366 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2285 3.20 e75/20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.283447497000001, 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018531975999999999, 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046752+0000", 2024-04-22T19:56:38.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.046753+0000", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4750000000000001e-06 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051077+0000", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043240420000000002 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051099+0000", 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1775000000000001e-05 2024-04-22T19:56:38.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051109+0000", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3989999999999993e-06 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051183+0000", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4388999999999995e-05 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.051209+0000", 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6364e-05 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065217+0000", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014007779999999999 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065284+0000", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6752000000000001e-05 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2294 3.2b 3:d7f84201:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:38.370 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.194051336000001, 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015118481, 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2294 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136148+0000", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.136151+0000", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7329999999999999e-06 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138609+0000", 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002458591 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138631+0000", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1654999999999998e-05 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138644+0000", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3193999999999999e-05 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138713+0000", 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8536999999999998e-05 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.138873+0000", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015986599999999999 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.139001+0000", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012877 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.147109+0000", 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081072379999999993 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151126+0000", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040168490000000003 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151208+0000", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2696999999999998e-05 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.151267+0000", 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8350999999999997e-05 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2334 3.39 e76/20 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head v 76'2, mlcod=0'0)", 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.759948483999999, 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017984908000000001, 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.570251+0000", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575079+0000", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048271210000000002 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575102+0000", 2024-04-22T19:56:38.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3176999999999998e-05 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575112+0000", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575191+0000", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9210999999999998e-05 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575220+0000", 2024-04-22T19:56:38.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258999999999999e-05 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588191+0000", 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012970534000000001 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588236+0000", 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2336 3.1b 3:da298d83:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.744765129000001, 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015250207, 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2336 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:38.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585434+0000", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.585437+0000", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9000000000000002e-06 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587056+0000", 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001618731 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587081+0000", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.55e-05 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587096+0000", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4842e-05 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587167+0000", 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0573000000000003e-05 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587312+0000", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014513899999999999 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.587415+0000", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010298699999999999 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.593331+0000", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059162049999999999 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600558+0000", 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072266539999999999 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600629+0000", 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1328999999999994e-05 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.600685+0000", 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5346999999999997e-05 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2348 3.1 3:8222c369:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.624305265, 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015550125999999999, 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2348 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705894+0000", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.705897+0000", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9170000000000002e-06 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707596+0000", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001699407 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707619+0000", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2058000000000001e-05 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707629+0000", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707699+0000", 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:38.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707819+0000", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120559 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.707912+0000", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2405999999999996e-05 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.713992+0000", 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060801960000000004 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721352+0000", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073600139999999998 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721404+0000", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2298e-05 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.721444+0000", 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9892999999999999e-05 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2356 3.12 3:49f6adf5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.545005487000001, 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01483187, 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2356 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.390 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785194+0000", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785197+0000", 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9840000000000001e-06 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787010+0000", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018132910000000001 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787037+0000", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6393e-05 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787055+0000", 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8377e-05 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787135+0000", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9966e-05 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787309+0000", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017395799999999999 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.787461+0000", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000151786 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799502+0000", 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01204146 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799903+0000", 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040125000000000002 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.799973+0000", 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9954000000000001e-05 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.800026+0000", 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2451000000000003e-05 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2364 3.30 e76/20 3:0c896c4c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_173:head v 76'5, mlcod=75'3)", 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.451661095999999, 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014877286, 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878538+0000", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.878541+0000", 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199999999999999e-06 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882594+0000", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040533210000000004 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882632+0000", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7889999999999998e-05 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882649+0000", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7198999999999999e-05 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882726+0000", 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6824999999999997e-05 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.882757+0000", 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0620999999999997e-05 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893346+0000", 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010588735 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.893416+0000", 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0074999999999996e-05 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2368 3.1f 3:fa2c368a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.413739488000001, 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017814888000000001, 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2368 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916460+0000", 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.916462+0000", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2299999999999998e-06 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918229+0000", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001767088 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918246+0000", 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6466000000000001e-05 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918254+0000", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3950000000000001e-06 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918326+0000", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2191000000000001e-05 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918518+0000", 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019120899999999999 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.918685+0000", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016718700000000001 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.925569+0000", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068842970000000002 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934151+0000", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085817800000000007 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934214+0000", 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3602999999999994e-05 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.934275+0000", 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0442000000000002e-05 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2371 3.2b 3:d7666e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.382176645000001, 2024-04-22T19:56:38.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014548161, 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2371 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948023+0000", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.948026+0000", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2820000000000001e-06 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949594+0000", 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001568411 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949619+0000", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4530999999999999e-05 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949629+0000", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0079e-05 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949714+0000", 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4704999999999996e-05 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.949902+0000", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018778800000000001 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.950071+0000", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016991700000000001 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.955358+0000", 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052866689999999999 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962475+0000", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071165120000000002 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962526+0000", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0899000000000002e-05 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.962571+0000", 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5368000000000003e-05 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2380 3.39 e76/20 3:9d387e7e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_189:head v 76'4, mlcod=76'2)", 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.270711646999999, 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016934601000000001, 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059488+0000", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.059490+0000", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063273+0000", 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037835519999999999 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063301+0000", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7693999999999999e-05 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063314+0000", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2584e-05 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063438+0000", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124599 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.063491+0000", 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2547999999999999e-05 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076357+0000", 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012866481000000001 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076422+0000", 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5112999999999998e-05 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2384 3.17 3:eadd9673:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.225693904, 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016101606000000001, 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2384 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104506+0000", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.104509+0000", 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.54e-06 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108900+0000", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043907529999999998 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108939+0000", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9116000000000003e-05 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.108956+0000", 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7337e-05 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109059+0000", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102713 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109242+0000", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018301799999999999 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.109410+0000", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168126 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.118325+0000", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089148109999999999 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120469+0000", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002144207 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120555+0000", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5434999999999998e-05 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.120607+0000", 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2549999999999997e-05 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2409 3.2b 3:d6021423:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.773287573000001, 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018020067000000001, 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2409 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556912+0000", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.556916+0000", 2024-04-22T19:56:38.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2459999999999997e-06 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559633+0000", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027169910000000002 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559659+0000", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5958000000000001e-05 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559674+0000", 2024-04-22T19:56:38.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4722999999999999e-05 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.559794+0000", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012010600000000001 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560001+0000", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020678499999999999 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.560185+0000", 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018441200000000001 2024-04-22T19:56:38.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.567773+0000", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075876750000000003 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574761+0000", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069878800000000001 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574857+0000", 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5891999999999996e-05 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.574932+0000", 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5399000000000001e-05 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2428 3.2b 3:d690c0a1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.541220973000001, 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016031986000000002, 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.424 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2428 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788978+0000", 2024-04-22T19:56:38.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.788981+0000", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8720000000000002e-06 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791238+0000", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002256989 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791259+0000", 2024-04-22T19:56:38.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1038000000000001e-05 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791272+0000", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791355+0000", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3331000000000006e-05 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791540+0000", 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018519200000000001 2024-04-22T19:56:38.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.791700+0000", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015992799999999999 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.798641+0000", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069413629999999999 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804881+0000", 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062399229999999997 2024-04-22T19:56:38.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.804952+0000", 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0640000000000001e-05 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.805010+0000", 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8458000000000002e-05 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.429 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:38.430 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:38.430 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:38.431 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:38.431 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:38.432 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:38.432 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:38.429+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:38.532 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:38.529+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:38.585 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:38.585 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:38.585 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:38.585 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:38.597 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:38.633 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:56:38.633 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:38.629+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:38.713 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:38.713 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:38.713 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:38.713 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:38.713 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:38.726 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:38.733 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:38.733+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:38.834 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:38.833+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 145.49319476599999, 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:56:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:56:38.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2234 3.1a e75/20 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.325952205, 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013529701999999999, 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514973+0000", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.68e-06 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519979+0000", 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050056659999999998 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519995+0000", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6580999999999999e-05 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520005+0000", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8120000000000002e-06 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520085+0000", 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0187999999999999e-05 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520109+0000", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4048000000000001e-05 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528439+0000", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083296499999999992 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528501+0000", 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2076999999999995e-05 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2239 3.4 3:21f73a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.272313983, 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014804291000000001, 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2239 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.851 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568613+0000", 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2949999999999998e-06 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570474+0000", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018617060000000001 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570514+0000", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9580999999999999e-05 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570530+0000", 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6175999999999999e-05 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570634+0000", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103566 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570762+0000", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012803399999999999 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570905+0000", 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143079 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582799+0000", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011894175 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583277+0000", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047821099999999998 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583353+0000", 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5809000000000006e-05 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583414+0000", 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0659000000000003e-05 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2253 3.25 3:a7350408:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.132794606000001, 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011503131, 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.856 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2253 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708132+0000", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9960000000000002e-06 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709597+0000", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014653159999999999 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709631+0000", 2024-04-22T19:56:38.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4124000000000001e-05 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709647+0000", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5506999999999999e-05 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709736+0000", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9341999999999999e-05 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709889+0000", 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015342 2024-04-22T19:56:38.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709984+0000", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4676e-05 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.718852+0000", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088682929999999993 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719498+0000", 2024-04-22T19:56:38.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064514499999999996 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719571+0000", 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3642999999999999e-05 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719632+0000", 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0668999999999998e-05 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.861 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2256 3.31 3:8ce47cb8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.101241185999999, 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015270647, 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2256 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739685+0000", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.948e-06 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740784+0000", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001098489 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740820+0000", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6658e-05 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740836+0000", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5807999999999998e-05 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740915+0000", 2024-04-22T19:56:38.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8534000000000004e-05 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741039+0000", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012463200000000001 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741143+0000", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103453 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.746502+0000", 2024-04-22T19:56:38.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005359351 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754828+0000", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083260509999999992 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754900+0000", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2203e-05 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754953+0000", 2024-04-22T19:56:38.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2519999999999999e-05 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2265 3.0 3:0004f258:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.010057035999999, 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012197256, 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2265 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830869+0000", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.734e-06 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832813+0000", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019440410000000001 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832846+0000", 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2404999999999999e-05 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832862+0000", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6507999999999998e-05 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832951+0000", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8634000000000006e-05 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833072+0000", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012147899999999999 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:38.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833175+0000", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102589 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842438+0000", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092631840000000007 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842939+0000", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050115499999999998 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843006+0000", 2024-04-22T19:56:38.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6886999999999998e-05 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843064+0000", 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7639999999999997e-05 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2266 3.1a e75/20 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.994942381000001, 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011766982, 2024-04-22T19:56:38.872 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845983+0000", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.850998+0000", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050147000000000004 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851028+0000", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9926000000000001e-05 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851044+0000", 2024-04-22T19:56:38.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851131+0000", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6959000000000005e-05 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851157+0000", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5854e-05 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857673+0000", 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065160189999999996 2024-04-22T19:56:38.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857748+0000", 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5436000000000001e-05 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2277 3.31 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.885249760000001, 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017512757, 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.876 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2277 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955677+0000", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.92e-06 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957378+0000", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001701316 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957391+0000", 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2952000000000001e-05 2024-04-22T19:56:38.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957397+0000", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6229999999999999e-06 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957456+0000", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8468999999999999e-05 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957572+0000", 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116082 2024-04-22T19:56:38.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957677+0000", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105305 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.963176+0000", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054987320000000001 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973068+0000", 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098916569999999999 2024-04-22T19:56:38.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973135+0000", 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6879999999999997e-05 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973186+0000", 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1820999999999997e-05 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2286 3.0 3:0027e6e6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.788544456, 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013313472, 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2286 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:38.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052382+0000", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1410000000000001e-06 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054416+0000", 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020339830000000001 2024-04-22T19:56:38.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054444+0000", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7580999999999999e-05 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054455+0000", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1195999999999999e-05 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054532+0000", 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6978999999999996e-05 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054649+0000", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117459 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054760+0000", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111061 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.064840+0000", 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010079612999999999 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065571+0000", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073068600000000003 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065636+0000", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5467000000000002e-05 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065692+0000", 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6305999999999999e-05 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2289 3.4 3:232cb087:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.756419189999999, 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017538444, 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2289 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.887 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084506+0000", 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086111+0000", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016043330000000001 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086142+0000", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411000000000001e-05 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086156+0000", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086231+0000", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4982999999999997e-05 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086388+0000", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156396 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086574+0000", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186305 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.098446+0000", 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011871457 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101948+0000", 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035023419999999999 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101995+0000", 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6947999999999998e-05 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.102043+0000", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7734000000000001e-05 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2306 3.3e 3:7d26d192:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.576846583999998, 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012849724999999999, 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.892 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2306 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264081+0000", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7589999999999999e-06 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265830+0000", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017491500000000001 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265868+0000", 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8056000000000003e-05 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265881+0000", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3529999999999999e-05 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265980+0000", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8876999999999995e-05 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266173+0000", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019305400000000001 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:38.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266357+0000", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018393899999999999 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276434+0000", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077254000000001 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276822+0000", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000387239 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276879+0000", 2024-04-22T19:56:38.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7501999999999999e-05 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276927+0000", 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7364999999999998e-05 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2310 3.3e 3:7edfea0a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.539338141000002, 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012685073, 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.897 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2310 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301588+0000", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2550000000000002e-06 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303338+0000", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017496440000000001 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303364+0000", 2024-04-22T19:56:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5677000000000002e-05 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303373+0000", 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6639999999999993e-06 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303445+0000", 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1292999999999997e-05 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303578+0000", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013347700000000001 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303709+0000", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013108099999999999 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.313555+0000", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098454960000000005 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314136+0000", 2024-04-22T19:56:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058124700000000001 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314203+0000", 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6910999999999997e-05 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314270+0000", 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7328000000000003e-05 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2314 3.25 3:a7b71818:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.495435843999999, 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012726375999999999, 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2314 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345490+0000", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347233+0000", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001743164 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347253+0000", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452e-05 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347264+0000", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0385e-05 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347332+0000", 2024-04-22T19:56:38.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8471000000000002e-05 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347458+0000", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012541599999999999 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347588+0000", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012997799999999999 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.357622+0000", 2024-04-22T19:56:38.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010034022 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358127+0000", 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050533299999999995 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358164+0000", 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6866999999999998e-05 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358214+0000", 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9988000000000003e-05 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2329 3.19 3:9858478a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.328808455000001, 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015534793, 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2329 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512118+0000", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6350000000000002e-06 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514585+0000", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002467155 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514602+0000", 2024-04-22T19:56:38.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7456999999999999e-05 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514614+0000", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1528e-05 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515433+0000", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081949699999999998 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515562+0000", 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012903200000000001 2024-04-22T19:56:38.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515684+0000", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121968 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.522007+0000", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063230220000000002 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527545+0000", 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055375670000000002 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527601+0000", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6489000000000001e-05 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527650+0000", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442999999999997e-05 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2335 3.25 3:a6bbb67a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:38.913 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.267539391, 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015472677000000001, 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2335 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:38.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573386+0000", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3300000000000001e-06 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575798+0000", 2024-04-22T19:56:38.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024118770000000002 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575820+0000", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1345999999999999e-05 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575830+0000", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0436e-05 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575899+0000", 2024-04-22T19:56:38.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9175000000000001e-05 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576003+0000", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576094+0000", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1188999999999997e-05 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588377+0000", 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012282944000000001 2024-04-22T19:56:38.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588726+0000", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034938100000000001 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588804+0000", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7871e-05 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588857+0000", 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2598e-05 2024-04-22T19:56:38.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2344 3.4 3:20840935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.175562697, 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012283522, 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2344 2024-04-22T19:56:38.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665363+0000", 2024-04-22T19:56:38.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.542e-06 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667312+0000", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019485100000000001 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667328+0000", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6623999999999999e-05 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667336+0000", 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4279999999999999e-06 2024-04-22T19:56:38.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667400+0000", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3893999999999995e-05 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667553+0000", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015292300000000001 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667655+0000", 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102216 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677250+0000", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095952180000000008 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677509+0000", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025870899999999998 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677575+0000", 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6026999999999997e-05 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677644+0000", 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9431000000000007e-05 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2381 3.31 3:8d21d2bd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.776890754, 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017338782, 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2381 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064036+0000", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9110000000000002e-06 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066529+0000", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002493777 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066556+0000", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7144999999999998e-05 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066574+0000", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7107000000000001e-05 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066641+0000", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7895e-05 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066753+0000", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011113299999999999 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066847+0000", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4347999999999999e-05 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076112+0000", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092649340000000007 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081183+0000", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050710979999999996 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081273+0000", 2024-04-22T19:56:38.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9538999999999998e-05 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081371+0000", 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8894999999999994e-05 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2386 3.31 3:8f12d370:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.706974198000001, 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017342527999999999, 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2386 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:38.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133953+0000", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4240000000000002e-06 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136131+0000", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002178195 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136182+0000", 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1221999999999998e-05 2024-04-22T19:56:38.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136208+0000", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.58e-05 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136323+0000", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011534700000000001 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136557+0000", 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000233694 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136732+0000", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017486800000000001 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.143708+0000", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069766339999999998 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151107+0000", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073982800000000001 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151217+0000", 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109962 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151292+0000", 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5102e-05 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2424 3.19 3:99e73f45:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.095427882999999, 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016703743, 2024-04-22T19:56:38.934 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2424 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745500+0000", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.566e-06 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748132+0000", 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026317929999999999 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748167+0000", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4913000000000003e-05 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748181+0000", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4208e-05 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748274+0000", 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2824000000000004e-05 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748457+0000", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182936 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748647+0000", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190037 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.761985+0000", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013338077 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762008+0000", 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2853e-05 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762089+0000", 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0996999999999997e-05 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762199+0000", 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011053900000000001 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2429 3.19 3:99ec54ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.039391638000001, 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013709542999999999, 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2429 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:38.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801535+0000", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5769999999999998e-06 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803462+0000", 2024-04-22T19:56:38.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019265759999999999 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803495+0000", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2932999999999998e-05 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803507+0000", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1810999999999999e-05 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803582+0000", 2024-04-22T19:56:38.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5840000000000006e-05 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803785+0000", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202282 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803968+0000", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018328800000000001 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.809395+0000", 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054274340000000001 2024-04-22T19:56:38.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815096+0000", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057001459999999997 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815180+0000", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4295999999999994e-05 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815241+0000", 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1359999999999995e-05 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.944 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:38.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:38.945 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:38.946 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:38.946 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:38.941+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:39.047 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:39.045+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:39.070 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.070 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:39.070 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:39.070 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:39.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:39.148 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:39.145+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:39.192 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.192 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:39.192 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:39.193 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:39.193 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:39.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:39.249 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:39.245+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:39.317 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.317 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:39.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:39.317 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.873294751, 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.318 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:39.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:39.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:39.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.842393314999999, 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.323 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:39.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.770018153999999, 2024-04-22T19:56:39.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2240 3.21 3:86cda26a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.733589517999999, 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013495467000000001, 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2240 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581141+0000", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0350000000000002e-06 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582501+0000", 2024-04-22T19:56:39.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013595 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582522+0000", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1687000000000001e-05 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582537+0000", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4307e-05 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582637+0000", 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100796 2024-04-22T19:56:39.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582826+0000", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188989 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583023+0000", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019687200000000001 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.590870+0000", 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078466939999999995 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594508+0000", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036385879999999999 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594575+0000", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6137999999999996e-05 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594633+0000", 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8860999999999998e-05 2024-04-22T19:56:39.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2262 3.37 3:ed8b2b14:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.514336530000001, 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015263897, 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2262 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800395+0000", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8489999999999999e-06 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802740+0000", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023454230000000001 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802767+0000", 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7129000000000001e-05 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802781+0000", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.381e-05 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802877+0000", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5506000000000003e-05 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803053+0000", 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000176718 2024-04-22T19:56:39.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803214+0000", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016006500000000001 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812100+0000", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088860469999999993 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815531+0000", 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034318669999999999 2024-04-22T19:56:39.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815600+0000", 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8905000000000005e-05 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815655+0000", 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4577999999999998e-05 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2270 3.9 e75/20 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.426452132000001, 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014069467, 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888277+0000", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8700000000000001e-06 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892702+0000", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044243420000000004 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892729+0000", 2024-04-22T19:56:39.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7525000000000002e-05 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892743+0000", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.416e-05 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892822+0000", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8388999999999998e-05 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892848+0000", 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6441e-05 2024-04-22T19:56:39.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902286+0000", 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094381510000000005 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902345+0000", 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8588999999999998e-05 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.375745559999999, 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2295 3.3b e75/20 3:df7e9e21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_104:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.161902496, 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014042288, 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152835+0000", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7140000000000005e-06 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156743+0000", 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084840000000003 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156770+0000", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6305999999999999e-05 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156782+0000", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2605e-05 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156857+0000", 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5238e-05 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156877+0000", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9468999999999999e-05 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166825+0000", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099478899999999992 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166867+0000", 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2582e-05 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.938452481999999, 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.357 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:39.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.362 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.771918453000001, 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:39.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:39.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2349 3.27 3:e69aba77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.368 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.598804697999999, 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015070930999999999, 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2349 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715926+0000", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0429999999999999e-06 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718239+0000", 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023127740000000001 2024-04-22T19:56:39.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718267+0000", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718281+0000", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3913e-05 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718367+0000", 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5824999999999999e-05 2024-04-22T19:56:39.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718543+0000", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000175985 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718722+0000", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017876599999999999 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.727780+0000", 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090579719999999992 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730887+0000", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031073630000000001 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730930+0000", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3247000000000001e-05 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730994+0000", 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3406999999999998e-05 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2354 3.2e 3:75168009:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.549435951, 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013790066, 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2354 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.374 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765294+0000", 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766753+0000", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014591389999999999 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766783+0000", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550999999999999e-05 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766793+0000", 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0665e-05 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766866+0000", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2999999999999999e-05 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767002+0000", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135561 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767096+0000", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3902999999999999e-05 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.772586+0000", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054899889999999998 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.778995+0000", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064092730000000001 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779042+0000", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7017000000000001e-05 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779082+0000", 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9712000000000002e-05 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2355 3.9 e76/20 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.534142785, 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015165445, 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780586+0000", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.17e-06 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785645+0000", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050587050000000001 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785676+0000", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1853999999999997e-05 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785692+0000", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785774+0000", 2024-04-22T19:56:39.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2193000000000004e-05 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785801+0000", 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6655000000000001e-05 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795682+0000", 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098813749999999995 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795750+0000", 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8011999999999999e-05 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.331812859999999, 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:39.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:39.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2388 3.9 e76/20 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.151026847000001, 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013233333999999999, 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163703+0000", 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.768e-06 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168233+0000", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004529239 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168267+0000", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4224999999999998e-05 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168287+0000", 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9973999999999999e-05 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168399+0000", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011219500000000001 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168439+0000", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0244999999999998e-05 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176738+0000", 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082984140000000005 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176934+0000", 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000196274 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.039286430000001, 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:39.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2398 3.2d e76/20 3:b78c8b50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_207:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.942626892, 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013856109, 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.397 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372103+0000", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7810000000000001e-06 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376334+0000", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004230368 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376375+0000", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1043e-05 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376394+0000", 2024-04-22T19:56:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9386999999999999e-05 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376542+0000", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014801300000000001 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376585+0000", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2469999999999998e-05 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385821+0000", 2024-04-22T19:56:39.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092366589999999995 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385957+0000", 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013538800000000001 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.808876375000001, 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.401 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:39.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:39.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2419 3.3b e77/20 3:dd4443fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_228:head v 77'4, mlcod=75'2)", 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.626845555999999, 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013731093, 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687884+0000", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692213+0000", 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043292979999999997 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692245+0000", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2097000000000001e-05 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692261+0000", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5647000000000001e-05 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692350+0000", 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9692999999999997e-05 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692380+0000", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9977000000000001e-05 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701537+0000", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091567990000000002 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701613+0000", 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6019999999999994e-05 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2426 3.2e 3:75868e42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.547861310999998, 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572174, 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2426 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766869+0000", 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7920000000000001e-06 2024-04-22T19:56:39.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769331+0000", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024615650000000002 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769366+0000", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5466000000000002e-05 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769382+0000", 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960999999999998e-05 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769474+0000", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1580000000000001e-05 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769641+0000", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016693200000000001 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769793+0000", 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015276299999999999 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.777202+0000", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074088019999999999 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781296+0000", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040942360000000002 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781376+0000", 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9552e-05 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781438+0000", 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2525000000000002e-05 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.416 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:39.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:39.417 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:39.417+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:39.518 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:39.513+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:39.539 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:39.540 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:39.540 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:39.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:39.639 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:39.637+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:39.719 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:39.717+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:39.720 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:39.721 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:39.734 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:39.827 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:39.825+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:39.906 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.378279909, 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.242481529999999, 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.039763751999999, 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.778447847999999, 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.719301604000002, 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.619942722000001, 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.476099054999999, 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.427257804, 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.369524337000001, 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.277882429000002, 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.879975907999999, 2024-04-22T19:56:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.829283660000002, 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.559711904, 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.476074149999999, 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.439532081999999, 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.374493952999998, 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.356757947999998, 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.189926234000001, 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.184728983999999, 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.146481473000001, 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:40.013 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:40.014 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:40.014 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:40.009+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:40.114 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:40.113+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:40.146 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:40.146 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:40.160 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:40.245 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:40.245+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:40.316 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:40.313+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:40.326 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:40.329 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:40.329 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:40.329 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:40.329 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:40.340 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:40.429 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:40.429+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:40.433 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.223550201000002, 2024-04-22T19:56:40.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:40.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:40.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.194707504, 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.245170657000003, 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2234 3.1a 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.000160441999999, 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021079243000000001, 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510120+0000", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514283+0000", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041627849999999996 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514319+0000", 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6279000000000003e-05 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514337+0000", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000002e-05 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514465+0000", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012822500000000001 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514759+0000", 2024-04-22T19:56:40.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029401200000000002 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.515064+0000", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000305369 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.529369+0000", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014304546 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.530884+0000", 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015148340000000001 2024-04-22T19:56:40.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531063+0000", 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179144 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531195+0000", 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013279200000000001 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2241 3.3 3:c17523d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.917927316, 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018309130999999999, 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2241 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:40.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592353+0000", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596511+0000", 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004157689 2024-04-22T19:56:40.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596549+0000", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7722999999999998e-05 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596566+0000", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7232999999999999e-05 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596756+0000", 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019029100000000001 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597011+0000", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025448199999999999 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597239+0000", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022798100000000001 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.606429+0000", 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00918975 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610330+0000", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039011200000000001 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610517+0000", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018694 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610659+0000", 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141812 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2243 3.e e75/20 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.891691302000002, 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019719670000000002, 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618588+0000", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2359999999999999e-06 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.622983+0000", 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043956560000000004 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623022+0000", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8509e-05 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623042+0000", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9984e-05 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623164+0000", 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012174400000000001 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623200+0000", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.65e-05 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638135+0000", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014935313 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638305+0000", 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016972800000000001 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.887091475999998, 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.542 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2247 3.e e75/20 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.852071260999999, 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016026911000000001, 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658208+0000", 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7690000000000001e-06 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661839+0000", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036309699999999999 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661891+0000", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1969999999999999e-05 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661914+0000", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3142999999999998e-05 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662073+0000", 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015902099999999999 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662129+0000", 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6135999999999999e-05 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674095+0000", 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011965567 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674232+0000", 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013733500000000001 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2250 3.14 3:29315fda:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.829546180000001, 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016152612, 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.551 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680733+0000", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7839999999999999e-06 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684720+0000", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039870230000000001 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684755+0000", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5021000000000002e-05 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684773+0000", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7445e-05 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684881+0000", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010862900000000001 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685091+0000", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210087 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685270+0000", 2024-04-22T19:56:40.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017822000000000001 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.693447+0000", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081774489999999998 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696742+0000", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032943740000000001 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696821+0000", 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9773999999999999e-05 2024-04-22T19:56:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696883+0000", 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1805999999999997e-05 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2266 3.1a 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.668556352, 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017647817999999999, 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.556 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2266 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:40.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841723+0000", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.818e-06 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845729+0000", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040059120000000004 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845758+0000", 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8439999999999999e-05 2024-04-22T19:56:40.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845777+0000", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9211999999999998e-05 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845874+0000", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6872000000000004e-05 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846027+0000", 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015361899999999999 2024-04-22T19:56:40.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846163+0000", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013575800000000001 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.851816+0000", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056529600000000003 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859284+0000", 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679780000000001 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859327+0000", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3432e-05 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859368+0000", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0816999999999999e-05 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2270 3.9 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:40.561 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.626288908999999, 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019065421999999999, 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883990+0000", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887966+0000", 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039765670000000003 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887995+0000", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8694e-05 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888008+0000", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2658e-05 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888095+0000", 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7727999999999998e-05 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888228+0000", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132605 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888362+0000", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013399000000000001 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.894120+0000", 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00575845 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902908+0000", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087880549999999995 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902985+0000", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6637999999999994e-05 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.903053+0000", 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8089999999999994e-05 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.566 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.257332078000001, 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:40.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:40.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:40.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2305 3.1c e75/20 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head v 75'3, mlcod=75'1)", 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.249502100000001, 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016090595999999999, 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260776+0000", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263929+0000", 2024-04-22T19:56:40.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031526039999999998 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263948+0000", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8885e-05 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263961+0000", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3662999999999999e-05 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264089+0000", 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127136 2024-04-22T19:56:40.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264135+0000", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6845999999999998e-05 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276754+0000", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012618430999999999 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276865+0000", 2024-04-22T19:56:40.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011136100000000001 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2342 3.14 3:29b9f9a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.864331549999999, 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017148498000000002, 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2342 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645948+0000", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.627e-06 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651334+0000", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053864910000000002 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651371+0000", 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6523000000000003e-05 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651389+0000", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7969e-05 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651477+0000", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7876999999999999e-05 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651609+0000", 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013271499999999999 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651731+0000", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121841 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.659086+0000", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073550250000000003 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.662886+0000", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037994399999999998 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663019+0000", 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013331399999999999 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663094+0000", 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4676000000000001e-05 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.762584760999999, 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:40.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:40.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:40.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2355 3.9 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.585 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.73406932, 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02047042, 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2355 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:40.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776211+0000", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1839999999999999e-06 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780333+0000", 2024-04-22T19:56:40.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041225819999999996 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780367+0000", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3606999999999999e-05 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780384+0000", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7316000000000002e-05 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780464+0000", 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9896999999999998e-05 2024-04-22T19:56:40.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780591+0000", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012743699999999999 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780703+0000", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011181 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.785122+0000", 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044187890000000002 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796555+0000", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011433103999999999 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796625+0000", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9935e-05 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796678+0000", 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2759000000000001e-05 2024-04-22T19:56:40.590 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2376 3.3 3:c3eda47a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.507593573000001, 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016352073000000002, 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.591 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2376 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002688+0000", 2024-04-22T19:56:40.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8099999999999997e-06 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006957+0000", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042690239999999997 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006994+0000", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7149e-05 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007013+0000", 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8674000000000001e-05 2024-04-22T19:56:40.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007109+0000", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6372999999999994e-05 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007246+0000", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729700000000001 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007367+0000", 2024-04-22T19:56:40.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121041 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.014424+0000", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070568849999999997 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018824+0000", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044000100000000002 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018964+0000", 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013976099999999999 2024-04-22T19:56:40.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.019035+0000", 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1049000000000004e-05 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2388 3.9 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.351006747, 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018974290000000001, 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.596 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2388 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:40.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159272+0000", 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.447e-06 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163089+0000", 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038161340000000001 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163109+0000", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0554999999999999e-05 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163122+0000", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2947e-05 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163270+0000", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147527 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163518+0000", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024866299999999999 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163763+0000", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024473000000000002 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.177631+0000", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013868096999999999 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178080+0000", 2024-04-22T19:56:40.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044913199999999998 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178174+0000", 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3602000000000003e-05 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178244+0000", 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0456000000000004e-05 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2393 3.9 3:904d522a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.256324276000001, 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016110073999999999, 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2393 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253954+0000", 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9819999999999998e-06 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258156+0000", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042015799999999999 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258184+0000", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258196+0000", 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2363e-05 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258307+0000", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011117500000000001 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258436+0000", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012931499999999999 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258547+0000", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110759 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.263618+0000", 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050708230000000003 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269890+0000", 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062723550000000003 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269988+0000", 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8059000000000004e-05 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.270062+0000", 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4119e-05 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.802136925999999, 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:40.607 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:40.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:40.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:40.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:40.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:40.612 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:40.613 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:40.613 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:40.614 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:40.614 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:40.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:40.615 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:40.613+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:40.615 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:40.615 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:40.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:40.631 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:40.651 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:40.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:56:40.671 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:40.671 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:40.691 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:40.691 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:40.710 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:40.710 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:40.714 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:40.713+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:40.793 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:40.793 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:40.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:40.850 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:40.849+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:40.915 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:40.913+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:40.974 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:40.974 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:40.987 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:41.016 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:41.013+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:41.104 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.104 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.116 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:41.113+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:41.119 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:41.217 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:41.213+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:41.288 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.288 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:41.318 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:41.313+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:41.419 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:41.413+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:41.421 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.421 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.435 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:41.520 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:41.517+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:41.554 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.554 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:41.620 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:41.617+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:41.679 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:56:41.720 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:41.717+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:41.735 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.735 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:41.837 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:41.837+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:41.918 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:41.918 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:41.922 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:41.917+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:41.932 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:42.023 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:42.021+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:42.101 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:42.101 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:42.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:42.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:42.157+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:42.224 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:42.221+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:42.247 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:42.247 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:42.262 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:42.325 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:42.325+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:42.426 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:42.425+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:42.433 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:42.433 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:42.447 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:42.527 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:42.521+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:42.565 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:42.565 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:42.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:42.584 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:56:42.584 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:56:42.584 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:56:42.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-04-22T19:56:42.628 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:42.625+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:42.728 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:42.729 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:42.725+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:42.752 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:42.752 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:42.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:42.859 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:42.857+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:42.871 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:42.871 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:42.889 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:42.889 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:42.907 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:42.907 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:42.925 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:42.925 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:42.930 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:42.930 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:42.930 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:42.930 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:42.930 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:42.930 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:42.925+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:42.944 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:42.946 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:42.946 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:42.948 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-22T19:56:42.945+0000 7fe06150a640 -1 mon.a@0(leader).osd e88 definitely_dead 0 2024-04-22T19:56:42.967 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:42.967 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:42.987 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:42.987 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:43.009 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:43.009 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 149.71329945299999, 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:56:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:56:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:56:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:56:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2234 3.1a e75/20 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.546056892000003, 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013529701999999999, 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514971+0000", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.514973+0000", 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.68e-06 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519979+0000", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050056659999999998 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.519995+0000", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6580999999999999e-05 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520005+0000", 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8120000000000002e-06 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520085+0000", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0187999999999999e-05 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.520109+0000", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4048000000000001e-05 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528439+0000", 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083296499999999992 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.528501+0000", 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2076999999999995e-05 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2239 3.4 3:21f73a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.492418669999999, 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014804291000000001, 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2239 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568609+0000", 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.568613+0000", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2949999999999998e-06 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570474+0000", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018617060000000001 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570514+0000", 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9580999999999999e-05 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570530+0000", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6175999999999999e-05 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570634+0000", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103566 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570762+0000", 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012803399999999999 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.570905+0000", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143079 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582799+0000", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011894175 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583277+0000", 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047821099999999998 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583353+0000", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5809000000000006e-05 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583414+0000", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0659000000000003e-05 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2253 3.25 3:a7350408:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.352899293, 2024-04-22T19:56:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011503131, 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2253 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708129+0000", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.708132+0000", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9960000000000002e-06 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709597+0000", 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014653159999999999 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709631+0000", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4124000000000001e-05 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709647+0000", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5506999999999999e-05 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709736+0000", 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9341999999999999e-05 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709889+0000", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015342 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.709984+0000", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4676e-05 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.718852+0000", 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088682929999999993 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719498+0000", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064514499999999996 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719571+0000", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3642999999999999e-05 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.719632+0000", 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0668999999999998e-05 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2256 3.31 3:8ce47cb8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.321345872999999, 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015270647, 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2256 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739682+0000", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.739685+0000", 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.948e-06 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740784+0000", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001098489 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740820+0000", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6658e-05 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740836+0000", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5807999999999998e-05 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.740915+0000", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8534000000000004e-05 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741039+0000", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012463200000000001 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.741143+0000", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103453 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.746502+0000", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005359351 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754828+0000", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083260509999999992 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754900+0000", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2203e-05 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.754953+0000", 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2519999999999999e-05 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2265 3.0 3:0004f258:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.230161723000002, 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012197256, 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.087 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2265 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830866+0000", 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.830869+0000", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.734e-06 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832813+0000", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019440410000000001 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832846+0000", 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2404999999999999e-05 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832862+0000", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6507999999999998e-05 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.832951+0000", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8634000000000006e-05 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833072+0000", 2024-04-22T19:56:43.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012147899999999999 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.833175+0000", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102589 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842438+0000", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092631840000000007 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.842939+0000", 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050115499999999998 2024-04-22T19:56:43.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843006+0000", 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6886999999999998e-05 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.843064+0000", 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7639999999999997e-05 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.092 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2266 3.1a e75/20 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.215047067999997, 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011766982, 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845981+0000", 2024-04-22T19:56:43.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.845983+0000", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.850998+0000", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050147000000000004 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851028+0000", 2024-04-22T19:56:43.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9926000000000001e-05 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851044+0000", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851131+0000", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6959000000000005e-05 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.851157+0000", 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5854e-05 2024-04-22T19:56:43.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857673+0000", 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065160189999999996 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.857748+0000", 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5436000000000001e-05 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2277 3.31 3:8df7bb21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.096 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.105354447000003, 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017512757, 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2277 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955674+0000", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.955677+0000", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.92e-06 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957378+0000", 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001701316 2024-04-22T19:56:43.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957391+0000", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2952000000000001e-05 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957397+0000", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6229999999999999e-06 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957456+0000", 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8468999999999999e-05 2024-04-22T19:56:43.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957572+0000", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116082 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.957677+0000", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105305 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.963176+0000", 2024-04-22T19:56:43.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054987320000000001 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973068+0000", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098916569999999999 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973135+0000", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6879999999999997e-05 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.973186+0000", 2024-04-22T19:56:43.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1820999999999997e-05 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2286 3.0 3:0027e6e6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.008649143, 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013313472, 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2286 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052379+0000", 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.052382+0000", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1410000000000001e-06 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054416+0000", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020339830000000001 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054444+0000", 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7580999999999999e-05 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054455+0000", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1195999999999999e-05 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054532+0000", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6978999999999996e-05 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054649+0000", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117459 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:43.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.054760+0000", 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111061 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.064840+0000", 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010079612999999999 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065571+0000", 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073068600000000003 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065636+0000", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5467000000000002e-05 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.065692+0000", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6305999999999999e-05 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2289 3.4 3:232cb087:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:43.107 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.976523876999998, 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017538444, 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2289 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084504+0000", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.084506+0000", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1339999999999998e-06 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086111+0000", 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016043330000000001 2024-04-22T19:56:43.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086142+0000", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411000000000001e-05 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086156+0000", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086231+0000", 2024-04-22T19:56:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4982999999999997e-05 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086388+0000", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156396 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.086574+0000", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186305 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.098446+0000", 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011871457 2024-04-22T19:56:43.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101948+0000", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035023419999999999 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.101995+0000", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6947999999999998e-05 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.102043+0000", 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7734000000000001e-05 2024-04-22T19:56:43.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2306 3.3e 3:7d26d192:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.796951271000001, 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012849724999999999, 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2306 2024-04-22T19:56:43.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264077+0000", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.264081+0000", 2024-04-22T19:56:43.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7589999999999999e-06 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265830+0000", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017491500000000001 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265868+0000", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8056000000000003e-05 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265881+0000", 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3529999999999999e-05 2024-04-22T19:56:43.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.265980+0000", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8876999999999995e-05 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266173+0000", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019305400000000001 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.266357+0000", 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018393899999999999 2024-04-22T19:56:43.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276434+0000", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077254000000001 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276822+0000", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000387239 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276879+0000", 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7501999999999999e-05 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.276927+0000", 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7364999999999998e-05 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2310 3.3e 3:7edfea0a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.759442828000001, 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012685073, 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2310 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301585+0000", 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301588+0000", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2550000000000002e-06 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303338+0000", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017496440000000001 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303364+0000", 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5677000000000002e-05 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303373+0000", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6639999999999993e-06 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303445+0000", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1292999999999997e-05 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303578+0000", 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013347700000000001 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.303709+0000", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013108099999999999 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.313555+0000", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098454960000000005 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314136+0000", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00058124700000000001 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314203+0000", 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6910999999999997e-05 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.314270+0000", 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7328000000000003e-05 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2314 3.25 3:a7b71818:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.715540530999998, 2024-04-22T19:56:43.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012726375999999999, 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2314 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345488+0000", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.345490+0000", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3e-06 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347233+0000", 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001743164 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347253+0000", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0452e-05 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347264+0000", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0385e-05 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347332+0000", 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8471000000000002e-05 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347458+0000", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012541599999999999 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.347588+0000", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012997799999999999 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.357622+0000", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010034022 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358127+0000", 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050533299999999995 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358164+0000", 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6866999999999998e-05 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.358214+0000", 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9988000000000003e-05 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2329 3.19 3:9858478a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.548913142, 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015534793, 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2329 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512115+0000", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.512118+0000", 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6350000000000002e-06 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514585+0000", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002467155 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514602+0000", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7456999999999999e-05 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.514614+0000", 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1528e-05 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515433+0000", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081949699999999998 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515562+0000", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012903200000000001 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.515684+0000", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121968 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.522007+0000", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063230220000000002 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527545+0000", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055375670000000002 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527601+0000", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6489000000000001e-05 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.527650+0000", 2024-04-22T19:56:43.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442999999999997e-05 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2335 3.25 3:a6bbb67a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.487644077999999, 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015472677000000001, 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.134 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2335 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573384+0000", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.573386+0000", 2024-04-22T19:56:43.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3300000000000001e-06 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575798+0000", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024118770000000002 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575820+0000", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1345999999999999e-05 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575830+0000", 2024-04-22T19:56:43.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0436e-05 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.575899+0000", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9175000000000001e-05 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576003+0000", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010353000000000001 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.576094+0000", 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1188999999999997e-05 2024-04-22T19:56:43.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588377+0000", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012282944000000001 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588726+0000", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034938100000000001 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588804+0000", 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7871e-05 2024-04-22T19:56:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.588857+0000", 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2598e-05 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2344 3.4 3:20840935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.395667383999999, 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012283522, 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.139 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2344 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665361+0000", 2024-04-22T19:56:43.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.665363+0000", 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.542e-06 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667312+0000", 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019485100000000001 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667328+0000", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6623999999999999e-05 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667336+0000", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4279999999999999e-06 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667400+0000", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3893999999999995e-05 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667553+0000", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015292300000000001 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.667655+0000", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102216 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677250+0000", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095952180000000008 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677509+0000", 2024-04-22T19:56:43.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025870899999999998 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677575+0000", 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6026999999999997e-05 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.677644+0000", 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9431000000000007e-05 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2381 3.31 3:8d21d2bd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.996995440999999, 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017338782, 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2381 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064033+0000", 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.064036+0000", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9110000000000002e-06 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066529+0000", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002493777 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066556+0000", 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7144999999999998e-05 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066574+0000", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7107000000000001e-05 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066641+0000", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7895e-05 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066753+0000", 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011113299999999999 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.066847+0000", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4347999999999999e-05 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.076112+0000", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092649340000000007 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081183+0000", 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050710979999999996 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081273+0000", 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9538999999999998e-05 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.081371+0000", 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8894999999999994e-05 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2386 3.31 3:8f12d370:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.927078885, 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017342527999999999, 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2386 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133949+0000", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.133953+0000", 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4240000000000002e-06 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136131+0000", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002178195 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136182+0000", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1221999999999998e-05 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136208+0000", 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.58e-05 2024-04-22T19:56:43.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136323+0000", 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011534700000000001 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136557+0000", 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000233694 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.136732+0000", 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017486800000000001 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.143708+0000", 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069766339999999998 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151107+0000", 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073982800000000001 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151217+0000", 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109962 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.151292+0000", 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5102e-05 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2424 3.19 3:99e73f45:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.315532569999998, 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016703743, 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2424 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745495+0000", 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.745500+0000", 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.566e-06 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748132+0000", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026317929999999999 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748167+0000", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4913000000000003e-05 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748181+0000", 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4208e-05 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748274+0000", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2824000000000004e-05 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748457+0000", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182936 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.748647+0000", 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190037 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.761985+0000", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013338077 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762008+0000", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2853e-05 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762089+0000", 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0996999999999997e-05 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.762199+0000", 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011053900000000001 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2429 3.19 3:99ec54ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.259496325000001, 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013709542999999999, 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.162 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2429 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801532+0000", 2024-04-22T19:56:43.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.801535+0000", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5769999999999998e-06 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803462+0000", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019265759999999999 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803495+0000", 2024-04-22T19:56:43.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2932999999999998e-05 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803507+0000", 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1810999999999999e-05 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803582+0000", 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5840000000000006e-05 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803785+0000", 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000202282 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.803968+0000", 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018328800000000001 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.809395+0000", 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054274340000000001 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815096+0000", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057001459999999997 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815180+0000", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4295999999999994e-05 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.815241+0000", 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1359999999999995e-05 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.168 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:43.168 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:43.057+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:43.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:43.211 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:43.209+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:43.271 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:43.269+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:43.340 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:43.340 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:43.354 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:43.372 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:43.369+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:43.473 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:43.473+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:43.511 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:43.511 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:43.511 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:43.511 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:43.512 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:43.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:43.574 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:43.569+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.646 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.203799414999999, 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:43.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:43.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.172897978999998, 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:43.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:43.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.100522818000002, 2024-04-22T19:56:43.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:43.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2240 3.21 3:86cda26a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.064094181999998, 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013495467000000001, 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2240 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581138+0000", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.581141+0000", 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0350000000000002e-06 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582501+0000", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013595 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582522+0000", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1687000000000001e-05 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582537+0000", 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4307e-05 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582637+0000", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100796 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.582826+0000", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188989 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.583023+0000", 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019687200000000001 2024-04-22T19:56:43.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.590870+0000", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078466939999999995 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594508+0000", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036385879999999999 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594575+0000", 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6137999999999996e-05 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.594633+0000", 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8860999999999998e-05 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2262 3.37 3:ed8b2b14:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.844841193999997, 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015263897, 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2262 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800395+0000", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8489999999999999e-06 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802740+0000", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023454230000000001 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802767+0000", 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7129000000000001e-05 2024-04-22T19:56:43.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802781+0000", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.381e-05 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802877+0000", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5506000000000003e-05 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803053+0000", 2024-04-22T19:56:43.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000176718 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803214+0000", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016006500000000001 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812100+0000", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088860469999999993 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815531+0000", 2024-04-22T19:56:43.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034318669999999999 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815600+0000", 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8905000000000005e-05 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815655+0000", 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4577999999999998e-05 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2270 3.9 e75/20 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.756956795999997, 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014069467, 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888277+0000", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8700000000000001e-06 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892702+0000", 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044243420000000004 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892729+0000", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7525000000000002e-05 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892743+0000", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.416e-05 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892822+0000", 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8388999999999998e-05 2024-04-22T19:56:43.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892848+0000", 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6441e-05 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902286+0000", 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094381510000000005 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902345+0000", 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8588999999999998e-05 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.706250224000001, 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:43.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:43.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:43.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2295 3.3b e75/20 3:df7e9e21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_104:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.492407159999999, 2024-04-22T19:56:43.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014042288, 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152835+0000", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7140000000000005e-06 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156743+0000", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084840000000003 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156770+0000", 2024-04-22T19:56:43.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6305999999999999e-05 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156782+0000", 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2605e-05 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156857+0000", 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5238e-05 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156877+0000", 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9468999999999999e-05 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166825+0000", 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099478899999999992 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166867+0000", 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2582e-05 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.268957145999998, 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:43.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:43.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:43.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.102423117000001, 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2349 3.27 3:e69aba77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.929309362000001, 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015070930999999999, 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2349 2024-04-22T19:56:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715926+0000", 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0429999999999999e-06 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718239+0000", 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023127740000000001 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718267+0000", 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718281+0000", 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3913e-05 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718367+0000", 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5824999999999999e-05 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718543+0000", 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000175985 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718722+0000", 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017876599999999999 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.727780+0000", 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090579719999999992 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730887+0000", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031073630000000001 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730930+0000", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3247000000000001e-05 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730994+0000", 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3406999999999998e-05 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2354 3.2e 3:75168009:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.879940614999999, 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013790066, 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2354 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765294+0000", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766753+0000", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014591389999999999 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766783+0000", 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550999999999999e-05 2024-04-22T19:56:43.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766793+0000", 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0665e-05 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766866+0000", 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2999999999999999e-05 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767002+0000", 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135561 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767096+0000", 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3902999999999999e-05 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.772586+0000", 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054899889999999998 2024-04-22T19:56:43.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.778995+0000", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064092730000000001 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779042+0000", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7017000000000001e-05 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779082+0000", 2024-04-22T19:56:43.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9712000000000002e-05 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2355 3.9 e76/20 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.864647449, 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015165445, 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.712 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780586+0000", 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.17e-06 2024-04-22T19:56:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785645+0000", 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050587050000000001 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785676+0000", 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1853999999999997e-05 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785692+0000", 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785774+0000", 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2193000000000004e-05 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785801+0000", 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6655000000000001e-05 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795682+0000", 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098813749999999995 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795750+0000", 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8011999999999999e-05 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.716 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.662317523999999, 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:43.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:43.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2388 3.9 e76/20 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head v 76'4, mlcod=75'2)", 2024-04-22T19:56:43.722 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.481531511, 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013233333999999999, 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163701+0000", 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.163703+0000", 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.768e-06 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168233+0000", 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004529239 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168267+0000", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4224999999999998e-05 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168287+0000", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9973999999999999e-05 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168399+0000", 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011219500000000001 2024-04-22T19:56:43.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.168439+0000", 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0244999999999998e-05 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176738+0000", 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082984140000000005 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.176934+0000", 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000196274 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.369791094, 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.727 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:43.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.732 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2398 3.2d e76/20 3:b78c8b50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_207:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.273131555999999, 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013856109, 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372103+0000", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7810000000000001e-06 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376334+0000", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004230368 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376375+0000", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1043e-05 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376394+0000", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9386999999999999e-05 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376542+0000", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014801300000000001 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376585+0000", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2469999999999998e-05 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385821+0000", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092366589999999995 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385957+0000", 2024-04-22T19:56:43.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013538800000000001 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.139381039, 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:43.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:43.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2419 3.3b e77/20 3:dd4443fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_228:head v 77'4, mlcod=75'2)", 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.957350219999999, 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013731093, 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687882+0000", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.687884+0000", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692213+0000", 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043292979999999997 2024-04-22T19:56:43.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692245+0000", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2097000000000001e-05 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692261+0000", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5647000000000001e-05 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692350+0000", 2024-04-22T19:56:43.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9692999999999997e-05 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.692380+0000", 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9977000000000001e-05 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701537+0000", 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091567990000000002 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.701613+0000", 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6019999999999994e-05 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2426 3.2e 3:75868e42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.878365975000001, 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572174, 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:43.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2426 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:43.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766869+0000", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7920000000000001e-06 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769331+0000", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024615650000000002 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769366+0000", 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5466000000000002e-05 2024-04-22T19:56:43.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769382+0000", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960999999999998e-05 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769474+0000", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1580000000000001e-05 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769641+0000", 2024-04-22T19:56:43.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016693200000000001 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769793+0000", 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015276299999999999 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.777202+0000", 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074088019999999999 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:43.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781296+0000", 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040942360000000002 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781376+0000", 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9552e-05 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781438+0000", 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2525000000000002e-05 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:43.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:43.753 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:43.753 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:56:43.754 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:43.755 INFO:teuthology.orchestra.run.smithi111.stderr:marked out osd.3. 2024-04-22T19:56:43.756 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:43.753+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:43.855 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:43.849+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:43.915 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:43.915 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:43.915 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:43.916 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:43.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:43.979 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:43.977+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:44.056 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:44.053+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:44.093 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:44.093 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:44.094 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:44.094 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:44.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:44.195 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:44.193+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:44.258 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:44.257+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:44.277 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:44.277 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:44.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:44.277 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:44.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.749213464999997, 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.278 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:44.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.283 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.613415086000003, 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:44.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:44.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.410697308000003, 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.290 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:44.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:44.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.149381404000003, 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:44.296 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:44.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.090235159999999, 2024-04-22T19:56:44.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:44.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:44.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:44.308 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.990876278000002, 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:44.314 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.847032611000003, 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.798191359999997, 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.740457892999999, 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:44.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:44.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.648815984999999, 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.250909464000003, 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:44.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:44.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.200217215999999, 2024-04-22T19:56:44.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:44.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:44.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:44.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.930645460000001, 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:44.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:44.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:44.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:44.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.847007705999999, 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:44.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.810465638, 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:44.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:44.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:44.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.745427508999999, 2024-04-22T19:56:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.727691503999999, 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.560859789999999, 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.55566254, 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.517415028999999, 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:44.395 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:44.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:44.397 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:44.393+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:44.498 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:44.493+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:44.527 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:44.528 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:44.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:44.599 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:44.597+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:44.667 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:44.667 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:44.667 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:44.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:44.667 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:44.688 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:56:44.696 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:44.741 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:44.741+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:44.802 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:44.797+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:44.850 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1192 3.2c e71/20 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head v 71'1, mlcod=0'0)", 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.561572781000002, 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017713198999999999, 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286726+0000", 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286729+0000", 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291645+0000", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049161589999999998 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291694+0000", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9246000000000003e-05 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291714+0000", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0029000000000001e-05 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291844+0000", 2024-04-22T19:56:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129541 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.291882+0000", 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7999e-05 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304317+0000", 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012435104000000001 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304440+0000", 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122948 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.532730084000001, 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 46.583193237000003, 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:44.859 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2234 3.1a 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.338183022000003, 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021079243000000001, 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510120+0000", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514283+0000", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041627849999999996 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514319+0000", 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6279000000000003e-05 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514337+0000", 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000002e-05 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514465+0000", 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012822500000000001 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514759+0000", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029401200000000002 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.515064+0000", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000305369 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.529369+0000", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014304546 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.530884+0000", 2024-04-22T19:56:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015148340000000001 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531063+0000", 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179144 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531195+0000", 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013279200000000001 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2241 3.3 3:c17523d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.255949895999997, 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018309130999999999, 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2241 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592349+0000", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.592353+0000", 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596511+0000", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004157689 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596549+0000", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7722999999999998e-05 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596566+0000", 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7232999999999999e-05 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.596756+0000", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019029100000000001 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597011+0000", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025448199999999999 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.597239+0000", 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022798100000000001 2024-04-22T19:56:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.606429+0000", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00918975 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610330+0000", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039011200000000001 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610517+0000", 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018694 2024-04-22T19:56:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.610659+0000", 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141812 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2243 3.e e75/20 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.229713881999999, 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019719670000000002, 2024-04-22T19:56:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618585+0000", 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618588+0000", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2359999999999999e-06 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.622983+0000", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043956560000000004 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623022+0000", 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8509e-05 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623042+0000", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9984e-05 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623164+0000", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012174400000000001 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623200+0000", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.65e-05 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638135+0000", 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014935313 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638305+0000", 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016972800000000001 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.225114056000002, 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2247 3.e e75/20 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.190093840999999, 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016026911000000001, 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658205+0000", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.658208+0000", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7690000000000001e-06 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661839+0000", 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036309699999999999 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661891+0000", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1969999999999999e-05 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661914+0000", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3142999999999998e-05 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662073+0000", 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015902099999999999 2024-04-22T19:56:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662129+0000", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6135999999999999e-05 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674095+0000", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011965567 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674232+0000", 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013733500000000001 2024-04-22T19:56:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2250 3.14 3:29315fda:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.167568760000002, 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016152612, 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-22T19:56:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680731+0000", 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.680733+0000", 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7839999999999999e-06 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684720+0000", 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039870230000000001 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684755+0000", 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5021000000000002e-05 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684773+0000", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7445e-05 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.684881+0000", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010862900000000001 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685091+0000", 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210087 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.685270+0000", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017822000000000001 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.693447+0000", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081774489999999998 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696742+0000", 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032943740000000001 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696821+0000", 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9773999999999999e-05 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.696883+0000", 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1805999999999997e-05 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2266 3.1a 3:59c27426:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.006578931999996, 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017647817999999999, 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2266 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841720+0000", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.841723+0000", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.818e-06 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845729+0000", 2024-04-22T19:56:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040059120000000004 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845758+0000", 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8439999999999999e-05 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845777+0000", 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9211999999999998e-05 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.845874+0000", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6872000000000004e-05 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846027+0000", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015361899999999999 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.846163+0000", 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013575800000000001 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.851816+0000", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056529600000000003 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859284+0000", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679780000000001 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859327+0000", 2024-04-22T19:56:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3432e-05 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.859368+0000", 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0816999999999999e-05 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2270 3.9 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.964311488999996, 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019065421999999999, 2024-04-22T19:56:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883988+0000", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.883990+0000", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887966+0000", 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039765670000000003 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.887995+0000", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8694e-05 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888008+0000", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2658e-05 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888095+0000", 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7727999999999998e-05 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888228+0000", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132605 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.888362+0000", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013399000000000001 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.894120+0000", 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00575845 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902908+0000", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087880549999999995 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.902985+0000", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6637999999999994e-05 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.903053+0000", 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8089999999999994e-05 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.595354657999998, 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2305 3.1c e75/20 3:395e44cc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_114:head v 75'3, mlcod=75'1)", 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.587524680000001, 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016090595999999999, 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260775+0000", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.260776+0000", 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263929+0000", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031526039999999998 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263948+0000", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8885e-05 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.263961+0000", 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3662999999999999e-05 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264089+0000", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127136 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.264135+0000", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6845999999999998e-05 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276754+0000", 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012618430999999999 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.276865+0000", 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011136100000000001 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2342 3.14 3:29b9f9a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.202354130000003, 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017148498000000002, 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2342 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645945+0000", 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.645948+0000", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.627e-06 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651334+0000", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053864910000000002 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651371+0000", 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6523000000000003e-05 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651389+0000", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7969e-05 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651477+0000", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7876999999999999e-05 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651609+0000", 2024-04-22T19:56:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013271499999999999 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.651731+0000", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121841 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.659086+0000", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073550250000000003 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.662886+0000", 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037994399999999998 2024-04-22T19:56:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663019+0000", 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013331399999999999 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.663094+0000", 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4676000000000001e-05 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.100607341, 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2355 3.9 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.072091899999997, 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02047042, 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2355 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776207+0000", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.776211+0000", 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1839999999999999e-06 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780333+0000", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041225819999999996 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780367+0000", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3606999999999999e-05 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780384+0000", 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7316000000000002e-05 2024-04-22T19:56:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780464+0000", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9896999999999998e-05 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780591+0000", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012743699999999999 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.780703+0000", 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011181 2024-04-22T19:56:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.785122+0000", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044187890000000002 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796555+0000", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011433103999999999 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796625+0000", 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9935e-05 2024-04-22T19:56:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.796678+0000", 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2759000000000001e-05 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2376 3.3 3:c3eda47a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.845616153000002, 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016352073000000002, 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2376 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002683+0000", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.002688+0000", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8099999999999997e-06 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006957+0000", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042690239999999997 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.006994+0000", 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7149e-05 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007013+0000", 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8674000000000001e-05 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007109+0000", 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6372999999999994e-05 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007246+0000", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729700000000001 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.007367+0000", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121041 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.014424+0000", 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070568849999999997 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018824+0000", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044000100000000002 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.018964+0000", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013976099999999999 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.019035+0000", 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1049000000000004e-05 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2388 3.9 3:920c85a2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.689029327, 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018974290000000001, 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2388 2024-04-22T19:56:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159270+0000", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.159272+0000", 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.447e-06 2024-04-22T19:56:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163089+0000", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038161340000000001 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163109+0000", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0554999999999999e-05 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163122+0000", 2024-04-22T19:56:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2947e-05 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163270+0000", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147527 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163518+0000", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024866299999999999 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.163763+0000", 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024473000000000002 2024-04-22T19:56:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.177631+0000", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013868096999999999 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178080+0000", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044913199999999998 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178174+0000", 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3602000000000003e-05 2024-04-22T19:56:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.178244+0000", 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0456000000000004e-05 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2393 3.9 3:904d522a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.594346856000001, 2024-04-22T19:56:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016110073999999999, 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2393 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253952+0000", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.253954+0000", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9819999999999998e-06 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258156+0000", 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042015799999999999 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258184+0000", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7543999999999999e-05 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258196+0000", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2363e-05 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258307+0000", 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011117500000000001 2024-04-22T19:56:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258436+0000", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012931499999999999 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.258547+0000", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110759 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.263618+0000", 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050708230000000003 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269890+0000", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062723550000000003 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.269988+0000", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8059000000000004e-05 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.270062+0000", 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4119e-05 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.140159506000003, 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:44.953 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:44.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:44.955 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:44.953+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:45.028 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:45.079 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:45.077+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:45.149 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:45.149 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:45.149 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:45.149 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:45.155 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:45.153+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:45.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:45.207 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:45.208 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:45.226 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:45.226 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:45.243 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:45.244 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:45.256 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:45.253+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:45.260 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:45.260 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:45.282 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:45.283 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:45.305 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:45.306 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:45.309 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:45.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:45.328 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:45.328 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:45.339 INFO:tasks.workunit.client.0.smithi111.stderr:100+0 records in 2024-04-22T19:56:45.340 INFO:tasks.workunit.client.0.smithi111.stderr:100+0 records out 2024-04-22T19:56:45.340 INFO:tasks.workunit.client.0.smithi111.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.50674 s, 140 MB/s 2024-04-22T19:56:45.349 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:45.349 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:45.369 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:45.369+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:45.458 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:45.453+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:45.491 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:45.491 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:45.505 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:45.559 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:45.557+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:45.626 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:45.627 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:45.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:45.681 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:45.681+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:45.761 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:45.757+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:45.810 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:45.811 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:45.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:45.865 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:45.865+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:45.963 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:45.961+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:45.987 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:45.987 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.001 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:46.089 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:46.089+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:46.162 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.162 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.165 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:46.161+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:46.176 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:46.266 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:46.261+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:46.338 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.338 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.353 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:46.397 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:46.397+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:46.467 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:46.461+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:46.474 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.474 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.489 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:46.568 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:46.565+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:46.613 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.613 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.627 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:46.668 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:46.665+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:46.751 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:56:46.769 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:46.765+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:46.784 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.784 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.798 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:46.883 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:46.881+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:46.958 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:46.959 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:46.972 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:46.972 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:46.969+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:47.072 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:47.069+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:47.136 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:47.136 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:47.150 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:47.195 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:47.193+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:47.268 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:47.268 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:47.274 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:47.269+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:47.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:47.375 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:47.369+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:47.375 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:47.475 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:47.473+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:47.484 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:47.484 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:47.515 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:47.562 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:47.562 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:47.575 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:47.573+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:47.585 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:47.585 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:47.620 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:47.620 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:47.653 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:47.653 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:47.676 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:47.673+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2677 3.28 e92/89 3:15d1eca6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_26:head v 92'4, mlcod=75'2)", 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.673780+0000", 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0080559250000000002, 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080949549999999992, 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.673780+0000", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.673780+0000", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:47.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.673782+0000", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9690000000000001e-06 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.679863+0000", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006081487 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.679886+0000", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2857000000000002e-05 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:47.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.679899+0000", 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3043e-05 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.679988+0000", 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8771999999999996e-05 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.680007+0000", 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9758e-05 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:47.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:47.686 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:56:47.686 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-04-22T19:56:47.686 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:47.690 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:47.690 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:47.702 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:47.722 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:47.722 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:47.733 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:56:47.777 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:47.778 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:47.778 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:47.773+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:47.817 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:47.817 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:47.869 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:47.870 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:47.878 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:47.877+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:47.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:47.979 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:47.977+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.629900681000002, 2024-04-22T19:56:48.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:48.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:48.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.598999245000002, 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.079 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:48.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:48.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.526624083999998, 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.085 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:48.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2262 3.37 3:ed8b2b14:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.091 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.270942460000001, 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015263897, 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2262 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:48.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800391+0000", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.800395+0000", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8489999999999999e-06 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802740+0000", 2024-04-22T19:56:48.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023454230000000001 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802767+0000", 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7129000000000001e-05 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802781+0000", 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.381e-05 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.802877+0000", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5506000000000003e-05 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803053+0000", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000176718 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.803214+0000", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016006500000000001 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.812100+0000", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088860469999999993 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815531+0000", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034318669999999999 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815600+0000", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8905000000000005e-05 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.815655+0000", 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4577999999999998e-05 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2270 3.9 e75/20 3:913e931f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_79:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.183058062000001, 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014069467, 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888275+0000", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.888277+0000", 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8700000000000001e-06 2024-04-22T19:56:48.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892702+0000", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044243420000000004 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892729+0000", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7525000000000002e-05 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892743+0000", 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.416e-05 2024-04-22T19:56:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892822+0000", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8388999999999998e-05 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.892848+0000", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6441e-05 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902286+0000", 2024-04-22T19:56:48.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094381510000000005 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.902345+0000", 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8588999999999998e-05 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.132351489999998, 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:48.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2295 3.3b e75/20 3:df7e9e21:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_104:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.918508426000002, 2024-04-22T19:56:48.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014042288, 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152825+0000", 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.152835+0000", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7140000000000005e-06 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156743+0000", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084840000000003 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156770+0000", 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6305999999999999e-05 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156782+0000", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2605e-05 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156857+0000", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5238e-05 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.156877+0000", 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9468999999999999e-05 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166825+0000", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099478899999999992 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.166867+0000", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2582e-05 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:48.109 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.695058412000002, 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:48.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:48.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:48.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:48.114 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.528524382999997, 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:48.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2349 3.27 3:e69aba77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.355410628000001, 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015070930999999999, 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.121 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2349 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715923+0000", 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.715926+0000", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0429999999999999e-06 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718239+0000", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023127740000000001 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718267+0000", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718281+0000", 2024-04-22T19:56:48.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3913e-05 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718367+0000", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5824999999999999e-05 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718543+0000", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000175985 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.718722+0000", 2024-04-22T19:56:48.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017876599999999999 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.727780+0000", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090579719999999992 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730887+0000", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031073630000000001 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730930+0000", 2024-04-22T19:56:48.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3247000000000001e-05 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.730994+0000", 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3406999999999998e-05 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2354 3.2e 3:75168009:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.306041880999999, 2024-04-22T19:56:48.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013790066, 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2354 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765292+0000", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.765294+0000", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2560000000000001e-06 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766753+0000", 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014591389999999999 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766783+0000", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550999999999999e-05 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766793+0000", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0665e-05 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.766866+0000", 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2999999999999999e-05 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767002+0000", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135561 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.767096+0000", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3902999999999999e-05 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.772586+0000", 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054899889999999998 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.778995+0000", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064092730000000001 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779042+0000", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7017000000000001e-05 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.779082+0000", 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9712000000000002e-05 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2355 3.9 e76/20 3:9303af05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_164:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.290748714999999, 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015165445, 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780585+0000", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.780586+0000", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.17e-06 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785645+0000", 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050587050000000001 2024-04-22T19:56:48.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785676+0000", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1853999999999997e-05 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785692+0000", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785774+0000", 2024-04-22T19:56:48.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2193000000000004e-05 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.785801+0000", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6655000000000001e-05 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795682+0000", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098813749999999995 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.795750+0000", 2024-04-22T19:56:48.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8011999999999999e-05 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.088418789999999, 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.136 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:48.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:48.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.795892360000003, 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.141 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:48.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:48.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.146 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2398 3.2d e76/20 3:b78c8b50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_207:head v 76'3, mlcod=75'1)", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.699232821999999, 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013856109, 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372101+0000", 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.372103+0000", 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7810000000000001e-06 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376334+0000", 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004230368 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376375+0000", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1043e-05 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376394+0000", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9386999999999999e-05 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376542+0000", 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014801300000000001 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.376585+0000", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2469999999999998e-05 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385821+0000", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092366589999999995 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.385957+0000", 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013538800000000001 2024-04-22T19:56:48.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.565482305000003, 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:48.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2426 3.2e 3:75868e42:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:48.156 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.304467240999998, 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572174, 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2426 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766866+0000", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766869+0000", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7920000000000001e-06 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769331+0000", 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024615650000000002 2024-04-22T19:56:48.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769366+0000", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5466000000000002e-05 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769382+0000", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5960999999999998e-05 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769474+0000", 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1580000000000001e-05 2024-04-22T19:56:48.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769641+0000", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016693200000000001 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.769793+0000", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015276299999999999 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.777202+0000", 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074088019999999999 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781296+0000", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040942360000000002 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781376+0000", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9552e-05 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.781438+0000", 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2525000000000002e-05 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2681 3.2f 3:f5a309e5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.364247298, 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570364000000001, 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2681 2024-04-22T19:56:48.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707089+0000", 2024-04-22T19:56:48.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1379999999999999e-06 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708576+0000", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014865449999999999 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708613+0000", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7415e-05 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708628+0000", 2024-04-22T19:56:48.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4817000000000001e-05 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708716+0000", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8201000000000005e-05 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708933+0000", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217178 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.709114+0000", 2024-04-22T19:56:48.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018043599999999999 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.715476+0000", 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063621299999999997 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723574+0000", 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080981290000000008 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723616+0000", 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1409000000000003e-05 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723657+0000", 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0966e-05 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2695 3.2e 3:74fd567c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.20763134, 2024-04-22T19:56:48.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015985966000000001, 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2695 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863705+0000", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9179999999999998e-06 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865122+0000", 2024-04-22T19:56:48.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014173479999999999 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865155+0000", 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3077000000000002e-05 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865170+0000", 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4337e-05 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865255+0000", 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5378999999999997e-05 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865362+0000", 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010717000000000001 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865460+0000", 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7485000000000006e-05 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.873200+0000", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077403089999999999 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879565+0000", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063644360000000002 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879635+0000", 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0312e-05 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879688+0000", 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3195000000000001e-05 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2698 3.2f 3:f41a50d2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.17528292000000001, 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021500624999999999, 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.173 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2698 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896054+0000", 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4070000000000002e-06 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897731+0000", 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001677373 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897757+0000", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5320000000000002e-05 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897767+0000", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0601000000000001e-05 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897831+0000", 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3792000000000002e-05 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897974+0000", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014317799999999999 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.898075+0000", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010082900000000001 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.904482+0000", 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064069060000000004 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917373+0000", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012891316999999999 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917470+0000", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6773000000000003e-05 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917551+0000", 2024-04-22T19:56:48.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1129000000000002e-05 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.179 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:48.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:48.181 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:48.177+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:48.281 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:48.277+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:48.342 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:48.342 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:48.342 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:48.342 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:48.358 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:48.382 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:48.381+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:48.482 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:48.477+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:48.535 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:48.535 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:48.535 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:48.535 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:48.535 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:48.553 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:48.595 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:48.593+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:48.684 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:48.681+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.219826206999997, 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.084027828000004, 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.881310050000003, 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.619994146000003, 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:48.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:48.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.560847901999999, 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:48.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.461489020000002, 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:48.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:48.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:48.781 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.317645353000003, 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.268804101999997, 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:48.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.211070634999999, 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:48.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:48.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:48.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.119428726999999, 2024-04-22T19:56:48.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:48.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.721522206000003, 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.803 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.670829957999999, 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.809 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:48.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:48.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.401258202000001, 2024-04-22T19:56:48.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:48.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:48.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.317620448, 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:48.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:48.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.281078379999997, 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:48.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:48.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.216040251000003, 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.834 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:48.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:48.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.198304245999999, 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.840 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:48.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:48.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:48.845 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.031472532000002, 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:48.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:48.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.849 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.026275282, 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.850 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:48.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:48.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.988027770999999, 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:48.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:48.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:48.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:48.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:48.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:48.861 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:48.863 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:48.863 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:48.861+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:48.964 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:48.961+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:49.010 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:49.010 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:49.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2809 3.9 3:9104ff12:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.999245+0000", 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.012030904, 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012109062, 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "waiting for sub ops", 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2809 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.999245+0000", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.999245+0000", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.999248+0000", 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3369999999999998e-06 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003602+0000", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043539060000000003 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003649+0000", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7023e-05 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003678+0000", 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8826000000000001e-05 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003778+0000", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100314 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003893+0000", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011514300000000001 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.003991+0000", 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.014 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.015 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-04-22T19:56:49.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 1 2024-04-22T19:56:49.015 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:49.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:49.073 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:49.073+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:49.165 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:49.161+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:49.201 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:49.201 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:49.201 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:49.202 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:49.202 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:49.215 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:49.266 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:49.261+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:49.366 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:49.365+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.399 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.083030393999998, 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.133493547, 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:49.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:49.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:49.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2234 3.1a 3:5bc12377:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.888483332, 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021079243000000001, 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510116+0000", 2024-04-22T19:56:49.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.510120+0000", 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514283+0000", 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041627849999999996 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514319+0000", 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6279000000000003e-05 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514337+0000", 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000002e-05 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514465+0000", 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012822500000000001 2024-04-22T19:56:49.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.514759+0000", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029401200000000002 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.515064+0000", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000305369 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.529369+0000", 2024-04-22T19:56:49.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014304546 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.530884+0000", 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015148340000000001 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531063+0000", 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179144 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.531195+0000", 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013279200000000001 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.775414366, 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.416 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:49.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:49.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:49.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.145654968000002, 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.422 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:49.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.650907650999997, 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:49.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:49.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:49.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 36.690459816000001, 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.437 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2682 3.15 e92/89 3:a9094df8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_31:head v 92'8, mlcod=77'6)", 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6752700869999999, 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031839320999999997, 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723332+0000", 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4040000000000002e-06 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727108+0000", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003776101 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727152+0000", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3853000000000002e-05 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727176+0000", 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4375999999999998e-05 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727314+0000", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001373 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727369+0000", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5429000000000001e-05 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.754987+0000", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027617561999999998 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755169+0000", 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182296 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2683 3.1c e92/20 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head v 92'9, mlcod=77'7)", 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6647582409999999, 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042764414000000001, 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.442 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733845+0000", 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.54e-06 2024-04-22T19:56:49.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738419+0000", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004573672 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738451+0000", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2351999999999998e-05 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738472+0000", 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1290000000000001e-05 2024-04-22T19:56:49.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738861+0000", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038872499999999998 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738931+0000", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0401999999999994e-05 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776388+0000", 2024-04-22T19:56:49.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.037456697999999997 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776606+0000", 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021773499999999999 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2684 3.2c e92/20 3:3779f477:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_33:head v 92'7, mlcod=75'5)", 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.649289722, 2024-04-22T19:56:49.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032945639999999998, 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:49.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749312+0000", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.553e-06 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755415+0000", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061026170000000003 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755448+0000", 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3195999999999999e-05 2024-04-22T19:56:49.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755470+0000", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1302999999999999e-05 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757104+0000", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016341859999999999 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757158+0000", 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4008999999999997e-05 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782135+0000", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024977428999999999 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782255+0000", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120347 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2687 3.1d e93/20 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head v 93'3, mlcod=75'1)", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:49.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.6146803360000002, 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028276740000000002, 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:49.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783921+0000", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.623e-06 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787256+0000", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033348739999999998 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787293+0000", 2024-04-22T19:56:49.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6933e-05 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787307+0000", 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4611e-05 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787412+0000", 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787451+0000", 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8930999999999997e-05 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812092+0000", 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024640704999999999 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812196+0000", 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010401200000000001 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2703 3.1a 3:5b28f2e9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.454262443, 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026147159, 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2703 2024-04-22T19:56:49.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944340+0000", 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5569999999999998e-06 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948297+0000", 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039573480000000003 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948332+0000", 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4836000000000003e-05 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948350+0000", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7782999999999999e-05 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948554+0000", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020403199999999999 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948796+0000", 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024245899999999999 2024-04-22T19:56:49.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.949034+0000", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238318 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970082+0000", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021047184 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970222+0000", 2024-04-22T19:56:49.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014042699999999999 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970360+0000", 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819400000000001 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970484+0000", 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012402100000000001 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2706 3.1d e93/20 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head v 93'4, mlcod=75'2)", 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.4171041259999999, 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022188887000000001, 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981498+0000", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2340000000000001e-06 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984756+0000", 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003258305 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984790+0000", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3665999999999999e-05 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984806+0000", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6079999999999999e-05 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984949+0000", 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014278399999999999 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.985011+0000", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2419e-05 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003568+0000", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018556919000000002 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003684+0000", 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011648 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.464 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2707 3.23 e93/89 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head v 93'3, mlcod=76'1)", 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.987396+0000", 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.4112033880000001, 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020831160000000001, 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.987396+0000", 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.987396+0000", 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.987397+0000", 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7000000000000003e-07 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.991438+0000", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040404280000000004 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.991465+0000", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7231000000000001e-05 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.991479+0000", 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4323e-05 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.991663+0000", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000184303 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.991732+0000", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8422000000000003e-05 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.008083+0000", 2024-04-22T19:56:49.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016351562 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.008227+0000", 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014392100000000001 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2714 3.31 e93/20 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.3335036630000001, 2024-04-22T19:56:49.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021717826999999999, 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065099+0000", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069899+0000", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048002169999999999 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069934+0000", 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4792999999999997e-05 2024-04-22T19:56:49.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069950+0000", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070089+0000", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013934099999999999 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070130+0000", 2024-04-22T19:56:49.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0682000000000001e-05 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086720+0000", 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016589567 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086814+0000", 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4180999999999998e-05 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2774 3.15 e93/89 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head v 93'9, mlcod=77'7)", 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.76212855199999996, 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022494369, 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:49.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636473+0000", 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640260+0000", 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037869029999999999 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640304+0000", 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3809e-05 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640328+0000", 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3796000000000001e-05 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640477+0000", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014879300000000001 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640535+0000", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8613000000000003e-05 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658748+0000", 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018212569000000001 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658965+0000", 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217536 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2775 3.3 3:c2d90fc7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.639839+0000", 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.758760251, 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021228776000000001, 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2775 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.639839+0000", 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.639839+0000", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.639844+0000", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.644077+0000", 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042328380000000001 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.644130+0000", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3485e-05 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.644161+0000", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0352999999999999e-05 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.644329+0000", 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016837699999999999 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.644775+0000", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044591200000000002 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.645202+0000", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000426582 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659347+0000", 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014145771 2024-04-22T19:56:49.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660650+0000", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013024250000000001 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660817+0000", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000166887 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.661068+0000", 2024-04-22T19:56:49.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000251353 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2787 3.e e93/20 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head v 93'5, mlcod=76'3)", 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.63575892599999995, 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026224332, 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762843+0000", 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7e-06 2024-04-22T19:56:49.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767730+0000", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048870980000000003 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767769+0000", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8327000000000001e-05 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767786+0000", 2024-04-22T19:56:49.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7657000000000001e-05 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767961+0000", 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017417800000000001 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.768029+0000", 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8769000000000005e-05 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.788969+0000", 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020939859000000002 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789065+0000", 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5743999999999997e-05 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2789 3.a e93/20 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:49.488 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.61633900900000005, 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031890114999999997, 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782263+0000", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4260000000000002e-06 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789623+0000", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073601609999999996 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789648+0000", 2024-04-22T19:56:49.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5085000000000001e-05 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789665+0000", 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7062e-05 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789780+0000", 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114287 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789821+0000", 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1609000000000001e-05 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814068+0000", 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02424728 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814151+0000", 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2205000000000003e-05 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2794 3.24 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.56990895600000002, 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029467394000000001, 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2794 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828694+0000", 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0759999999999999e-06 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835121+0000", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064273400000000001 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835164+0000", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2876000000000001e-05 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835183+0000", 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9259e-05 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835387+0000", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020336700000000001 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835709+0000", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032233700000000001 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.836065+0000", 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035655700000000002 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.846931+0000", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010865649999999999 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858029+0000", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011097721 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858102+0000", 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2970000000000001e-05 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:49.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858158+0000", 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:49.498 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:49.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:49.500 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:49.497+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:49.600 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:49.597+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:49.688 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:49.689 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:49.689 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:49.689 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:49.701 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:49.701+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:49.704 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:49.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:56:49.801 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:49.801+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:49.843 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:49.876 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:49.876 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:49.876 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:49.876 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:49.876 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:49.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:49.902 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:49.897+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:50.003 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:49.997+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:50.065 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:50.065 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.447617328, 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.082 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:50.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.437371151999997, 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.088 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:50.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:50.092 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.657671104999999, 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.384477920000002, 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.098 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:50.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.103 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.22227642, 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.104 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.3530011470000001, 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:56:50.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:56:50.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:56:50.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:56:50.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.3030674790000001, 2024-04-22T19:56:50.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:56:50.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:56:50.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:56:50.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.120 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.2263743279999999, 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:50.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:56:50.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.126 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.1054232169999998, 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:56:50.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:56:50.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:56:50.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:56:50.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2712 3.2a 3:55e3face:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.0371115039999999, 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021790146, 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2712 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043633+0000", 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4200000000000001e-06 2024-04-22T19:56:50.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048847+0000", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052140729999999996 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048873+0000", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6092999999999999e-05 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048890+0000", 2024-04-22T19:56:50.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6626e-05 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049044+0000", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015450699999999999 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049359+0000", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514500000000002 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049591+0000", 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023134100000000001 2024-04-22T19:56:50.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057839+0000", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082482000000000007 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065236+0000", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007396835 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065349+0000", 2024-04-22T19:56:50.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113584 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065421+0000", 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1322000000000006e-05 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.639381631, 2024-04-22T19:56:50.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.142 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.586328111, 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.143 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:56:50.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:56:50.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:50.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.148 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.4813741920000001, 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:50.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:56:50.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.154 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.3133715800000001, 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:56:50.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:56:50.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:56:50.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:56:50.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.2955497030000001, 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:56:50.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.22131978, 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:56:50.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:50.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.0918959159999999, 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:56:50.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:50.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:50.177 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.89718986099999998, 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:56:50.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.183 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2843 3.22 3:4565b493:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.42162195899999999, 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021451708, 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2843 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659123+0000", 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663577+0000", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044546530000000003 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663621+0000", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3359000000000003e-05 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663639+0000", 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:50.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663785+0000", 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146312 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664120+0000", 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033481100000000002 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:50.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664441+0000", 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032131100000000001 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.675438+0000", 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010996634 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680327+0000", 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048891380000000003 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680462+0000", 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134917 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680572+0000", 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010953799999999999 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:50.189 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.241578669, 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:50.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:50.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:50.195 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:50.196 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:50.196 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:50.197 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:50.197 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:50.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:50.198 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:50.193+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:50.199 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:50.199 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:50.199 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:50.199 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:50.200 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:50.200 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:50.204 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:50.204 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:50.225 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:50.225 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:50.297 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:50.293+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:50.384 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:50.385 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:50.398 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:50.397+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:50.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:50.498 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:50.493+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:50.572 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:50.572 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:50.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:50.615 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 1Gb. 2024-04-22T19:56:50.615 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:56:50.615 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:50.615 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-22T19:56:50.615 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:56:50.633 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:50.633+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:50.699 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:50.697+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:50.711 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:50.711 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:50.728 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:50.767 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:56:50.817 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:50.817+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:50.851 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:56:50.851 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:56:50.898 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:50.898 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:50.902 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:50.901+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:50.913 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:51.003 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:51.001+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:51.078 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.078 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.092 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:51.134 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:51.133+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:51.204 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:51.201+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:51.260 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.260 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.275 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:51.319 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:51.317+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:51.400 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.400 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.406 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:51.405+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:51.416 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:51.507 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:51.505+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:51.588 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.588 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.605 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:51.609 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:51.605+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:51.710 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:51.705+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:51.769 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.770 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:51.810 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:51.809+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:51.911 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:51.905+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:51.949 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:51.949 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:51.965 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:52.012 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:52.009+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:52.112 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:52.109+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:52.124 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:52.124 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:52.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:52.235 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:52.233+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:52.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:52.303 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:52.303 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:52.314 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:52.309+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:52.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:52.394 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:52.394 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:52.410 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:52.410 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:52.415 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:52.409+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:52.426 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:52.427 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:52.442 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:52.442 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:52.461 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:52.461 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:52.474 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:52.474 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:52.474 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:52.474 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:52.481 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:52.481 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:52.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:52.501 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:52.502 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:52.523 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:52.523 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:52.523 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:52.521+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:52.609 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:52.609 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:52.609 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:52.609 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:52.609 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:52.616 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:52.613+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:52.621 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:52.717 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:52.713+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:52.788 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.349448580999997, 2024-04-22T19:56:52.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:56:52.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.318547144999997, 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:56:52.800 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:56:52.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.246171984, 2024-04-22T19:56:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.85189939, 2024-04-22T19:56:52.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.816 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.414606311999997, 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:52.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:56:52.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:56:52.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.248072282999999, 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.822 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:56:52.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:56:52.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:56:52.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:56:52.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.807966690000001, 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:56:52.828 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:56:52.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.515440259999998, 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.834 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:56:52.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:56:52.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:56:52.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.285030204999998, 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:56:52.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:56:52.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:56:52.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2681 3.2f 3:f5a309e5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.0837951979999998, 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570364000000001, 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2681 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.846 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707086+0000", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.707089+0000", 2024-04-22T19:56:52.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1379999999999999e-06 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708576+0000", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014865449999999999 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708613+0000", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7415e-05 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708628+0000", 2024-04-22T19:56:52.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4817000000000001e-05 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708716+0000", 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8201000000000005e-05 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.708933+0000", 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000217178 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.709114+0000", 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018043599999999999 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.715476+0000", 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063621299999999997 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723574+0000", 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080981290000000008 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723616+0000", 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1409000000000003e-05 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.723657+0000", 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0966e-05 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2695 3.2e 3:74fd567c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.9271792400000001, 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015985966000000001, 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2695 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:52.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863702+0000", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.863705+0000", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9179999999999998e-06 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865122+0000", 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014173479999999999 2024-04-22T19:56:52.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865155+0000", 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3077000000000002e-05 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865170+0000", 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4337e-05 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865255+0000", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5378999999999997e-05 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865362+0000", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010717000000000001 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.865460+0000", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7485000000000006e-05 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.873200+0000", 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077403089999999999 2024-04-22T19:56:52.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879565+0000", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063644360000000002 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879635+0000", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0312e-05 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.879688+0000", 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3195000000000001e-05 2024-04-22T19:56:52.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2698 3.2f 3:f41a50d2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.8948308200000001, 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021500624999999999, 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.857 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2698 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896054+0000", 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4070000000000002e-06 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897731+0000", 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001677373 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897757+0000", 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5320000000000002e-05 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897767+0000", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0601000000000001e-05 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897831+0000", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3792000000000002e-05 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897974+0000", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014317799999999999 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.898075+0000", 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010082900000000001 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.904482+0000", 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064069060000000004 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917373+0000", 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012891316999999999 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917470+0000", 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6773000000000003e-05 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917551+0000", 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1129000000000002e-05 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2719 3.2e 3:74fbf0ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.677359139, 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017402009999999999, 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2719 2024-04-22T19:56:52.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.865 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:56:52.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113526+0000", 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4079999999999998e-06 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116022+0000", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024959040000000002 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116051+0000", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9099999999999999e-05 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116066+0000", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5158e-05 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116194+0000", 2024-04-22T19:56:52.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793400000000001 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116432+0000", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023872100000000001 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116604+0000", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017193500000000001 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.123935+0000", 2024-04-22T19:56:52.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073304930000000004 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130792+0000", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068571559999999997 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130857+0000", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4929000000000001e-05 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130924+0000", 2024-04-22T19:56:52.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7272000000000002e-05 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2751 3.5 e93/89 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head v 93'4, mlcod=76'2)", 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.289899524, 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018490064, 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.870 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500993+0000", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0903e-05 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505906+0000", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049134399999999998 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505929+0000", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3059000000000001e-05 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505940+0000", 2024-04-22T19:56:52.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0356e-05 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505995+0000", 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5452999999999999e-05 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506013+0000", 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8298e-05 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.519379+0000", 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013365432 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.519472+0000", 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3122999999999996e-05 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2792 3.4 e93/20 3:20cf0ea2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_131:head v 93'9, mlcod=93'7)", 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.806809+0000", 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.984071954, 2024-04-22T19:56:52.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017040177, 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806809+0000", 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806809+0000", 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806811+0000", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9460000000000001e-06 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.809667+0000", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028554779999999998 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.809693+0000", 2024-04-22T19:56:52.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6052999999999999e-05 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.809707+0000", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3879e-05 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.809785+0000", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8151000000000004e-05 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.809813+0000", 2024-04-22T19:56:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7736e-05 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823796+0000", 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013983786999999999 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823850+0000", 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3146999999999998e-05 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2793 3.2f 3:f78624fc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9720501179999999, 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020778125000000001, 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2793 2024-04-22T19:56:52.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818834+0000", 2024-04-22T19:56:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820707+0000", 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001873612 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820737+0000", 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9379000000000001e-05 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820749+0000", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2045000000000001e-05 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820826+0000", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7217000000000003e-05 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820939+0000", 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001132 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.821048+0000", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108346 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.826602+0000", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055548079999999996 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839518+0000", 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012915908 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839559+0000", 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0311000000000001e-05 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839609+0000", 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0668999999999999e-05 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.884 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2821 3.3d e93/20 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head v 93'4, mlcod=92'2)", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.5793338239999999, 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020536564, 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211550+0000", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8729999999999999e-06 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215215+0000", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036646729999999998 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215253+0000", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7438999999999998e-05 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215270+0000", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7552999999999999e-05 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215405+0000", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134492 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215444+0000", 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9523000000000001e-05 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.231920+0000", 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016475447000000001 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232084+0000", 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016456399999999999 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2844 3.1e e93/89 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head v 93'9, mlcod=77'7)", 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.1055135150000002, 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017882711999999999, 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685371+0000", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3830000000000001e-06 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692780+0000", 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074083359999999997 2024-04-22T19:56:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692819+0000", 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9378999999999997e-05 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692838+0000", 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8717000000000001e-05 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692971+0000", 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013354400000000001 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.693008+0000", 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6770000000000002e-05 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.703100+0000", 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010091961 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.703251+0000", 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000150622 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2855 3.2f 3:f6f2b6a8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.859918+0000", 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.9309636919999997, 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016296657999999999, 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2855 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.859918+0000", 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.859918+0000", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.859921+0000", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5130000000000001e-06 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862339+0000", 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00241735 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862362+0000", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3719000000000001e-05 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862373+0000", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862458+0000", 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4648999999999995e-05 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862662+0000", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020357200000000001 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.862873+0000", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021175799999999999 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.867637+0000", 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047636149999999997 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.876079+0000", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084420899999999993 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.876152+0000", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3196999999999997e-05 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.876214+0000", 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2063999999999994e-05 2024-04-22T19:56:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2863 3.2e 3:779cdc9f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.8383037939999998, 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018555156, 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2863 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952580+0000", 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953897+0000", 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013164940000000001 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953929+0000", 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2506999999999999e-05 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953945+0000", 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6055000000000001e-05 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954048+0000", 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102167 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954175+0000", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012748499999999999 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954289+0000", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114183 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963999+0000", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097093709999999996 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.970984+0000", 2024-04-22T19:56:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069854069999999999 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971069+0000", 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4777999999999994e-05 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971133+0000", 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3983e-05 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:52.905 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:52.906 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:52.906 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:52.901+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:53.006 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:53.001+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:53.059 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:53.059 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:56:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:53.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:53.115 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:53.113+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:53.208 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:53.205+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:53.230 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:53.230 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:53.231 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:53.231 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:53.231 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:53.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:53.309 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:53.309+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:53.369 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:53.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.841061349, 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:53.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:53.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.70526297, 2024-04-22T19:56:53.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:53.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:53.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.502545191999999, 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:53.384 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:53.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:53.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:53.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.241229288, 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:53.391 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:53.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:53.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:53.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.182083044000002, 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:53.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:53.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.082724161999998, 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:53.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.938880494999999, 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:53.413 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:53.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:53.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:53.418 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.890039244, 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:53.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:53.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.832305777000002, 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.426 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:53.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:53.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:53.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.740663869000002, 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.433 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:53.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:53.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:53.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.342757347999999, 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:53.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:53.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:53.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.292065100000002, 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:53.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:53.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:53.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.453 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.022493343999997, 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:53.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:53.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:53.460 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.938855590000003, 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:53.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.902313522, 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.468 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:53.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:53.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.837275392999999, 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:53.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:53.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:53.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.819539388000003, 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.482 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:53.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:53.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:53.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:53.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.652707673999998, 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:53.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.647510424000004, 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.609262913000002, 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:53.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:53.509 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:53.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:53.511 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:53.505+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:53.612 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:53.609+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:53.644 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:53.644 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:53.644 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:53.644 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:53.658 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:53.713 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:53.709+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:53.780 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:56:53.781 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:53.781 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:53.781 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:53.781 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:53.781 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:53.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:53.847 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:53.845+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:53.914 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:53.913+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:53.920 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:53.920 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:53.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.604241493000004, 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:53.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 55.654704645999999, 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.926 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:53.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.933 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.296625464999998, 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.934 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:53.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:53.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:53.941 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.666866067000001, 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:53.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.172118750000003, 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.946 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:53.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.211670914999999, 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.952 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:53.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2682 3.15 e92/89 3:a9094df8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_31:head v 92'8, mlcod=77'6)", 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1964811859999998, 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031839320999999997, 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723332+0000", 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4040000000000002e-06 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727108+0000", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003776101 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727152+0000", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3853000000000002e-05 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727176+0000", 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4375999999999998e-05 2024-04-22T19:56:53.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727314+0000", 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001373 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727369+0000", 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5429000000000001e-05 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.754987+0000", 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027617561999999998 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755169+0000", 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182296 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2683 3.1c e92/20 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head v 92'9, mlcod=77'7)", 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1859693399999998, 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042764414000000001, 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733845+0000", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.54e-06 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738419+0000", 2024-04-22T19:56:53.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004573672 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738451+0000", 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2351999999999998e-05 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738472+0000", 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1290000000000001e-05 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738861+0000", 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038872499999999998 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738931+0000", 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0401999999999994e-05 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776388+0000", 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.037456697999999997 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776606+0000", 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021773499999999999 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2684 3.2c e92/20 3:3779f477:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_33:head v 92'7, mlcod=75'5)", 2024-04-22T19:56:53.968 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1705008210000001, 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032945639999999998, 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749312+0000", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.553e-06 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755415+0000", 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061026170000000003 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755448+0000", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3195999999999999e-05 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755470+0000", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1302999999999999e-05 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757104+0000", 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016341859999999999 2024-04-22T19:56:53.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757158+0000", 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4008999999999997e-05 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782135+0000", 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024977428999999999 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782255+0000", 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120347 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2687 3.1d e93/20 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head v 93'3, mlcod=75'1)", 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1358914349999996, 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028276740000000002, 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.973 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783921+0000", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.623e-06 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787256+0000", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033348739999999998 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787293+0000", 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6933e-05 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787307+0000", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4611e-05 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787412+0000", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787451+0000", 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8930999999999997e-05 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812092+0000", 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024640704999999999 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812196+0000", 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010401200000000001 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2703 3.1a 3:5b28f2e9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.9754735419999996, 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026147159, 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2703 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944340+0000", 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5569999999999998e-06 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948297+0000", 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039573480000000003 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948332+0000", 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4836000000000003e-05 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948350+0000", 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7782999999999999e-05 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948554+0000", 2024-04-22T19:56:53.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020403199999999999 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948796+0000", 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024245899999999999 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.949034+0000", 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238318 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970082+0000", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021047184 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970222+0000", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014042699999999999 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970360+0000", 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819400000000001 2024-04-22T19:56:53.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970484+0000", 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012402100000000001 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2706 3.1d e93/20 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head v 93'4, mlcod=75'2)", 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.9383152250000002, 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022188887000000001, 2024-04-22T19:56:53.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981498+0000", 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2340000000000001e-06 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984756+0000", 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003258305 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984790+0000", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3665999999999999e-05 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984806+0000", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6079999999999999e-05 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984949+0000", 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014278399999999999 2024-04-22T19:56:53.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.985011+0000", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2419e-05 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003568+0000", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018556919000000002 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003684+0000", 2024-04-22T19:56:53.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011648 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2714 3.31 e93/20 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8547147620000004, 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021717826999999999, 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065099+0000", 2024-04-22T19:56:53.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069899+0000", 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048002169999999999 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069934+0000", 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4792999999999997e-05 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069950+0000", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070089+0000", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013934099999999999 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070130+0000", 2024-04-22T19:56:53.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0682000000000001e-05 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086720+0000", 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016589567 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086814+0000", 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4180999999999998e-05 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.993 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2774 3.15 e93/89 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head v 93'9, mlcod=77'7)", 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2833396510000004, 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022494369, 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636473+0000", 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640260+0000", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037869029999999999 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640304+0000", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3809e-05 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640328+0000", 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3796000000000001e-05 2024-04-22T19:56:53.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640477+0000", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014879300000000001 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640535+0000", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8613000000000003e-05 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658748+0000", 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018212569000000001 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658965+0000", 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217536 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2787 3.e e93/20 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head v 93'5, mlcod=76'3)", 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.1569700249999997, 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026224332, 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:53.998 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:53.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762843+0000", 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7e-06 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767730+0000", 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048870980000000003 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767769+0000", 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8327000000000001e-05 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767786+0000", 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7657000000000001e-05 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767961+0000", 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017417800000000001 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.768029+0000", 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8769000000000005e-05 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.788969+0000", 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020939859000000002 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789065+0000", 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5743999999999997e-05 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2789 3.a e93/20 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.1375501080000001, 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031890114999999997, 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.003 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:54.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782263+0000", 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4260000000000002e-06 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789623+0000", 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073601609999999996 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789648+0000", 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5085000000000001e-05 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789665+0000", 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7062e-05 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789780+0000", 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114287 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789821+0000", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1609000000000001e-05 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814068+0000", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02424728 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814151+0000", 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2205000000000003e-05 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.008 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2794 3.24 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0911200550000002, 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029467394000000001, 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.009 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2794 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828694+0000", 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0759999999999999e-06 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835121+0000", 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064273400000000001 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835164+0000", 2024-04-22T19:56:54.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2876000000000001e-05 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835183+0000", 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9259e-05 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835387+0000", 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020336700000000001 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835709+0000", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032233700000000001 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.836065+0000", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035655700000000002 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.846931+0000", 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010865649999999999 2024-04-22T19:56:54.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858029+0000", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011097721 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858102+0000", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2970000000000001e-05 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858158+0000", 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:56:54.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2848 3.29 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.1463399519999999, 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026007142, 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2848 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773479+0000", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1710000000000002e-06 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777520+0000", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040408550000000003 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777545+0000", 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5296e-05 2024-04-22T19:56:54.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777555+0000", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777661+0000", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105301 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777906+0000", 2024-04-22T19:56:54.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024572500000000002 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.778135+0000", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022820199999999999 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.793572+0000", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015437227 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799393+0000", 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058216370000000002 2024-04-22T19:56:54.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799441+0000", 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7120999999999998e-05 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799478+0000", 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7285e-05 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2862 3.24 3:24dfaea7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.9791109950000001, 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023981771999999998, 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2862 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940703+0000", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.253e-06 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945051+0000", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004348251 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945083+0000", 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1897000000000003e-05 2024-04-22T19:56:54.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945103+0000", 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9579e-05 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945180+0000", 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7455999999999998e-05 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945299+0000", 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011882 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945399+0000", 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9591000000000002e-05 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.952733+0000", 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073344789999999997 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964552+0000", 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011818777000000001 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964625+0000", 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2748000000000002e-05 2024-04-22T19:56:54.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964681+0000", 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6920999999999999e-05 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2866 3.24 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.933322939, 2024-04-22T19:56:54.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028710040999999999, 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2866 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986496+0000", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5490000000000006e-06 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990351+0000", 2024-04-22T19:56:54.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038546040000000002 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990378+0000", 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7152999999999999e-05 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990389+0000", 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0533000000000001e-05 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990471+0000", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2395e-05 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990613+0000", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142115 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990730+0000", 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116711 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.998090+0000", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073602399999999997 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015088+0000", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016997844000000002 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015143+0000", 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4792e-05 2024-04-22T19:56:54.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015198+0000", 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105000000000002e-05 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.033 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:54.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:54.035 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:54.033+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:54.135 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:54.133+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:54.205 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:54.205 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:54.205 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:54.205 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:54.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:54.261 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:54.261+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:54.337 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:54.337+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:54.381 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:54.381 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:54.381 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:54.381 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:54.382 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:54.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:54.438 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:54.433+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:54.522 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.886358227000002, 2024-04-22T19:56:54.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:54.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:54.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:54.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:54.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.876112051, 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:54.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.096412004000001, 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:54.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.823218818999997, 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.548 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.549 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:56:54.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:56:54.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:56:54.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.661017319000003, 2024-04-22T19:56:54.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:56:54.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:56:54.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:56:54.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.7917420459999995, 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:56:54.566 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.567 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:56:54.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:56:54.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.741808378, 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:54.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:56:54.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6651152270000003, 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:56:54.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:56:54.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:56:54.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.5441641160000001, 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:56:54.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:56:54.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2712 3.2a 3:55e3face:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.4758524030000002, 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021790146, 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2712 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043633+0000", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4200000000000001e-06 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048847+0000", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052140729999999996 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048873+0000", 2024-04-22T19:56:54.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6092999999999999e-05 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048890+0000", 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6626e-05 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049044+0000", 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015450699999999999 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049359+0000", 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514500000000002 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049591+0000", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023134100000000001 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057839+0000", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082482000000000007 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065236+0000", 2024-04-22T19:56:54.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007396835 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065349+0000", 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113584 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065421+0000", 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1322000000000006e-05 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.0781225299999999, 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:56:54.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:56:54.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.0250690100000002, 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:56:54.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.9201150909999996, 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.620 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.625 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.752112479, 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:56:54.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:56:54.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7342906019999997, 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:54.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:56:54.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:56:54.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6600606789999999, 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:56:54.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:56:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:56:54.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.5306368150000003, 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:56:54.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:56:54.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3359307600000001, 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:56:54.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:56:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2843 3.22 3:4565b493:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.8603628580000002, 2024-04-22T19:56:54.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021451708, 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2843 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659123+0000", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663577+0000", 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044546530000000003 2024-04-22T19:56:54.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663621+0000", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3359000000000003e-05 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663639+0000", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663785+0000", 2024-04-22T19:56:54.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146312 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664120+0000", 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033481100000000002 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664441+0000", 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032131100000000001 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.675438+0000", 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010996634 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680327+0000", 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048891380000000003 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680462+0000", 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134917 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680572+0000", 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010953799999999999 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6803195679999998, 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:54.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:56:54.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:56:54.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:54.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:54.666 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:54.666 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:54.668 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:54.668 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:54.665+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:54.768 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:54.765+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:54.822 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:54.823 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:54.839 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:54.853 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:54.855 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:54.855 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:54.868 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:54.865+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:54.872 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:54.872 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:54.890 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:54.891 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:54.908 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:54.908 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:54.926 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:54.926 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:54.943 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:54.943 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:55.003 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:55.001+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:55.020 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.021 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:55.070 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:55.069+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:55.156 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.156 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:55.170 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:55.169+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:55.271 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:55.269+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:55.330 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.330 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:55.372 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:55.369+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:55.468 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.468 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.473 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:55.469+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:55.482 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:55.574 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:55.573+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:55.600 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.600 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.614 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:55.674 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:55.673+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:55.746 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.747 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:55.805 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:56:55.807 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:55.805+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:55.876 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:55.873+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:55.880 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:55.880 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:55.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:56:55.978 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:55.977+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:56.057 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.057 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:56:56.078 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:56.077+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:56.179 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:56.177+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:56.189 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.189 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.203 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:56:56.280 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:56.277+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:56.326 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.326 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:56:56.383 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:56.381+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:56.460 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.460 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.474 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:56:56.515 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:56.513+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:56.583 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:56.581+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.653 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:56:56.699 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:56.697+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:56.770 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.770 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:56:56.794 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:56:56.795 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:56.793+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:56.885 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:56.881+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:56.914 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:56.914 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:56.928 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:56:56.961 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:56:57.015 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:57.013+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:57.088 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:57.085+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:57.092 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:57.092 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:57.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:56:57.114 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:57.114 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:57.131 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:57.132 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:57.148 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:57.164 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:57.165 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:57.185 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:57.188 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:57.185+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:57.206 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:57.226 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:57.227 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:57.228 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:57.228 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:56:57.228 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:56:57.228 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:56:57.228 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:57.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:56:57.249 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:57.249 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:57.315 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:57.313+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:57.374 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:56:57.374 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.848151260000002, 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:56:57.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:56:57.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.712352881000001, 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:56:57.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.509635103000001, 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:56:57.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:56:57.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.248319199000001, 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:57.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.189172954999997, 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:56:57.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.089814072999999, 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:56:57.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:57.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.410 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.945970406000001, 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:56:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:56:57.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.897129155000002, 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:56:57.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:56:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.839395688000003, 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.421 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:56:57.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:56:57.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.747753779999996, 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:56:57.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:56:57.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.349847259000001, 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.433 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:56:57.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.299155011000003, 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.444 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.029583254999999, 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:56:57.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:56:57.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.945945500999997, 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.451 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:56:57.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:56:57.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.456 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.909403433000001, 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:56:57.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:56:57.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.844365304, 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:56:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:56:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:56:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.826629298999997, 2024-04-22T19:56:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:56:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:56:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.659797585, 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:56:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:56:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.654600334999998, 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:56:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.616352824000003, 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:56:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:56:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:56:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:56:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:56:57.491 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:56:57.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:56:57.493 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:57.489+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:57.594 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:57.589+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:57.626 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:57.626 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:57.626 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:57.627 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:57.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:56:57.695 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:57.689+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:57.763 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:57.763 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:57.763 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:57.763 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:57.763 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:57.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:56:57.821 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:57.821+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:57.896 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:57.893+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.587246896000003, 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.910 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 59.637710048999999, 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:56:57.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:56:57.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:57.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:57.917 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.279630867999998, 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:57.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:56:57.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 46.649871470000001, 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.923 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:56:57.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:56:57.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:56:57.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 46.155124153000003, 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.927 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:56:57.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:56:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:56:57.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.194676317999999, 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:56:57.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:56:57.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:56:57.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:56:57.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:56:57.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2682 3.15 e92/89 3:a9094df8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_31:head v 92'8, mlcod=77'6)", 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.179486589, 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031839320999999997, 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.938 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723332+0000", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4040000000000002e-06 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727108+0000", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003776101 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727152+0000", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3853000000000002e-05 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727176+0000", 2024-04-22T19:56:57.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4375999999999998e-05 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727314+0000", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001373 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727369+0000", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5429000000000001e-05 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.754987+0000", 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027617561999999998 2024-04-22T19:56:57.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755169+0000", 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182296 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2683 3.1c e92/20 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head v 92'9, mlcod=77'7)", 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.168974743, 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042764414000000001, 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.942 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733845+0000", 2024-04-22T19:56:57.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.54e-06 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738419+0000", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004573672 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738451+0000", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2351999999999998e-05 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738472+0000", 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1290000000000001e-05 2024-04-22T19:56:57.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738861+0000", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038872499999999998 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738931+0000", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0401999999999994e-05 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776388+0000", 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.037456697999999997 2024-04-22T19:56:57.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776606+0000", 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021773499999999999 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2684 3.2c e92/20 3:3779f477:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_33:head v 92'7, mlcod=75'5)", 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.153506223999999, 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032945639999999998, 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749312+0000", 2024-04-22T19:56:57.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.553e-06 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755415+0000", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061026170000000003 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755448+0000", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3195999999999999e-05 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755470+0000", 2024-04-22T19:56:57.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1302999999999999e-05 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757104+0000", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016341859999999999 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757158+0000", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4008999999999997e-05 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782135+0000", 2024-04-22T19:56:57.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024977428999999999 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782255+0000", 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120347 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2687 3.1d e93/20 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head v 93'3, mlcod=75'1)", 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.118896838, 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028276740000000002, 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.950 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783921+0000", 2024-04-22T19:56:57.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.623e-06 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787256+0000", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033348739999999998 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787293+0000", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6933e-05 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787307+0000", 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4611e-05 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787412+0000", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787451+0000", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8930999999999997e-05 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812092+0000", 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024640704999999999 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812196+0000", 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010401200000000001 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2703 3.1a 3:5b28f2e9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9584789449999995, 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026147159, 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2703 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944340+0000", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5569999999999998e-06 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948297+0000", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039573480000000003 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948332+0000", 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4836000000000003e-05 2024-04-22T19:56:57.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948350+0000", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7782999999999999e-05 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948554+0000", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020403199999999999 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948796+0000", 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024245899999999999 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.949034+0000", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238318 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970082+0000", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021047184 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970222+0000", 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014042699999999999 2024-04-22T19:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970360+0000", 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819400000000001 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970484+0000", 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012402100000000001 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2706 3.1d e93/20 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head v 93'4, mlcod=75'2)", 2024-04-22T19:56:57.959 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9213206280000001, 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022188887000000001, 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981498+0000", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2340000000000001e-06 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984756+0000", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003258305 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984790+0000", 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3665999999999999e-05 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984806+0000", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6079999999999999e-05 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984949+0000", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014278399999999999 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.985011+0000", 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2419e-05 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003568+0000", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018556919000000002 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003684+0000", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011648 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2714 3.31 e93/20 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:57.963 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8377201650000003, 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021717826999999999, 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065099+0000", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069899+0000", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048002169999999999 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069934+0000", 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4792999999999997e-05 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069950+0000", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070089+0000", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013934099999999999 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070130+0000", 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0682000000000001e-05 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086720+0000", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016589567 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086814+0000", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4180999999999998e-05 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2774 3.15 e93/89 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head v 93'9, mlcod=77'7)", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2663450540000003, 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022494369, 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636473+0000", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640260+0000", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037869029999999999 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640304+0000", 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3809e-05 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640328+0000", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3796000000000001e-05 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640477+0000", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014879300000000001 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640535+0000", 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8613000000000003e-05 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658748+0000", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018212569000000001 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658965+0000", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217536 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2787 3.e e93/20 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head v 93'5, mlcod=76'3)", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1399754279999996, 2024-04-22T19:56:57.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026224332, 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762843+0000", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7e-06 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767730+0000", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048870980000000003 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767769+0000", 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8327000000000001e-05 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767786+0000", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7657000000000001e-05 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767961+0000", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017417800000000001 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.768029+0000", 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8769000000000005e-05 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.788969+0000", 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020939859000000002 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789065+0000", 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5743999999999997e-05 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2789 3.a e93/20 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head v 93'7, mlcod=76'5)", 2024-04-22T19:56:57.975 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1205555109999992, 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031890114999999997, 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:56:57.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782263+0000", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4260000000000002e-06 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789623+0000", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073601609999999996 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789648+0000", 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5085000000000001e-05 2024-04-22T19:56:57.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789665+0000", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7062e-05 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789780+0000", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114287 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789821+0000", 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1609000000000001e-05 2024-04-22T19:56:57.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814068+0000", 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02424728 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814151+0000", 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2205000000000003e-05 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2794 3.24 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:57.979 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.0741254579999993, 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029467394000000001, 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2794 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:57.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828694+0000", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0759999999999999e-06 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835121+0000", 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064273400000000001 2024-04-22T19:56:57.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835164+0000", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2876000000000001e-05 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835183+0000", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9259e-05 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835387+0000", 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020336700000000001 2024-04-22T19:56:57.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835709+0000", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032233700000000001 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.836065+0000", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035655700000000002 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.846931+0000", 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010865649999999999 2024-04-22T19:56:57.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858029+0000", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011097721 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858102+0000", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2970000000000001e-05 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858158+0000", 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:56:57.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2848 3.29 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1293453549999999, 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026007142, 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.985 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2848 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773479+0000", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1710000000000002e-06 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777520+0000", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040408550000000003 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777545+0000", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5296e-05 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777555+0000", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777661+0000", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105301 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777906+0000", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024572500000000002 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.778135+0000", 2024-04-22T19:56:57.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022820199999999999 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.793572+0000", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015437227 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799393+0000", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058216370000000002 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799441+0000", 2024-04-22T19:56:57.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7120999999999998e-05 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799478+0000", 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7285e-05 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2862 3.24 3:24dfaea7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.962116398, 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023981771999999998, 2024-04-22T19:56:57.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2862 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940703+0000", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.253e-06 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945051+0000", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004348251 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945083+0000", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1897000000000003e-05 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945103+0000", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9579e-05 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945180+0000", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7455999999999998e-05 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945299+0000", 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011882 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945399+0000", 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9591000000000002e-05 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.952733+0000", 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073344789999999997 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964552+0000", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011818777000000001 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964625+0000", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2748000000000002e-05 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964681+0000", 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6920999999999999e-05 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:57.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2866 3.24 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9163283419999999, 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028710040999999999, 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2866 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986496+0000", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5490000000000006e-06 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:57.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990351+0000", 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038546040000000002 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990378+0000", 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7152999999999999e-05 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990389+0000", 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0533000000000001e-05 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990471+0000", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2395e-05 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990613+0000", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142115 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990730+0000", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116711 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:57.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.998090+0000", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073602399999999997 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015088+0000", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016997844000000002 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015143+0000", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4792e-05 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015198+0000", 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105000000000002e-05 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.002 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:56:58.003 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:56:57.997+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:56:58.103 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:58.101+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:58.171 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:58.172 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.186 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:56:58.204 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:58.205+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:58.305 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:58.305+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:58.349 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:58.349 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:58.349 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:58.349 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:58.349 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:56:58.406 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:58.405+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.848086320999997, 2024-04-22T19:56:58.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.837840145000001, 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:56:58.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:56:58.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:56:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.058140098000003, 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.492 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:56:58.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:56:58.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.784946912999999, 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:56:58.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:56:58.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.622745412999997, 2024-04-22T19:56:58.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.753470139999999, 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:56:58.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:56:58.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.703536472, 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:58.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:56:58.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.626843320999999, 2024-04-22T19:56:58.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:56:58.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:56:58.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.523 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.505892210000001, 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:56:58.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:56:58.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2712 3.2a 3:55e3face:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.437580497000001, 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021790146, 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.529 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2712 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043633+0000", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4200000000000001e-06 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048847+0000", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052140729999999996 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048873+0000", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6092999999999999e-05 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048890+0000", 2024-04-22T19:56:58.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6626e-05 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049044+0000", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015450699999999999 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049359+0000", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514500000000002 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049591+0000", 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023134100000000001 2024-04-22T19:56:58.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057839+0000", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082482000000000007 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065236+0000", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007396835 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065349+0000", 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113584 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065421+0000", 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1322000000000006e-05 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.039850624, 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.534 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:56:58.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9867971040000008, 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.538 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:56:58.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:56:58.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:58.543 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8818431849999993, 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.7138405730000006, 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:56:58.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:56:58.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6960186959999994, 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6217887730000005, 2024-04-22T19:56:58.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:56:58.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.564 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.4923649090000008, 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:58.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:56:58.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2976588539999998, 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.570 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2843 3.22 3:4565b493:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8220909519999999, 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021451708, 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2843 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659123+0000", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663577+0000", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044546530000000003 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663621+0000", 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3359000000000003e-05 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663639+0000", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663785+0000", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146312 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664120+0000", 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033481100000000002 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664441+0000", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032131100000000001 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.675438+0000", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010996634 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680327+0000", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048891380000000003 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680462+0000", 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134917 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680572+0000", 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010953799999999999 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6420476619999995, 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:56:58.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:56:58.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:56:58.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:58.585 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.586 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:56:58.587 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:58.585+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:58.687 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:56:58.685+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:56:58.755 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:58.755 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:58.755 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:58.755 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:56:58.813 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:56:58.814 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:56:58.813+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:56:58.885 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:58.885 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:58.885 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:56:58.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:56:58.885 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:58.889 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:58.885+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:58.902 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:56:58.989 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:58.989+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:59.072 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:59.072 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 161.71437952299999, 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:56:59.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:56:59.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:59.080 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.791635984000003, 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:56:59.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:56:59.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:56:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:56:59.086 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.760419294999998, 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:56:59.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:59.092 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.027540058, 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:59.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:56:59.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:56:59.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.842767191999997, 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:56:59.098 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:56:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:56:59.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.823559279000001, 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:56:59.104 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:56:59.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:56:59.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.140389943999999, 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.110 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:56:59.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.225123056999999, 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.121 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2713 3.26 3:66ce3eea:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.016229814000001, 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022347905000000001, 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2713 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053122+0000", 2024-04-22T19:56:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3900000000000003e-06 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057314+0000", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041919979999999997 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057369+0000", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5652000000000002e-05 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057397+0000", 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7515999999999999e-05 2024-04-22T19:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057537+0000", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014015800000000001 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057788+0000", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025124199999999999 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.058007+0000", 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218469 2024-04-22T19:56:59.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.068070+0000", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010063478000000001 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075301+0000", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072310050000000004 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075398+0000", 2024-04-22T19:56:59.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6378000000000005e-05 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075465+0000", 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7619000000000004e-05 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.974431167000001, 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:56:59.127 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:56:59.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:56:59.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:56:59.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.719028221, 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.138 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.709566935, 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:56:59.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:56:59.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.633588420000001, 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.144 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:56:59.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:56:59.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.293207964, 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:56:59.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:56:59.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:56:59.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.155 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.279032115, 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.159 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.274851682, 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:56:59.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:56:59.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:56:59.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:56:59.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.182358183, 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:56:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:56:59.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:56:59.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2824 3.20 3:05be2077:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8111543169999997, 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022880451999999999, 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.171 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2824 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258195+0000", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9580000000000001e-06 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262050+0000", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038554140000000001 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262069+0000", 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785999999999999e-05 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262077+0000", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0469999999999994e-06 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262135+0000", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7901e-05 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262248+0000", 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011288799999999999 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262343+0000", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4738e-05 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.268630+0000", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062879529999999998 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.280986+0000", 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012355766000000001 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281034+0000", 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7460999999999998e-05 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281073+0000", 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9539999999999998e-05 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.5825024340000002, 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2844 3.1e 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3886464440000008, 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023364238999999998, 2024-04-22T19:56:59.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2844 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680703+0000", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684748+0000", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040446969999999999 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:56:59.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684788+0000", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9381999999999997e-05 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684805+0000", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684910+0000", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104974 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:56:59.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685130+0000", 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0002198 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685311+0000", 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018140100000000001 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.695458+0000", 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010146438000000001 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703883+0000", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084251540000000007 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703988+0000", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.704065+0000", 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6902000000000003e-05 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:56:59.188 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:56:59.188 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:59.189 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:56:59.190 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:56:59.190 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:59.189+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:59.267 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:56:59.289 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:59.289+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:59.363 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:56:59.363 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:56:59.363 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:56:59.363 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:56:59.382 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:56:59.390 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:59.385+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:56:59.419 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:56:59.435 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:56:59.435 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:56:59.451 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:56:59.451 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:56:59.468 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:56:59.468 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:56:59.485 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:56:59.486 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:56:59.491 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:56:59.489+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:56:59.503 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:56:59.503 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:56:59.520 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:56:59.521 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:56:59.540 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:56:59.541 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:56:59.550 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:59.550 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:59.565 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:56:59.603 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:56:59.601+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:56:59.692 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:59.689+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:59.733 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:59.733 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:59.747 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:56:59.793 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:56:59.793+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:56:59.878 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:56:59.878 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:56:59.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:56:59.894 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:56:59.893+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:56:59.994 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:56:59.989+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:00.016 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.016 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:00.115 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:00.113+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:00.194 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.194 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.196 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:00.193+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:00.210 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:00.297 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:00.293+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:00.378 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.378 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:00.398 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:00.397+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:00.499 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:00.497+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:00.561 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.561 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:00.619 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:00.617+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:00.699 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.699 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.700 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:00.697+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:00.716 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:00.803 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:00.801+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:00.886 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:00.886 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:00.900 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:00.946 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:00.941+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:01.003 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:01.001+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:01.070 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:01.070 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:01.084 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:01.131 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:01.129+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:01.202 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:01.202 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:01.205 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:01.201+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:01.216 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:57:01.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:01.306 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:01.305+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:01.381 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:01.381 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:01.396 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:01.406 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:01.405+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:01.507 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:01.501+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:01.512 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:01.512 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:01.526 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:01.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:01.611 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:01.609+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:01.684 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:01.684 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:01.699 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:01.707 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:01.708 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:01.708 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:01.705+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:01.724 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:01.725 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:01.740 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:01.741 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:01.756 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:01.757 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:01.775 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:01.775 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:01.793 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:01.793 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:01.809 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:01.805+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:01.812 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:01.832 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:01.832 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:01.833 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:01.833 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:01.834 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:01.834 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:01.848 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:01.933 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:01.933+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:02.008 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.009 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:02.009 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:02.009 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:02.009 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.011 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:02.009+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:02.023 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:02.112 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:02.109+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.194 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:1195 3.2c e71/20 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head v 71'2, mlcod=0'0)", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 64.876444687000003, 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021231163000000001, 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315569+0000", 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315571+0000", 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2699999999999999e-06 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318464+0000", 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028921820000000001 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318514+0000", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0525999999999997e-05 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318540+0000", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6035999999999999e-05 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318736+0000", 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019553300000000001 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.318807+0000", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1579e-05 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336702+0000", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017894449 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.336800+0000", 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8587999999999999e-05 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.198 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.926907839999998, 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.199 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:02.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.568828658999998, 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:02.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2304 3.a e75/20 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head v 75'4, mlcod=75'2)", 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 50.939069261, 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021628398, 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252945+0000", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252947+0000", 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256194+0000", 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032471319999999998 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256230+0000", 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5735000000000003e-05 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256247+0000", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7365999999999999e-05 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256405+0000", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015832300000000001 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.256470+0000", 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5074999999999996e-05 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.273883+0000", 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017412318 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274573+0000", 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069027599999999998 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2352 3.34 3:2ead4bed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:02.214 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 50.444321944000002, 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021641917, 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2352 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:57:02.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747692+0000", 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.747695+0000", 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.915e-06 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751575+0000", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038805340000000002 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751604+0000", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8687000000000002e-05 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751619+0000", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4717e-05 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751725+0000", 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106618 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.751944+0000", 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021844 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.752158+0000", 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021405799999999999 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769085+0000", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016927478999999999 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769183+0000", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7456999999999999e-05 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769274+0000", 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0854999999999997e-05 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.769334+0000", 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0157e-05 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2421 3.14 3:28745612:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.483874108999998, 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021613948000000001, 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.220 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2421 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708140+0000", 2024-04-22T19:57:02.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.708143+0000", 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.943e-06 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714667+0000", 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065238470000000002 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714716+0000", 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9023000000000001e-05 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714737+0000", 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1155999999999999e-05 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714844+0000", 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107182 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.714999+0000", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155193 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.715120+0000", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120765 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726263+0000", 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011142854000000001 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729547+0000", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032846479999999998 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729646+0000", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8665999999999994e-05 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.729754+0000", 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010767100000000001 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.225 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2682 3.15 e92/89 3:a9094df8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_31:head v 92'8, mlcod=77'6)", 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.468684379999999, 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031839320999999997, 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723332+0000", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4040000000000002e-06 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727108+0000", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003776101 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727152+0000", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3853000000000002e-05 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727176+0000", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4375999999999998e-05 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727314+0000", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001373 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727369+0000", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5429000000000001e-05 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.754987+0000", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027617561999999998 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755169+0000", 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182296 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2683 3.1c e92/20 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head v 92'9, mlcod=77'7)", 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.458172533999999, 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042764414000000001, 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.230 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733845+0000", 2024-04-22T19:57:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.54e-06 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738419+0000", 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004573672 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738451+0000", 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2351999999999998e-05 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738472+0000", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1290000000000001e-05 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738861+0000", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038872499999999998 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738931+0000", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0401999999999994e-05 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776388+0000", 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.037456697999999997 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776606+0000", 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021773499999999999 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2684 3.2c e92/20 3:3779f477:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_33:head v 92'7, mlcod=75'5)", 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.442704015, 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032945639999999998, 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749312+0000", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.553e-06 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755415+0000", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061026170000000003 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755448+0000", 2024-04-22T19:57:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3195999999999999e-05 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755470+0000", 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1302999999999999e-05 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757104+0000", 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016341859999999999 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757158+0000", 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4008999999999997e-05 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782135+0000", 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024977428999999999 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782255+0000", 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120347 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2687 3.1d e93/20 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head v 93'3, mlcod=75'1)", 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.408094629000001, 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028276740000000002, 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783921+0000", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.623e-06 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787256+0000", 2024-04-22T19:57:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033348739999999998 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787293+0000", 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6933e-05 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787307+0000", 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4611e-05 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787412+0000", 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787451+0000", 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8930999999999997e-05 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812092+0000", 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024640704999999999 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812196+0000", 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010401200000000001 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2703 3.1a 3:5b28f2e9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.247676736000001, 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026147159, 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2703 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944337+0000", 2024-04-22T19:57:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.944340+0000", 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5569999999999998e-06 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948297+0000", 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039573480000000003 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948332+0000", 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4836000000000003e-05 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948350+0000", 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7782999999999999e-05 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948554+0000", 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020403199999999999 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.948796+0000", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024245899999999999 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.949034+0000", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238318 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970082+0000", 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021047184 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970222+0000", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014042699999999999 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970360+0000", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819400000000001 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.970484+0000", 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012402100000000001 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2706 3.1d e93/20 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head v 93'4, mlcod=75'2)", 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.210518419, 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022188887000000001, 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:57:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981495+0000", 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981498+0000", 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2340000000000001e-06 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984756+0000", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003258305 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984790+0000", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3665999999999999e-05 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984806+0000", 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6079999999999999e-05 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.984949+0000", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014278399999999999 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.985011+0000", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2419e-05 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003568+0000", 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018556919000000002 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.003684+0000", 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011648 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2714 3.31 e93/20 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head v 93'7, mlcod=76'5)", 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.126917956, 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021717826999999999, 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065096+0000", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065099+0000", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069899+0000", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048002169999999999 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069934+0000", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4792999999999997e-05 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.069950+0000", 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6405999999999998e-05 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070089+0000", 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013934099999999999 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.070130+0000", 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0682000000000001e-05 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086720+0000", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016589567 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.086814+0000", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4180999999999998e-05 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2774 3.15 e93/89 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head v 93'9, mlcod=77'7)", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:57:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.555542845, 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022494369, 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636471+0000", 2024-04-22T19:57:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636473+0000", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640260+0000", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037869029999999999 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640304+0000", 2024-04-22T19:57:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3809e-05 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640328+0000", 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3796000000000001e-05 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640477+0000", 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014879300000000001 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.640535+0000", 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8613000000000003e-05 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658748+0000", 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018212569000000001 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.658965+0000", 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217536 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2787 3.e e93/20 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head v 93'5, mlcod=76'3)", 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.429173219000001, 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026224332, 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:57:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762841+0000", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762843+0000", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7e-06 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767730+0000", 2024-04-22T19:57:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048870980000000003 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767769+0000", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8327000000000001e-05 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767786+0000", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7657000000000001e-05 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767961+0000", 2024-04-22T19:57:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017417800000000001 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.768029+0000", 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8769000000000005e-05 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.788969+0000", 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020939859000000002 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789065+0000", 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5743999999999997e-05 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2789 3.a e93/20 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head v 93'7, mlcod=76'5)", 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.409753302, 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031890114999999997, 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782263+0000", 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4260000000000002e-06 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789623+0000", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073601609999999996 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789648+0000", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5085000000000001e-05 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789665+0000", 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7062e-05 2024-04-22T19:57:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789780+0000", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114287 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789821+0000", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1609000000000001e-05 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814068+0000", 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02424728 2024-04-22T19:57:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814151+0000", 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2205000000000003e-05 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2794 3.24 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.363323249, 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029467394000000001, 2024-04-22T19:57:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2794 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828694+0000", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0759999999999999e-06 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835121+0000", 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064273400000000001 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835164+0000", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2876000000000001e-05 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835183+0000", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9259e-05 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835387+0000", 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020336700000000001 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835709+0000", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032233700000000001 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.836065+0000", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035655700000000002 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.846931+0000", 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010865649999999999 2024-04-22T19:57:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858029+0000", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011097721 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858102+0000", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2970000000000001e-05 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858158+0000", 2024-04-22T19:57:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2848 3.29 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.418543145999999, 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026007142, 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2848 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773471+0000", 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.773479+0000", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1710000000000002e-06 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777520+0000", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040408550000000003 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777545+0000", 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5296e-05 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777555+0000", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0322e-05 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777661+0000", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105301 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.777906+0000", 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024572500000000002 2024-04-22T19:57:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.778135+0000", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022820199999999999 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.793572+0000", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015437227 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799393+0000", 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058216370000000002 2024-04-22T19:57:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799441+0000", 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7120999999999998e-05 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.799478+0000", 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7285e-05 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2862 3.24 3:24dfaea7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.251314189, 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023981771999999998, 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2862 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940700+0000", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.940703+0000", 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.253e-06 2024-04-22T19:57:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945051+0000", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004348251 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945083+0000", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1897000000000003e-05 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945103+0000", 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9579e-05 2024-04-22T19:57:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945180+0000", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7455999999999998e-05 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945299+0000", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011882 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.945399+0000", 2024-04-22T19:57:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9591000000000002e-05 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.952733+0000", 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073344789999999997 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964552+0000", 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011818777000000001 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964625+0000", 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2748000000000002e-05 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.964681+0000", 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6920999999999999e-05 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2866 3.24 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.205526132999999, 2024-04-22T19:57:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028710040999999999, 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2866 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986496+0000", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5490000000000006e-06 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990351+0000", 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038546040000000002 2024-04-22T19:57:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990378+0000", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7152999999999999e-05 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990389+0000", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0533000000000001e-05 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990471+0000", 2024-04-22T19:57:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2395e-05 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990613+0000", 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142115 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990730+0000", 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116711 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.998090+0000", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073602399999999997 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015088+0000", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016997844000000002 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015143+0000", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4792e-05 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015198+0000", 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105000000000002e-05 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.293 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.294 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:02.295 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:02.293+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:02.395 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:02.393+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:02.465 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.465 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:02.465 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:02.465 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.467 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:57:02.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:02.531 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:02.529+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:02.596 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.596 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:02.596 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:02.596 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:02.596 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.597 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:02.593+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:02.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:02.698 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:02.693+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:02.732 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:02.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.096732451999998, 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:02.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:02.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:02.738 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.086486276000002, 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:02.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:57:02.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.306786228999997, 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.743 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:57:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:57:02.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:02.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:02.748 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 50.033593044, 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:02.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.871391543999998, 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.754 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.002116271, 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.952182603000001, 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.875489452, 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:57:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.754538341, 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2712 3.2a 3:55e3face:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.686226628, 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021790146, 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2712 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043633+0000", 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4200000000000001e-06 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048847+0000", 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052140729999999996 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048873+0000", 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6092999999999999e-05 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048890+0000", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6626e-05 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049044+0000", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015450699999999999 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049359+0000", 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514500000000002 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049591+0000", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023134100000000001 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057839+0000", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082482000000000007 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065236+0000", 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007396835 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065349+0000", 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113584 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065421+0000", 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1322000000000006e-05 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.288496755000001, 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:57:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:57:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.235443235, 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:57:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:57:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:57:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.130489316, 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.962486704, 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.944664827, 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.870434904, 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:57:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:57:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:57:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.74101104, 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:57:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:57:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:57:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.546304985000001, 2024-04-22T19:57:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2843 3.22 3:4565b493:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.070737082999999, 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021451708, 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2843 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659123+0000", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663577+0000", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044546530000000003 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663621+0000", 2024-04-22T19:57:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3359000000000003e-05 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663639+0000", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663785+0000", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146312 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664120+0000", 2024-04-22T19:57:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033481100000000002 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664441+0000", 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032131100000000001 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.675438+0000", 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010996634 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680327+0000", 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048891380000000003 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680462+0000", 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134917 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680572+0000", 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010953799999999999 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.890693793000001, 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:57:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:57:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:57:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:02.844 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.845 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:02.846 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:02.841+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:02.946 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:02.945+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:02.976 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:02.976 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:02.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:02.977 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:02.991 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:03.077 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:03.077+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:03.148 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:03.145+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:03.155 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:03.155 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:03.156 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:03.156 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:03.156 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:03.169 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:03.261 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:03.261+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 165.98612875800001, 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.063385218999997, 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.032168530000007, 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.299289293000001, 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:57:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:57:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:57:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:57:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.114516426999998, 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.095308514000003, 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.412139179, 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:57:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:57:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:57:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.496872292000001, 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2713 3.26 3:66ce3eea:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.287979049, 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022347905000000001, 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2713 2024-04-22T19:57:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053122+0000", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3900000000000003e-06 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057314+0000", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041919979999999997 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057369+0000", 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5652000000000002e-05 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057397+0000", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7515999999999999e-05 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057537+0000", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014015800000000001 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057788+0000", 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025124199999999999 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.058007+0000", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218469 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.068070+0000", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010063478000000001 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075301+0000", 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072310050000000004 2024-04-22T19:57:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075398+0000", 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6378000000000005e-05 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075465+0000", 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7619000000000004e-05 2024-04-22T19:57:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.246180402, 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:57:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:57:03.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.990777456, 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.405 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:03.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:03.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.981316169999999, 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.411 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:57:03.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:57:03.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.905337655, 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:03.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:03.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.564957199, 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:03.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.428 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.550781349999999, 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:03.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.433 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.546600916999999, 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.454107418, 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:57:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:57:03.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:57:03.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2824 3.20 3:05be2077:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.082903551999999, 2024-04-22T19:57:03.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022880451999999999, 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2824 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258195+0000", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9580000000000001e-06 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262050+0000", 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038554140000000001 2024-04-22T19:57:03.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262069+0000", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785999999999999e-05 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262077+0000", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0469999999999994e-06 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262135+0000", 2024-04-22T19:57:03.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7901e-05 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262248+0000", 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011288799999999999 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262343+0000", 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4738e-05 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.268630+0000", 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062879529999999998 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.280986+0000", 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012355766000000001 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281034+0000", 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7460999999999998e-05 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281073+0000", 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9539999999999998e-05 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.854251669, 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:03.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:03.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2844 3.1e 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.660395679000001, 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023364238999999998, 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2844 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:03.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680703+0000", 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684748+0000", 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040446969999999999 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684788+0000", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9381999999999997e-05 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684805+0000", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684910+0000", 2024-04-22T19:57:03.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104974 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685130+0000", 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0002198 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685311+0000", 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018140100000000001 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.695458+0000", 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010146438000000001 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703883+0000", 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084251540000000007 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703988+0000", 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.704065+0000", 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6902000000000003e-05 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.463 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:03.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:03.465 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:03.461+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:03.566 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:03.561+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:03.637 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:03.637 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:03.637 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:03.637 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:03.651 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:03.666 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:03.661+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:03.767 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:03.765+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:03.775 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:03.775 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:03.775 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:03.775 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:03.776 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:03.790 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:03.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:03.881 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:03.881+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:03.964 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 187.03011431799999, 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:03.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.666306215999995, 2024-04-22T19:57:03.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:03.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.348518071999997, 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:03.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.330881548000001, 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:57:03.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:57:03.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.310078711000003, 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.988 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:57:03.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:57:03.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:03.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.027284322, 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:03.994 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:57:03.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:57:03.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:03.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.845895183000003, 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:57:04.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:57:04.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:57:04.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.398825213999999, 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.009 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:04.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:04.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:04.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:04.015 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.099148534999998, 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:57:04.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.838108919, 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:04.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:04.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2736 3.3f 3:fd0f5217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.62168228, 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023203066000000001, 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2736 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340402+0000", 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799999999999997e-06 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344869+0000", 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044674559999999999 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344906+0000", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6965999999999998e-05 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344930+0000", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345111+0000", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180803 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345358+0000", 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024696199999999998 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345585+0000", 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000226999 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355592+0000", 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010007446 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363387+0000", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077947240000000003 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363484+0000", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7268000000000005e-05 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363601+0000", 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116352 2024-04-22T19:57:04.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2747 3.37 3:ee38ee50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.507477674, 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02309667, 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2747 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454607+0000", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8189999999999999e-06 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459048+0000", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044409799999999998 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459090+0000", 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1715999999999998e-05 2024-04-22T19:57:04.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459110+0000", 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0066999999999999e-05 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459297+0000", 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000187376 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459704+0000", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040662599999999999 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.460075+0000", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037066999999999997 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.474130+0000", 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014055120000000001 2024-04-22T19:57:04.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477416+0000", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003285858 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477582+0000", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016643699999999999 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477699+0000", 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117001 2024-04-22T19:57:04.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.497828974000001, 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:04.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:04.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.331846962, 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.044 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:04.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.049 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2783 3.39 3:9ed45f77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.243073427000001, 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022297813, 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2783 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719010+0000", 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.083e-06 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723034+0000", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040239789999999996 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723072+0000", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8393999999999999e-05 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723090+0000", 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8354000000000001e-05 2024-04-22T19:57:04.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723231+0000", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014051100000000001 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723481+0000", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025000100000000002 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723711+0000", 2024-04-22T19:57:04.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023034600000000001 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.737992+0000", 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014281126999999999 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.740995+0000", 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030024439999999999 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.741176+0000", 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018083899999999999 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.741304+0000", 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012873499999999999 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.055 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.205016356, 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:04.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:04.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.188505682000001, 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:04.061 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:04.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:04.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.99325524, 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:04.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.071 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2815 3.2d 3:b5d2a619:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.890752877000001, 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022636026, 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2815 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071330+0000", 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.207e-06 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077630+0000", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062994080000000003 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077666+0000", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6662999999999998e-05 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077684+0000", 2024-04-22T19:57:04.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7388999999999999e-05 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077878+0000", 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019391300000000001 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078217+0000", 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033960400000000002 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078449+0000", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231952 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.088095+0000", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096460880000000006 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093879+0000", 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057841450000000001 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093926+0000", 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6836999999999999e-05 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093963+0000", 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6820000000000003e-05 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2835 3.26 e93/20 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head v 93'8, mlcod=93'6)", 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.46924426, 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022191551, 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:04.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492838+0000", 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1059999999999998e-06 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496544+0000", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037058540000000002 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496581+0000", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7308000000000003e-05 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496598+0000", 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6608000000000001e-05 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496787+0000", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189161 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496857+0000", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0412000000000003e-05 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514862+0000", 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018004768000000001 2024-04-22T19:57:04.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515027+0000", 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000165334 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:04.082 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:04.083 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:04.084 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:04.084 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:04.084 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:04.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:04.085 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:04.086 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:04.086 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:04.086 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:04.086 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:04.087 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:04.087 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:04.081+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:04.096 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:04.096 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:04.116 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:04.117 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:04.137 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:04.138 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:04.203 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:04.201+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:04.210 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.210 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.222 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:04.285 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:04.285+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:04.386 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:04.381+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:04.391 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.391 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.405 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:04.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:57:04.487 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:04.485+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:04.573 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.573 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.588 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:04.589 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:04.585+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:04.689 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:04.689+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:04.708 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.708 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:04.790 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:04.789+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:04.848 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.849 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.863 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:04.891 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:04.889+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:04.947 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records in 2024-04-22T19:57:04.947 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records out 2024-04-22T19:57:04.947 INFO:tasks.workunit.client.0.smithi111.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.8908 s, 151 MB/s 2024-04-22T19:57:04.987 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:04.987 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:04.992 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:04.989+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:05.002 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:05.092 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:05.089+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:05.131 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_57_05 2024-04-22T19:57:05.131 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.131 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:05.195 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:05.193+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:05.267 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.267 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.284 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:05.288 INFO:tasks.workunit.client.0.smithi111.stdout:quota set for the bucket: buck_2024_03_22_19_57_05 2024-04-22T19:57:05.295 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:05.293+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:05.396 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:05.393+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:05.413 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.413 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.428 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:57:05.535 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:05.533+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:05.549 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.550 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.564 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:05.597 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:05.593+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:05.697 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:05.697+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:05.723 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.723 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:05.798 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:05.797+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:05.875 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:05.921 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:05.921+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:06.000 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:05.997+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:06.023 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:06.101 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:06.097+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:06.157 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:06.184 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:06.184 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:06.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:06.203 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:06.201+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:06.300 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:06.300 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:06.302 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:06.297+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:06.316 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:06.316 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:06.319 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:06.319 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:06.332 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:06.332 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:06.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:06.362 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:06.362 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:06.379 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:06.380 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:06.397 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:06.397 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:06.403 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:06.401+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:06.415 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:06.415 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:06.434 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:06.434 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:06.458 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:06.459 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:06.459 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:06.459 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:06.474 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:06.503 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:06.501+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:06.592 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:06.592 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:06.592 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:06.592 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:06.593 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:06.604 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:06.601+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:06.607 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:06.705 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:06.705+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.100251534999998, 2024-04-22T19:57:06.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:06.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:06.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2246 3.17 e75/20 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.090005359000003, 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021859315000000001, 2024-04-22T19:57:06.743 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643371+0000", 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.643374+0000", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.687e-06 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649455+0000", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060810530000000003 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649487+0000", 2024-04-22T19:57:06.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1077000000000001e-05 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649504+0000", 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7042999999999999e-05 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649625+0000", 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121088 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.649666+0000", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0985999999999997e-05 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665098+0000", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015432690000000001 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.665230+0000", 2024-04-22T19:57:06.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131691 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 55.310305311999997, 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.748 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:57:06.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:57:06.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.037112127, 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.755 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:06.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:06.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.761 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.874910626999998, 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.762 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:06.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:06.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.005635353999999, 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:06.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:06.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.775 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.955701686000001, 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:06.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.879008535000001, 2024-04-22T19:57:06.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:06.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:06.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:57:06.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:57:06.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.758057424, 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.789 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2712 3.2a 3:55e3face:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.689745711, 2024-04-22T19:57:06.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021790146, 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2712 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043630+0000", 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.043633+0000", 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4200000000000001e-06 2024-04-22T19:57:06.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048847+0000", 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052140729999999996 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048873+0000", 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6092999999999999e-05 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.048890+0000", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6626e-05 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049044+0000", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015450699999999999 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049359+0000", 2024-04-22T19:57:06.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514500000000002 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.049591+0000", 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023134100000000001 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057839+0000", 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082482000000000007 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065236+0000", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007396835 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065349+0000", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113584 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.065421+0000", 2024-04-22T19:57:06.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1322000000000006e-05 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.292015838000001, 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:57:06.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.238962317999999, 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:57:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:57:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.134008398999999, 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:06.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.966005787, 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:06.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:06.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.948183910000001, 2024-04-22T19:57:06.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:06.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:06.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.835 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.873953987, 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.836 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:57:06.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:57:06.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.842 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.744530123000001, 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:06.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:57:06.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.549824067999999, 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:06.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:06.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:06.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.856 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2843 3.22 3:4565b493:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.074256166000001, 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021451708, 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.857 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2843 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659120+0000", 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.659123+0000", 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663577+0000", 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044546530000000003 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663621+0000", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3359000000000003e-05 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663639+0000", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.663785+0000", 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146312 2024-04-22T19:57:06.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664120+0000", 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033481100000000002 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.664441+0000", 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032131100000000001 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.675438+0000", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010996634 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680327+0000", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048891380000000003 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680462+0000", 2024-04-22T19:57:06.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134917 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680572+0000", 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010953799999999999 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:06.863 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.894212876000001, 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:57:06.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:06.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:57:06.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:06.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:06.870 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:06.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:06.872 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:06.873+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:06.973 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:06.969+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:07.044 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:07.045 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:07.045 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:07.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:07.074 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:07.069+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:07.174 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:07.169+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:07.225 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.225 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:07.225 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:07.225 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:07.225 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:07.240 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:07.279 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:07.273+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 170.00523316499999, 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.364 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.082489625999997, 2024-04-22T19:57:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:07.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.051272936999993, 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:07.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:07.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:07.385 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.318393700000001, 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.386 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:57:07.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:57:07.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:07.392 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.133620833999998, 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:07.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:07.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.114412921000003, 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:07.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:07.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 55.431243586000001, 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.406 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:07.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:57:07.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:57:07.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.515976698999999, 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.413 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:07.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.419 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2713 3.26 3:66ce3eea:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.307083456000001, 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022347905000000001, 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2713 2024-04-22T19:57:07.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053122+0000", 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3900000000000003e-06 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057314+0000", 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041919979999999997 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057369+0000", 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5652000000000002e-05 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057397+0000", 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7515999999999999e-05 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057537+0000", 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014015800000000001 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057788+0000", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025124199999999999 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.058007+0000", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218469 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.068070+0000", 2024-04-22T19:57:07.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010063478000000001 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075301+0000", 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072310050000000004 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075398+0000", 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6378000000000005e-05 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075465+0000", 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7619000000000004e-05 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.265284809000001, 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:57:07.426 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:57:07.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.009881863, 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:07.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:07.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.000420577, 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:57:07.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.445 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.924442062000001, 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:07.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:07.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:07.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:07.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.584061605999999, 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:07.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:07.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.569885757000002, 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:07.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:07.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.565705324, 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.465 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:07.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.473211825, 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:57:07.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:57:07.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2824 3.20 3:05be2077:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.102007959000002, 2024-04-22T19:57:07.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022880451999999999, 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2824 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:07.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258195+0000", 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9580000000000001e-06 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262050+0000", 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038554140000000001 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262069+0000", 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785999999999999e-05 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262077+0000", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0469999999999994e-06 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262135+0000", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7901e-05 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262248+0000", 2024-04-22T19:57:07.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011288799999999999 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262343+0000", 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4738e-05 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.268630+0000", 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062879529999999998 2024-04-22T19:57:07.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.280986+0000", 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012355766000000001 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281034+0000", 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7460999999999998e-05 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281073+0000", 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9539999999999998e-05 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.873356076, 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:07.487 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:07.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2844 3.1e 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.679500086000001, 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023364238999999998, 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.494 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2844 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680703+0000", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684748+0000", 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040446969999999999 2024-04-22T19:57:07.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684788+0000", 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9381999999999997e-05 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684805+0000", 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:07.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684910+0000", 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104974 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685130+0000", 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0002198 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685311+0000", 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018140100000000001 2024-04-22T19:57:07.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.695458+0000", 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010146438000000001 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703883+0000", 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084251540000000007 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703988+0000", 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.704065+0000", 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6902000000000003e-05 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:07.500 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:07.501 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:07.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:57:07.503 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:07.503 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:07.501+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:07.603 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:07.601+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:07.676 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:07.676 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:07.690 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:07.704 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:07.701+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:07.805 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:07.801+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:07.856 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.856 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:07.856 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:07.856 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:07.856 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:07.870 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:07.906 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:07.901+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 191.06444171499999, 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:07.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:08.004 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.700633612999994, 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.005 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:08.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:08.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.382845469000003, 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:08.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.365208944999999, 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.016 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:57:08.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:57:08.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.344406108000001, 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:57:08.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.061611718999998, 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:57:08.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.031 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2292 3.f 3:f0aae49c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.880222580000002, 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022309437000000001, 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2292 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116185+0000", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.116189+0000", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.07e-06 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.121964+0000", 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057753819999999999 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122009+0000", 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4706000000000002e-05 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122032+0000", 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3003e-05 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122174+0000", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142177 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122432+0000", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025755999999999999 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.122660+0000", 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228533 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.134018+0000", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011358023 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138368+0000", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043499990000000002 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138437+0000", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8491999999999994e-05 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.138494+0000", 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7491999999999998e-05 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.433152610999997, 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.037 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 55.133475932000003, 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.043 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.047 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.872436316000002, 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:08.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2736 3.3f 3:fd0f5217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.656009677, 2024-04-22T19:57:08.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023203066000000001, 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2736 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340402+0000", 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799999999999997e-06 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344869+0000", 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044674559999999999 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344906+0000", 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6965999999999998e-05 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344930+0000", 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345111+0000", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180803 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345358+0000", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024696199999999998 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345585+0000", 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000226999 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355592+0000", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010007446 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363387+0000", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077947240000000003 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363484+0000", 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7268000000000005e-05 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363601+0000", 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116352 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2747 3.37 3:ee38ee50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.541805070999999, 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02309667, 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2747 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:08.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454607+0000", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8189999999999999e-06 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459048+0000", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044409799999999998 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459090+0000", 2024-04-22T19:57:08.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1715999999999998e-05 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459110+0000", 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0066999999999999e-05 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459297+0000", 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000187376 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459704+0000", 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040662599999999999 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.460075+0000", 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037066999999999997 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.474130+0000", 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014055120000000001 2024-04-22T19:57:08.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477416+0000", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003285858 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477582+0000", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016643699999999999 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477699+0000", 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117001 2024-04-22T19:57:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.532156370999999, 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:08.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:08.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:08.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.366174358999999, 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.070 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:08.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:08.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:08.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:08.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2783 3.39 3:9ed45f77:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.277400824000001, 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022297813, 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2783 2024-04-22T19:57:08.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719007+0000", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.719010+0000", 2024-04-22T19:57:08.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.083e-06 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723034+0000", 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040239789999999996 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723072+0000", 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8393999999999999e-05 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723090+0000", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8354000000000001e-05 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723231+0000", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014051100000000001 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723481+0000", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025000100000000002 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.723711+0000", 2024-04-22T19:57:08.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023034600000000001 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.737992+0000", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014281126999999999 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.740995+0000", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030024439999999999 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.741176+0000", 2024-04-22T19:57:08.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018083899999999999 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.741304+0000", 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012873499999999999 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:08.081 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.239343753, 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:08.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:08.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:08.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.222833079000001, 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.087 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:08.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.091 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.027582636999998, 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.092 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:08.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:08.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:08.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2815 3.2d 3:b5d2a619:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.925080273999999, 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022636026, 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.097 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2815 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071330+0000", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.207e-06 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077630+0000", 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062994080000000003 2024-04-22T19:57:08.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077666+0000", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6662999999999998e-05 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077684+0000", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7388999999999999e-05 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077878+0000", 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019391300000000001 2024-04-22T19:57:08.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078217+0000", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033960400000000002 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078449+0000", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231952 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.088095+0000", 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096460880000000006 2024-04-22T19:57:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093879+0000", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057841450000000001 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093926+0000", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6836999999999999e-05 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093963+0000", 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6820000000000003e-05 2024-04-22T19:57:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2835 3.26 e93/20 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head v 93'8, mlcod=93'6)", 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.503571656999998, 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022191551, 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492836+0000", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492838+0000", 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1059999999999998e-06 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496544+0000", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037058540000000002 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496581+0000", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7308000000000003e-05 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496598+0000", 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6608000000000001e-05 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496787+0000", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189161 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.496857+0000", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0412000000000003e-05 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514862+0000", 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018004768000000001 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:08.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515027+0000", 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000165334 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:08.107 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:08.108 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:08.109+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:08.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:08.209 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:08.205+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:08.229 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:08.229 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:08.229 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:08.230 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:08.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:08.331 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:08.329+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:08.406 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:08.406 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:08.406 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:08.406 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:08.406 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:08.411 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:08.409+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:08.420 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:08.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:08.481 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:57:08.511 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:08.505+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:08.584 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:08.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 57.942655084999998, 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.585 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:08.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:08.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.983307593999999, 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.590 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:08.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.818457161000001, 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.597778220999999, 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.601 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:08.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:08.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:08.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2722 3.12 3:49cf3d51:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.150573+0000", 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.432112765999999, 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018907315000000001, 2024-04-22T19:57:08.607 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2722 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.150573+0000", 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.150573+0000", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.150576+0000", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2000000000000001e-06 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152333+0000", 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00175789 2024-04-22T19:57:08.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152359+0000", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5593e-05 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152372+0000", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2947e-05 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152440+0000", 2024-04-22T19:57:08.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8489000000000001e-05 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152579+0000", 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138393 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.152712+0000", 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013302600000000001 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.160369+0000", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076567090000000003 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.169351+0000", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089825370000000005 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.169425+0000", 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3683000000000006e-05 2024-04-22T19:57:08.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.169481+0000", 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5847999999999998e-05 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2727 3.23 3:c759b3e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.361499897000002, 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020866947, 2024-04-22T19:57:08.613 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2727 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221189+0000", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9210000000000001e-06 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223161+0000", 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019713899999999999 2024-04-22T19:57:08.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223204+0000", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3235999999999997e-05 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223232+0000", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7869e-05 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223346+0000", 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011461899999999999 2024-04-22T19:57:08.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223529+0000", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018233799999999999 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223699+0000", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170459 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.232297+0000", 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085980680000000004 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.241931+0000", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096342200000000006 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242001+0000", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9760999999999998e-05 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242053+0000", 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2065999999999999e-05 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.618 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2741 3.1b 3:da4ad923:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.391043+0000", 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.191643204000002, 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019806543999999999, 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.619 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2741 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.391043+0000", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.391043+0000", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.391045+0000", 2024-04-22T19:57:08.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.392743+0000", 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016975320000000001 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.392771+0000", 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7917999999999999e-05 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.392784+0000", 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2891000000000001e-05 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.392860+0000", 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6674000000000005e-05 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.393010+0000", 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014992799999999999 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.393112+0000", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010196000000000001 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.398923+0000", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005811259 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.410780+0000", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011856148 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.410819+0000", 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9152000000000001e-05 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.410849+0000", 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0797999999999999e-05 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2752 3.32 3:4dcc7a09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.079097462, 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021065733999999999, 2024-04-22T19:57:08.624 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2752 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503592+0000", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1640000000000001e-06 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505558+0000", 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661930000000002 2024-04-22T19:57:08.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505608+0000", 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9957999999999998e-05 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505626+0000", 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7927999999999998e-05 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505735+0000", 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010932799999999999 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505919+0000", 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000183356 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506080+0000", 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016146800000000001 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.521592+0000", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015511723 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524530+0000", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029378490000000002 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524600+0000", 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9931000000000005e-05 2024-04-22T19:57:08.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524654+0000", 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4836000000000001e-05 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2753 3.23 3:c5380cef:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.514241+0000", 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.068444929999998, 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019542276000000001, 2024-04-22T19:57:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2753 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.514241+0000", 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.514241+0000", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.514244+0000", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.745e-06 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516326+0000", 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020816580000000001 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516353+0000", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.72e-05 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516367+0000", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4662e-05 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516456+0000", 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8737000000000001e-05 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516646+0000", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000189629 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.516810+0000", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016415399999999999 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.526179+0000", 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093693830000000002 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.533667+0000", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074875510000000003 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.533734+0000", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6715000000000001e-05 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.533783+0000", 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9842000000000002e-05 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2771 3.30 e93/20 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head v 93'7, mlcod=76'5)", 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.604158+0000", 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.978528381, 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019646515, 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.604158+0000", 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.604158+0000", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.604159+0000", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.376e-06 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.609513+0000", 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053538329999999997 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.609537+0000", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3975e-05 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.609550+0000", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3023000000000001e-05 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.609633+0000", 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3085999999999997e-05 2024-04-22T19:57:08.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.609662+0000", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9067000000000001e-05 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.623737+0000", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014074415 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.623804+0000", 2024-04-22T19:57:08.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7739999999999999e-05 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.873093480000001, 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.640 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.645 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2784 3.2b 3:d4a45fb4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.727023+0000", 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.855663102000001, 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018935805999999999, 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2784 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.727023+0000", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.727023+0000", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.727025+0000", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.424e-06 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.728785+0000", 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00175968 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.728812+0000", 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6726000000000001e-05 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.728824+0000", 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2149e-05 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.728888+0000", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4262000000000002e-05 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.729029+0000", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000140875 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.729152+0000", 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012312 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739610+0000", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010457757999999999 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.745860+0000", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062495110000000001 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.745903+0000", 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3525000000000001e-05 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.745959+0000", 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5776000000000003e-05 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2794 3.24 e93/89 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head v 93'8, mlcod=92'6)", 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.7465735, 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021407932000000001, 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.651 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836114+0000", 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.826e-06 2024-04-22T19:57:08.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840272+0000", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00415745 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840291+0000", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9398e-05 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840302+0000", 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1134999999999999e-05 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840367+0000", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4573000000000007e-05 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840384+0000", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6600999999999999e-05 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857472+0000", 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017088431000000001 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857521+0000", 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8517999999999999e-05 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2795 3.1f 3:f85731d8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.745279356000001, 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020520294000000001, 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.655 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2795 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:08.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837409+0000", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.187e-06 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839272+0000", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001863471 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839305+0000", 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502999999999997e-05 2024-04-22T19:57:08.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839319+0000", 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4205e-05 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839391+0000", 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2092e-05 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839533+0000", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014198100000000001 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839690+0000", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156429 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.851666+0000", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01197669 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857857+0000", 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061904270000000001 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857895+0000", 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7908999999999999e-05 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857927+0000", 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2400000000000001e-05 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.394231982000001, 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:08.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.377325417000002, 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:08.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:08.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:08.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2851 3.1b 3:d820f48a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.815578+0000", 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.767108331999999, 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018959186999999999, 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2851 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.672 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.815578+0000", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.815578+0000", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.815581+0000", 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5820000000000002e-06 2024-04-22T19:57:08.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.817807+0000", 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022256580000000002 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.817862+0000", 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4645999999999998e-05 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.817888+0000", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5879000000000001e-05 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.818002+0000", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114261 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.818202+0000", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000200268 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:08.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.818377+0000", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017525099999999999 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.826011+0000", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076332819999999999 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.834400+0000", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083889459999999996 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.834478+0000", 2024-04-22T19:57:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8337999999999994e-05 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.834537+0000", 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9076000000000002e-05 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2862 3.24 e93/89 3:24dfaea7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_201:head v 93'9, mlcod=92'7)", 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.945476+0000", 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.637209762000001, 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018664667999999999, 2024-04-22T19:57:08.677 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.945476+0000", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.945476+0000", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.945490+0000", 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3285000000000001e-05 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.951584+0000", 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060944969999999999 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.951613+0000", 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8487e-05 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.951624+0000", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1147e-05 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.951714+0000", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0433000000000006e-05 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.951746+0000", 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2276000000000001e-05 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.964082+0000", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01233592 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.964141+0000", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8622999999999998e-05 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:08.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.591953595, 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:08.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:08.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:08.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.585680939, 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:08.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:08.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:08.691 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:08.693 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:08.693 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:08.693 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:08.694 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:08.694 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:08.694 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:08.694 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:08.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:08.695 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:08.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:08.695 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:08.696 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:08.689+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:08.706 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:08.729 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:08.729 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:08.749 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:08.749 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:08.807 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:08.805+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:08.816 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:08.817 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:08.829 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:08.915 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:08.913+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:08.995 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:08.993+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:08.996 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:08.997 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:09.096 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:09.093+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:09.169 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:09.170 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:09.197 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:09.193+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:09.297 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:09.297+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:09.305 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:09.305 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.323 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:09.398 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:09.393+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:09.498 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:09.497+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:09.511 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:09.511 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.533 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:09.599 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:09.597+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:09.700 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:09.697+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:09.706 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:09.706 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.729 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:09.819 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:09.817+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:09.901 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:09.897+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:09.918 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:09.918 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:09.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:10.024 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:10.021+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:10.104 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:10.101+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:10.137 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:10.137 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:10.159 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:10.205 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:10.201+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:10.306 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:10.305+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:10.343 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:10.343 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:10.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:10.406 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:10.401+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:10.506 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:10.505+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:10.510 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:10.510 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:10.511 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:57:10.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:10.611 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:10.605+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:10.707 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:10.704+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:10.709 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:10.709 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:10.725 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:10.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:10.811 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:10.809+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:10.905 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:10.906 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:10.909 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:10.905+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:10.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:10.929 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:10.929 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:10.950 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:10.953 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:10.972 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:10.972 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:10.992 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:10.992 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:11.009 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:11.008+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:11.012 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:11.012 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:11.033 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:11.033 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:11.053 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:11.053 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3234 3.28 3:1711b927:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.064190+0000", 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.0089724330000000001, 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090044860000000008, 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.072 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "waiting for sub ops", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3234 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.064190+0000", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.064190+0000", 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.064192+0000", 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999998e-06 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.067928+0000", 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037365810000000001 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.067948+0000", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9555000000000002e-05 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.067957+0000", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4579999999999999e-06 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.068108+0000", 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015040299999999999 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.068509+0000", 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040178499999999999 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.068916+0000", 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040655699999999999 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-04-22T19:57:11.076 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 1 2024-04-22T19:57:11.077 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:11.083 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:11.084 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:11.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:11.155 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:11.153+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:11.211 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:11.205+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:11.289 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:11.289 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:11.289 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:11.289 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:11.289 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:11.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:11.354 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:11.352+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:11.412 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:11.409+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.808001443999999, 2024-04-22T19:57:11.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:11.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.018055220999997, 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.449 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:11.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:57:11.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:57:11.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:57:11.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.744862036000001, 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:11.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:11.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.582660535999999, 2024-04-22T19:57:11.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.713385262999999, 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.466 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:11.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:11.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.663451595000002, 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:11.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:11.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:11.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2694 3.3c 3:3e8cd2c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.586758444000001, 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022644146, 2024-04-22T19:57:11.477 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2694 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854368+0000", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.854371+0000", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858414+0000", 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040434310000000001 2024-04-22T19:57:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858446+0000", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2075e-05 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858462+0000", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5928999999999999e-05 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858564+0000", 2024-04-22T19:57:11.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010190400000000001 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858753+0000", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188464 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.858940+0000", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018739200000000001 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.869020+0000", 2024-04-22T19:57:11.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010079441 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876850+0000", 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078302170000000004 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.876944+0000", 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4166999999999995e-05 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.877012+0000", 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7700999999999994e-05 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.465807333000001, 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.483 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:11.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:11.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.999765747000001, 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:57:11.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:57:11.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.946712226999999, 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:57:11.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.841758307999999, 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.673755696000001, 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:11.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.655933819000001, 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:11.510 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:11.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2797 3.1c 3:3a8f1003:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.581703896, 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022500118999999999, 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2797 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859422+0000", 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.859425+0000", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863339+0000", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039144840000000002 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863365+0000", 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6287000000000001e-05 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863378+0000", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2207e-05 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863490+0000", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112382 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863727+0000", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237292 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.863954+0000", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022681900000000001 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.878548+0000", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014594037000000001 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881743+0000", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003194887 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881840+0000", 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6805999999999994e-05 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.881922+0000", 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2354000000000005e-05 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.452280032000001, 2024-04-22T19:57:11.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:57:11.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:57:11.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.526 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.257573977, 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:11.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:11.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2853 3.1c 3:3b9c56b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 21.601962785000001, 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022545358000000001, 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2853 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839163+0000", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.839167+0000", 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5300000000000001e-06 2024-04-22T19:57:11.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846151+0000", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069846259999999999 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846194+0000", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2491999999999999e-05 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846213+0000", 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9303000000000001e-05 2024-04-22T19:57:11.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846344+0000", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013124100000000001 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846591+0000", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024625800000000001 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.846814+0000", 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022373599999999999 2024-04-22T19:57:11.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861361+0000", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014546666999999999 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861608+0000", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024709299999999999 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861667+0000", 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9153000000000001e-05 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.861709+0000", 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1258999999999999e-05 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3235 3.22 3:47196f05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.367738234, 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025078831999999999, 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3235 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073390+0000", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077353+0000", 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039628060000000001 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077379+0000", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6444999999999998e-05 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077391+0000", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1535000000000001e-05 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077464+0000", 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3126000000000004e-05 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077587+0000", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123557 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077781+0000", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019379400000000001 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.084153+0000", 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006371799 2024-04-22T19:57:11.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098324+0000", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014171359999999999 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098408+0000", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3801000000000006e-05 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098467+0000", 2024-04-22T19:57:11.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.859e-05 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3239 3.3c 3:3e67caa9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.32494694499999999, 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023402579999999999, 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.544 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3239 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116183+0000", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.596e-06 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120196+0000", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040129720000000001 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120231+0000", 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5729999999999998e-05 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120249+0000", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7280000000000001e-05 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120385+0000", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013673799999999999 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120643+0000", 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025764000000000001 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120888+0000", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024505700000000002 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.138864+0000", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017976243999999999 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139443+0000", 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057890399999999999 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139519+0000", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6005000000000002e-05 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139582+0000", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2414000000000002e-05 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3253 3.30 3:0f02255a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.251220+0000", 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.18990610299999999, 2024-04-22T19:57:11.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022281215, 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3253 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.251220+0000", 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.251220+0000", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.251222+0000", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255147+0000", 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039244270000000003 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255167+0000", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0596999999999999e-05 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255178+0000", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0896999999999999e-05 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255321+0000", 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014289399999999999 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255581+0000", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260377 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.255810+0000", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022897299999999999 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.265044+0000", 2024-04-22T19:57:11.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092336229999999998 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.273397+0000", 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083526290000000003 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.273462+0000", 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5586000000000005e-05 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:11.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.273501+0000", 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8979000000000001e-05 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.555 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:11.557 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:57:11.557 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:11.560 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:11.556+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:11.657 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:11.656+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:11.705 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:11.705 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:11.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.705 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3292 3.a 3:50cf5872:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.694408+0000", 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.012130388000000001, 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012161908000000001, 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "waiting for sub ops", 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3292 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.694408+0000", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.694408+0000", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.694412+0000", 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7400000000000002e-06 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.698794+0000", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043820450000000002 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.698832+0000", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7914999999999999e-05 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.698850+0000", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:11.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.699024+0000", 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017365499999999999 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.699248+0000", 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022457999999999999 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.699451+0000", 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000202299 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:11.710 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-04-22T19:57:11.710 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 1 2024-04-22T19:57:11.710 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:11.724 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:11.769 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:11.768+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:11.858 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:11.856+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:11.908 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:11.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:11.908 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:11.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:11.958 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:11.953+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:12.060 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:12.057+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:12.097 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:12.097 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:12.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:12.097 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:12.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 174.741562423, 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.098 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:12.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:12.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:12.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:12.104 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.818818883999995, 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.105 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:12.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.787602195000005, 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.111 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.054722957999999, 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.116 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:57:12.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.869950092000003, 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.127 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.850742179000001, 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:12.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:12.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:12.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2369 3.a 3:53be2846:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.167572843999999, 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022441539999999999, 2024-04-22T19:57:12.133 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2369 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928957+0000", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.928960+0000", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8550000000000002e-06 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933663+0000", 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047029630000000001 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933692+0000", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8992999999999998e-05 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933707+0000", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4812e-05 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.933868+0000", 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016112900000000001 2024-04-22T19:57:12.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934134+0000", 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026587900000000001 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.934554+0000", 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042021700000000002 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.950558+0000", 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016004240999999999 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951242+0000", 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00068336700000000005 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951325+0000", 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3312000000000005e-05 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.951399+0000", 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3771999999999998e-05 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.252305957000001, 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.139 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:12.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:12.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2713 3.26 3:66ce3eea:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.043412713999999, 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022347905000000001, 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2713 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053117+0000", 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.053122+0000", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3900000000000003e-06 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057314+0000", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041919979999999997 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057369+0000", 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5652000000000002e-05 2024-04-22T19:57:12.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057397+0000", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7515999999999999e-05 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057537+0000", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014015800000000001 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.057788+0000", 2024-04-22T19:57:12.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025124199999999999 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.058007+0000", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218469 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.068070+0000", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010063478000000001 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075301+0000", 2024-04-22T19:57:12.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072310050000000004 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075398+0000", 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6378000000000005e-05 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.075465+0000", 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7619000000000004e-05 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.001614066999998, 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:57:12.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:57:12.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:57:12.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.746211121000002, 2024-04-22T19:57:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.736749835000001, 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.162 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.167 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.660771319999998, 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.168 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:12.173 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.320390864, 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:12.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:12.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:12.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:12.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.180 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.306215014999999, 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:12.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:12.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.302034582000001, 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.209541083000001, 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.190 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:12.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:57:12.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2824 3.20 3:05be2077:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:12.195 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.838337216999999, 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022880451999999999, 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2824 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258193+0000", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.258195+0000", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9580000000000001e-06 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262050+0000", 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038554140000000001 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262069+0000", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785999999999999e-05 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262077+0000", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0469999999999994e-06 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262135+0000", 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7901e-05 2024-04-22T19:57:12.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262248+0000", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011288799999999999 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.262343+0000", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4738e-05 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.268630+0000", 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062879529999999998 2024-04-22T19:57:12.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.280986+0000", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012355766000000001 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281034+0000", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7460999999999998e-05 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.281073+0000", 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9539999999999998e-05 2024-04-22T19:57:12.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.609685334000002, 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.201 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2844 3.1e 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.415829343999999, 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023364238999999998, 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2844 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680701+0000", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.680703+0000", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684748+0000", 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040446969999999999 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684788+0000", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9381999999999997e-05 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684805+0000", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.684910+0000", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104974 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685130+0000", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0002198 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.685311+0000", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018140100000000001 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.695458+0000", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010146438000000001 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703883+0000", 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084251540000000007 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.703988+0000", 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.704065+0000", 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6902000000000003e-05 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.212 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.212 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:12.213 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:12.214 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:12.209+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:12.313 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:12.312+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:12.349 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:12.349 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:12.349 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:12.349 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:12.367 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:12.414 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:12.409+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:12.515 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:12.509+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:12.538 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:12.538 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:12.539 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:12.539 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:12.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:12.615 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:12.612+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 195.755478184, 2024-04-22T19:57:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.391670082000005, 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.073881938, 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2244 3.14 e75/20 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.056245414000003, 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022784914, 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631198+0000", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.631202+0000", 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4300000000000002e-06 2024-04-22T19:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.634962+0000", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037600340000000002 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635000+0000", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179999999999997e-05 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635018+0000", 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7842e-05 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635305+0000", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028665299999999999 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.635372+0000", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7656000000000004e-05 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653800+0000", 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018428155000000002 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653983+0000", 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296400000000001 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2247 3.e 3:719c073a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.035442576999998, 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022998093000000001, 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652001+0000", 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.652005+0000", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5499999999999999e-06 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657285+0000", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052803559999999999 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657323+0000", 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8339e-05 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657342+0000", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8640000000000001e-05 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657481+0000", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013925799999999999 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657738+0000", 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256483 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.657972+0000", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023367599999999999 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.671767+0000", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013795544 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674671+0000", 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029038969999999999 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674927+0000", 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025640500000000002 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.674999+0000", 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1945000000000003e-05 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2275 3.2d 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:12.714 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.752648188000002, 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022425212, 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2275 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934796+0000", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.934798+0000", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3190000000000002e-06 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938705+0000", 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039074280000000001 2024-04-22T19:57:12.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938728+0000", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2405999999999999e-05 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938738+0000", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0542e-05 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938814+0000", 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5729000000000006e-05 2024-04-22T19:57:12.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.938968+0000", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015437900000000001 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.939088+0000", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119481 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.946191+0000", 2024-04-22T19:57:12.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007102784 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957031+0000", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0108401 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957122+0000", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1686000000000003e-05 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.957221+0000", 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8357999999999996e-05 2024-04-22T19:57:12.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.124189080000001, 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:12.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:12.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:12.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.725 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2434 3.2a e77/20 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head v 77'8, mlcod=76'6)", 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 59.824512401, 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022665726000000001, 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:12.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862931+0000", 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862933+0000", 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6899999999999999e-06 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865332+0000", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023991720000000002 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865358+0000", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6123e-05 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865371+0000", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2401e-05 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865459+0000", 2024-04-22T19:57:12.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8663000000000001e-05 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.865490+0000", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0417e-05 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885515+0000", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020025233999999999 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885597+0000", 2024-04-22T19:57:12.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2026000000000004e-05 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.563472784999998, 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:12.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:12.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2736 3.3f 3:fd0f5217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.347046146, 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023203066000000001, 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.735 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2736 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340398+0000", 2024-04-22T19:57:12.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.340402+0000", 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2799999999999997e-06 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344869+0000", 2024-04-22T19:57:12.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044674559999999999 2024-04-22T19:57:12.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344906+0000", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6965999999999998e-05 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.344930+0000", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3810000000000001e-05 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345111+0000", 2024-04-22T19:57:12.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180803 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345358+0000", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024696199999999998 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.345585+0000", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000226999 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355592+0000", 2024-04-22T19:57:12.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010007446 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363387+0000", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077947240000000003 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363484+0000", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7268000000000005e-05 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.363601+0000", 2024-04-22T19:57:12.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116352 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2747 3.37 3:ee38ee50:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.232841539999999, 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02309667, 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.742 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2747 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454602+0000", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.454607+0000", 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8189999999999999e-06 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459048+0000", 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044409799999999998 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459090+0000", 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1715999999999998e-05 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459110+0000", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0066999999999999e-05 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459297+0000", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000187376 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.459704+0000", 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040662599999999999 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.460075+0000", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037066999999999997 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.474130+0000", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014055120000000001 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477416+0000", 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003285858 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477582+0000", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016643699999999999 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.477699+0000", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117001 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:12.747 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.223192839999999, 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:12.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:12.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:12.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.057210827999999, 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.753 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.930380222, 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.758 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.763 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.913869548000001, 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:12.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:12.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.767 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.718619105999998, 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:12.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2815 3.2d 3:b5d2a619:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.616116742999999, 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022636026, 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2815 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071327+0000", 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.071330+0000", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.207e-06 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077630+0000", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062994080000000003 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077666+0000", 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6662999999999998e-05 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077684+0000", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7388999999999999e-05 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.077878+0000", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019391300000000001 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078217+0000", 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033960400000000002 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.078449+0000", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231952 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.088095+0000", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096460880000000006 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093879+0000", 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057841450000000001 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093926+0000", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6836999999999999e-05 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.093963+0000", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6820000000000003e-05 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3278 3.16 e101/20 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head v 101'11, mlcod=100'8)", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:12.778 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.1359918760000001, 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024822087999999999, 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551454+0000", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.877e-06 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554034+0000", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025798100000000001 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554067+0000", 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3232000000000003e-05 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554084+0000", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6996000000000001e-05 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556707+0000", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026228359999999999 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556755+0000", 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8489000000000003e-05 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576150+0000", 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019395022000000001 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576274+0000", 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123826 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.782 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.82185708000000002, 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:12.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:12.789 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3320 3.7 3:e02e5aff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.52501197700000002, 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023607379000000001, 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:12.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3320 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162434+0000", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166484+0000", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040498620000000004 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166518+0000", 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3868999999999997e-05 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166534+0000", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166695+0000", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016118099999999999 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166964+0000", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000268509 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:12.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.167217+0000", 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025270400000000003 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.178741+0000", 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011523950999999999 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185683+0000", 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069422479999999998 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185865+0000", 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181991 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186039+0000", 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017437400000000001 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:12.795 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:12.796 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:12.736+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:12.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:12.843 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:12.841+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:12.940 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:12.937+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.019174113, 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019247057000000001, 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-04-22T19:57:12.956 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:12.968 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:13.056 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:13.053+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:13.108 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:13.155 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:13.153+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:13.161 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:13.161 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:13.161 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:13.161 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:13.161 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:13.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:13.241 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:13.240+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:13.305 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:13.305 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:13.331 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:13.331 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:13.342 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:13.340+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:13.358 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:13.358 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:13.381 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:13.381 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:13.383 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:13.383 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:13.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:13.415 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:13.415 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:13.443 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:13.440+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:13.456 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:13.456 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:13.481 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:13.481 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:13.514 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:13.515 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:13.543 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:13.540+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:13.552 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:13.552 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:13.558 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:57:13.574 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:13.664 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:13.661+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:13.746 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:13.744+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:13.756 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-22T19:57:13.756 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-22T19:57:13.756 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-22T19:57:13.756 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-22T19:57:13.756 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-22T19:57:13.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-22T19:57:13.784 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:13.785 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:13.812 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:13.846 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:13.844+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:13.906 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-22T19:57:13.906 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:13.947 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:13.945+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:14.045 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.045 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.048 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:14.045+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:14.067 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:14.155 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:14.153+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:14.250 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:14.245+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:14.275 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.276 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.291 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:14.350 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:14.348+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:14.452 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:14.448+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.489 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:14.527 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:57:14.554 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:14.552+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:14.630 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.630 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.654 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:14.655 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:14.652+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:14.755 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:14.752+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:14.799 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.799 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:14.856 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:14.852+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:14.952 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:14.952 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:14.956 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:14.953+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:14.968 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:15.058 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:15.053+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:15.142 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:15.142 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:15.156 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:15.159 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:15.156+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:quota disabled for the bucket: buck_2024_03_22_19_57_05 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 2Gb. 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-22T19:57:15.185 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:57:15.260 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:15.256+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:15.292 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:15.292 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:15.306 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:15.361 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:15.357+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:15.424 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:57:15.424 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:57:15.463 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:15.460+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:15.479 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:15.479 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:15.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:15.538 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:15.587 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:15.585+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:15.659 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:15.659 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:15.664 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:15.660+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:15.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:15.683 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:15.684 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:15.699 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:15.700 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:15.716 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:15.716 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:15.732 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:15.732 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:15.764 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:15.760+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:15.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:15.769 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:15.786 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:15.806 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:15.806 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:15.841 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:15.841 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:15.841 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:15.841 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:15.855 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:15.897 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:15.896+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:15.966 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:15.961+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:16.013 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:16.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:16.013 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:16.027 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:16.067 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:16.065+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:16.151 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.516966103000001, 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:16.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:16.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 64.72701988, 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:57:16.157 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:57:16.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.453826694999997, 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.163 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:16.168 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.291625195000002, 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.169 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:16.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:16.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:16.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.422349921999999, 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.175 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.372416254000001, 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:16.180 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:16.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:16.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:16.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.174771992, 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:16.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:16.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.708730406000001, 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.655676885999998, 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.196 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:57:16.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.201 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.550722966999999, 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:16.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:16.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:16.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:16.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:16.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.382720355, 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:16.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:16.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.364898478000001, 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:16.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.161244691, 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.219 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:57:16.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:57:16.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:57:16.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.966538635999999, 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.224 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3235 3.22 3:47196f05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0767028930000002, 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025078831999999999, 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3235 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.230 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073390+0000", 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077353+0000", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039628060000000001 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077379+0000", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6444999999999998e-05 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077391+0000", 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1535000000000001e-05 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077464+0000", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3126000000000004e-05 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077587+0000", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123557 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077781+0000", 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019379400000000001 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.084153+0000", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006371799 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098324+0000", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014171359999999999 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098408+0000", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3801000000000006e-05 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098467+0000", 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.859e-05 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3239 3.3c 3:3e67caa9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.033911604, 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023402579999999999, 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3239 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116183+0000", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.596e-06 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120196+0000", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040129720000000001 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120231+0000", 2024-04-22T19:57:16.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5729999999999998e-05 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120249+0000", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7280000000000001e-05 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120385+0000", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013673799999999999 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120643+0000", 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025764000000000001 2024-04-22T19:57:16.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120888+0000", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024505700000000002 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.138864+0000", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017976243999999999 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139443+0000", 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057890399999999999 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139519+0000", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6005000000000002e-05 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139582+0000", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2414000000000002e-05 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3277 3.16 3:6a27634a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:16.240 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.617222591, 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034380834999999998, 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3277 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:16.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532872+0000", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1230000000000002e-06 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536901+0000", 2024-04-22T19:57:16.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004028836 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536940+0000", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8492999999999999e-05 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536961+0000", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996999999999999e-05 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537101+0000", 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014023799999999999 2024-04-22T19:57:16.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537112+0000", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0993e-05 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543074+0000", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059622640000000001 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543288+0000", 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021412699999999999 2024-04-22T19:57:16.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543497+0000", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020925699999999999 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.559753+0000", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016255281 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567096+0000", 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073434069999999997 2024-04-22T19:57:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567191+0000", 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4450000000000005e-05 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567249+0000", 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8369000000000003e-05 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.246 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3278 3.16 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6077592799999998, 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034344214999999997, 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3278 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:16.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542341+0000", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8339999999999994e-06 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549253+0000", 2024-04-22T19:57:16.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069115189999999996 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549276+0000", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3694e-05 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549287+0000", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0407e-05 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550496+0000", 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012090149999999999 2024-04-22T19:57:16.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550835+0000", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033953199999999997 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551236+0000", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040053199999999999 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.562553+0000", 2024-04-22T19:57:16.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011317081999999999 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576510+0000", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013957093 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576604+0000", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3729999999999999e-05 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576676+0000", 2024-04-22T19:57:16.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1777000000000001e-05 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3357 3.1d 3:bba822d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.312170697, 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035607101000000002, 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3357 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837924+0000", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846158+0000", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082345400000000003 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846215+0000", 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6678999999999997e-05 2024-04-22T19:57:16.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846244+0000", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8914000000000001e-05 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846452+0000", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000208703 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846917+0000", 2024-04-22T19:57:16.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046460799999999998 2024-04-22T19:57:16.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.847336+0000", 2024-04-22T19:57:16.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041877700000000001 2024-04-22T19:57:16.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.865281+0000", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017945699999999998 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873242+0000", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079604710000000002 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873407+0000", 2024-04-22T19:57:16.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016511100000000001 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873527+0000", 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119981 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3366 3.38 3:1fa2a2cd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.1897045300000002, 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025852145, 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.259 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3366 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:16.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960390+0000", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3159999999999998e-06 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965634+0000", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052432850000000003 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965678+0000", 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4409999999999997e-05 2024-04-22T19:57:16.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965699+0000", 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0496000000000002e-05 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965828+0000", 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012986200000000001 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.966066+0000", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237636 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.966288+0000", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022157399999999999 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.983391+0000", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017103296 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.985922+0000", 2024-04-22T19:57:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025309550000000001 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.986099+0000", 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176584 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.986238+0000", 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013973100000000001 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.265 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.265 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:16.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:16.267 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:16.264+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:16.368 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:16.365+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:16.436 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:16.436 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:16.436 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:16.436 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:16.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:16.497 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:16.496+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:16.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:57:16.569 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:16.569 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:16.569 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:16.570 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:16.568+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:16.583 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:16.673 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:16.672+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 179.40411641399999, 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:16.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:16.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.481372875000005, 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.769 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:16.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:16.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.774 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.450156186000001, 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:16.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.717276948999995, 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.780 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:16.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:57:16.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.532504083000006, 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:16.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:16.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:16.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.513296170000004, 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:16.791 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.914859948, 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:16.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:16.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:16.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.664168058000001, 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.802 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:16.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:57:16.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:57:16.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:57:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.408765112000001, 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:16.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:16.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.399303826000001, 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.813 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.818 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.323325311000001, 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:16.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:16.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:16.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:16.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:16.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.982944855, 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.829 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.968769005999999, 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.964588573, 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.834 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.839 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.872095074000001, 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:16.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:57:16.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:57:16.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:57:16.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.272239325000001, 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:16.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:16.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:16.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3317 3.33 3:cdd532a6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6597489740000002, 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025528266000000001, 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3317 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099338+0000", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7099999999999999e-06 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103472+0000", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041343300000000003 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103517+0000", 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4532e-05 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103535+0000", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103684+0000", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014927199999999999 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103924+0000", 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023997999999999999 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.104145+0000", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220504 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.113969+0000", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098247479999999995 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124565+0000", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010595597999999999 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124739+0000", 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413699999999999 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124863+0000", 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124132 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3321 3.2c 3:35681247:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_250:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.5766871069999997, 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026053086, 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3321 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182400+0000", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0900000000000001e-06 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186489+0000", 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040895039999999999 2024-04-22T19:57:16.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186524+0000", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4136e-05 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186540+0000", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6753e-05 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186616+0000", 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5519999999999995e-05 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186729+0000", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113496 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186832+0000", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010238099999999999 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.191251+0000", 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044196019999999999 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208324+0000", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017072952999999998 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208376+0000", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1752000000000002e-05 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208450+0000", 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3899000000000005e-05 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3359 3.26 3:67f9ce04:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_288:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.8962193210000002, 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025005466, 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3359 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862869+0000", 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870370+0000", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075017440000000003 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870409+0000", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8469e-05 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870433+0000", 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4216999999999999e-05 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870622+0000", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018929999999999999 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.871036+0000", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041361499999999999 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.871426+0000", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038962099999999999 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:16.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.884610+0000", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013183942000000001 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887700+0000", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030907349999999998 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887797+0000", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7182000000000006e-05 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887870+0000", 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2705000000000003e-05 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3399 3.3f e101/20 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head v 101'14, mlcod=101'12)", 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.4221354179999999, 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025146168, 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:16.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336951+0000", 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339852+0000", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029010009999999998 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339885+0000", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2869e-05 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339912+0000", 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7013e-05 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340045+0000", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133258 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340108+0000", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2508999999999994e-05 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361969+0000", 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021861275999999999 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:16.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362095+0000", 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012573200000000001 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:16.870 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:16.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:16.871 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:16.869+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:16.972 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:16.968+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:17.041 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:17.041 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:17.041 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:17.042 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:17.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:17.101 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:17.100+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:17.174 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:17.172+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:17.223 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:17.223 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:17.223 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:17.237 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:17.281 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:17.280+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:17.376 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:17.372+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:17.411 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 200.47689107599999, 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.113082973999994, 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.417 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:17.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.422 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.795294830000003, 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:17.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:17.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.845601971999997, 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.284885676999998, 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.434 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:17.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:17.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.944605731999999, 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:17.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:17.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:17.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:17.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.778623719999999, 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.651793114, 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:17.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:17.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.454 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.635282440000001, 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.440031997999998, 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3278 3.16 e101/20 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head v 101'11, mlcod=100'8)", 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8574047680000003, 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024822087999999999, 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551454+0000", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.877e-06 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554034+0000", 2024-04-22T19:57:17.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025798100000000001 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554067+0000", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3232000000000003e-05 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554084+0000", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6996000000000001e-05 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556707+0000", 2024-04-22T19:57:17.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026228359999999999 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556755+0000", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8489000000000003e-05 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576150+0000", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019395022000000001 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576274+0000", 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123826 2024-04-22T19:57:17.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.543269972, 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:17.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:17.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:17.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3320 3.7 3:e02e5aff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2464248690000002, 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023607379000000001, 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.473 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3320 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162434+0000", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166484+0000", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040498620000000004 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166518+0000", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3868999999999997e-05 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166534+0000", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166695+0000", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016118099999999999 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166964+0000", 2024-04-22T19:57:17.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000268509 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.167217+0000", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025270400000000003 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.178741+0000", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011523950999999999 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185683+0000", 2024-04-22T19:57:17.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069422479999999998 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185865+0000", 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181991 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186039+0000", 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017437400000000001 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3374 3.f 3:f24b7435:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3527012679999997, 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033085672000000003, 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3374 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056160+0000", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5399999999999997e-06 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063543+0000", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007383265 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063586+0000", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2363000000000001e-05 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063604+0000", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063742+0000", 2024-04-22T19:57:17.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138071 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064038+0000", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000296283 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064258+0000", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022030699999999999 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.083221+0000", 2024-04-22T19:57:17.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018962946000000001 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089044+0000", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058230189999999996 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089144+0000", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9046e-05 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089241+0000", 2024-04-22T19:57:17.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3380 3.e 3:70445021:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_309:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.2890892010000004, 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026443379999999999, 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119801+0000", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3569000000000003e-05 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127712+0000", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079112230000000002 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127756+0000", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3205999999999999e-05 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127775+0000", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9643000000000001e-05 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127957+0000", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018173399999999999 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128368+0000", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041124899999999998 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128788+0000", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042035800000000002 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.144721+0000", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015932720000000001 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.145980+0000", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012590310000000001 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146082+0000", 2024-04-22T19:57:17.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101326 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146211+0000", 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129321 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3387 3.e 3:708e763d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_316:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.211990535, 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024449419, 2024-04-22T19:57:17.489 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3387 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196870+0000", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7799999999999998e-06 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203634+0000", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067638339999999998 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203667+0000", 2024-04-22T19:57:17.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2756999999999998e-05 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203684+0000", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7356000000000001e-05 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203839+0000", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015536099999999999 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204091+0000", 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025196000000000002 2024-04-22T19:57:17.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204327+0000", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023566700000000001 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.213672+0000", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093453379999999999 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221143+0000", 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074708880000000002 2024-04-22T19:57:17.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221242+0000", 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9209000000000005e-05 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221316+0000", 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3269000000000006e-05 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3394 3.d 3:b0ab1424:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_323:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.1355207180000004, 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030154717000000001, 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3394 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273340+0000", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2729999999999996e-06 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279108+0000", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057675139999999996 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279162+0000", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3906000000000002e-05 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279183+0000", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1403000000000002e-05 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279330+0000", 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014687500000000001 2024-04-22T19:57:17.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279588+0000", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258063 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279888+0000", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.289608+0000", 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097194659999999995 2024-04-22T19:57:17.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303262+0000", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013653983 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303405+0000", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014306200000000001 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303491+0000", 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5912e-05 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.499 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3399 3.3f 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0778128249999996, 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031545288999999997, 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3399 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331047+0000", 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0529999999999998e-06 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335945+0000", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048978110000000002 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335986+0000", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.083e-05 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336004+0000", 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8629000000000001e-05 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336185+0000", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180898 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336448+0000", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026270699999999999 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336683+0000", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023544700000000001 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.348895+0000", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012212015 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362409+0000", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013513588 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362506+0000", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7613000000000002e-05 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362589+0000", 2024-04-22T19:57:17.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2698e-05 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3400 3.7 3:e3be52ca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0679830429999999, 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024819051000000002, 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.505 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3400 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340877+0000", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1930000000000002e-06 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345072+0000", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041953030000000001 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345118+0000", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5479999999999998e-05 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345145+0000", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7368999999999998e-05 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345315+0000", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017041499999999999 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345717+0000", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040180199999999999 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.346104+0000", 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038631800000000002 2024-04-22T19:57:17.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361555+0000", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015451327000000001 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365554+0000", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039992659999999996 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365635+0000", 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1071999999999999e-05 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365693+0000", 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7506000000000001e-05 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3402 3.e 3:7192c845:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0454290559999997, 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847825999999999, 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:17.510 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3402 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:17.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363430+0000", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367479+0000", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040487550000000002 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:17.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367516+0000", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6980000000000002e-05 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367537+0000", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367686+0000", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994499999999999 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368010+0000", 2024-04-22T19:57:17.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032352200000000002 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368230+0000", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021993100000000001 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.380292+0000", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012061776 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387068+0000", 2024-04-22T19:57:17.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067766900000000001 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387203+0000", 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013484200000000001 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387275+0000", 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2245999999999999e-05 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:17.515 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:17.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:17.517 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:17.513+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:17.539 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:57:17.619 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:17.617+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:17.654 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:17.654 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:17.654 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:17.655 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:17.667 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:17.755 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:17.753+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:17.818 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:17.816+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:17.826 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:17.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:17.829 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:17.829 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:17.829 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:17.829 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:17.842 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:17.935 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:17.933+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:17.966 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:17.966 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:17.982 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:17.983 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:17.998 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:18.014 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:18.014 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:18.015 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.015 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.020 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:18.016+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:18.028 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:18.035 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:18.035 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:18.055 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:18.055 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:18.074 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:18.095 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:18.095 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:18.121 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:18.116+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:18.145 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.145 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.158 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:18.221 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:18.216+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:18.313 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.314 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.321 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:18.320+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:18.327 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:18.422 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:18.417+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:18.442 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.442 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:18.547 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:18.545+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:18.623 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:18.621+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:18.626 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.626 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:18.724 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:18.720+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:18.807 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.807 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.821 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:18.867 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:18.865+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:18.926 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:18.924+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:18.938 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:18.938 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:18.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:19.026 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:19.024+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:19.119 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.119 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.127 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:19.124+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:19.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:19.228 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:19.224+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:19.250 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.250 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.265 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:19.329 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:19.324+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:19.383 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.383 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:19.445 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:19.444+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:19.528 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.528 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.531 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:19.525+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:19.544 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:19.574 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:57:19.631 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:19.628+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.709 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.723 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:19.732 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:19.729+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:19.833 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:19.829+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:19.892 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:19.892 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:19.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:19.953 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:19.952+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:20.025 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:20.025 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:20.035 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:20.029+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:20.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:20.111 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:20.135 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:20.132+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:20.203 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:20.203 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:20.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:20.236 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:20.233+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:20.264 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:20.264 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:20.281 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:20.281 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:20.297 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:20.297 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:20.315 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:20.315 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:20.334 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:20.334 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:20.337 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:20.333+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:20.354 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:20.354 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:20.374 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:20.374 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.752954736000007, 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:20.389 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:20.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2321 3.3c 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 68.963008513000005, 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022986759999999998, 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.395 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2321 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423071+0000", 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.423073+0000", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1440000000000001e-06 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426953+0000", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038796159999999998 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426975+0000", 2024-04-22T19:57:20.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2821000000000001e-05 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.426986+0000", 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0643e-05 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427058+0000", 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1692000000000004e-05 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427184+0000", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125826 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.427293+0000", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001093 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.433146+0000", 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058532339999999997 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445920+0000", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012774429 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.445991+0000", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0034000000000001e-05 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.446058+0000", 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7020999999999994e-05 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.689815327999995, 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:20.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.527613828, 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.658338555, 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.412 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:20.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:20.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:20.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.608404886999999, 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.418 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:20.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.410760625000002, 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:20.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2745 3.35 e93/20 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head v 93'7, mlcod=93'5)", 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.944719038999999, 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023890066000000001, 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441360+0000", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441363+0000", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9189999999999999e-06 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443955+0000", 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025920689999999998 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.443995+0000", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9776e-05 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444013+0000", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309e-05 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444150+0000", 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137138 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.444193+0000", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2342000000000002e-05 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464856+0000", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020663303000000001 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465250+0000", 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039420999999999998 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.433 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2751 3.5 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.891665519, 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026318404, 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.434 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2751 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494414+0000", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.494419+0000", 2024-04-22T19:57:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2900000000000002e-06 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500162+0000", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057433659999999997 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500202+0000", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9099e-05 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500221+0000", 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.927e-05 2024-04-22T19:57:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500364+0000", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357000000000001 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500665+0000", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026800000000002 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.500923+0000", 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258049 2024-04-22T19:57:20.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.510806+0000", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098836749999999998 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520563+0000", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097570439999999994 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520661+0000", 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7560999999999996e-05 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.520732+0000", 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1211999999999995e-05 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.7867116, 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.439 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:20.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:20.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.444 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.618708988000002, 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:20.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:20.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:20.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:20.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.600887110999999, 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:20.450 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2808 3.2 3:4136c78a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.397233323999998, 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025946736000000001, 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2808 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988846+0000", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.988850+0000", 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994686+0000", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058360579999999999 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994703+0000", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527999999999999e-05 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994711+0000", 2024-04-22T19:57:20.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0320000000000003e-06 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994842+0000", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013094699999999999 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995115+0000", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027272800000000002 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.995334+0000", 2024-04-22T19:57:20.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000219139 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.005993+0000", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010658561 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014644+0000", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086509029999999997 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014725+0000", 2024-04-22T19:57:20.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1477999999999995e-05 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.014793+0000", 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7658999999999997e-05 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.202527269000001, 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.461 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:20.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:20.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3235 3.22 3:47196f05:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3126915260000001, 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025078831999999999, 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3235 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.467 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073388+0000", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.073390+0000", 2024-04-22T19:57:20.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077353+0000", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039628060000000001 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077379+0000", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6444999999999998e-05 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077391+0000", 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1535000000000001e-05 2024-04-22T19:57:20.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077464+0000", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3126000000000004e-05 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077587+0000", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123557 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.077781+0000", 2024-04-22T19:57:20.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019379400000000001 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.084153+0000", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006371799 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098324+0000", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014171359999999999 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098408+0000", 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3801000000000006e-05 2024-04-22T19:57:20.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.098467+0000", 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.859e-05 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3239 3.3c 3:3e67caa9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2699002369999999, 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023402579999999999, 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.472 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3239 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116179+0000", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.116183+0000", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.596e-06 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120196+0000", 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040129720000000001 2024-04-22T19:57:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120231+0000", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5729999999999998e-05 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120249+0000", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7280000000000001e-05 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120385+0000", 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013673799999999999 2024-04-22T19:57:20.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120643+0000", 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025764000000000001 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.120888+0000", 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024505700000000002 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.138864+0000", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017976243999999999 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139443+0000", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057890399999999999 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139519+0000", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6005000000000002e-05 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.139582+0000", 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2414000000000002e-05 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3277 3.16 3:6a27634a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8532112240000007, 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034380834999999998, 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.478 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3277 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:20.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532872+0000", 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1230000000000002e-06 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536901+0000", 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004028836 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536940+0000", 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8492999999999999e-05 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536961+0000", 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996999999999999e-05 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537101+0000", 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014023799999999999 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537112+0000", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0993e-05 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543074+0000", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059622640000000001 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543288+0000", 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021412699999999999 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543497+0000", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020925699999999999 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.559753+0000", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016255281 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567096+0000", 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073434069999999997 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567191+0000", 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4450000000000005e-05 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567249+0000", 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8369000000000003e-05 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3278 3.16 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:20.484 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8437479129999996, 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034344214999999997, 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3278 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542341+0000", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8339999999999994e-06 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549253+0000", 2024-04-22T19:57:20.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069115189999999996 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549276+0000", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3694e-05 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549287+0000", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0407e-05 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550496+0000", 2024-04-22T19:57:20.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012090149999999999 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550835+0000", 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033953199999999997 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551236+0000", 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040053199999999999 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.562553+0000", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011317081999999999 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576510+0000", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013957093 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576604+0000", 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3729999999999999e-05 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576676+0000", 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1777000000000001e-05 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3357 3.1d 3:bba822d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5481593299999998, 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035607101000000002, 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.490 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3357 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837924+0000", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846158+0000", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082345400000000003 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846215+0000", 2024-04-22T19:57:20.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6678999999999997e-05 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846244+0000", 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8914000000000001e-05 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846452+0000", 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000208703 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846917+0000", 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046460799999999998 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.847336+0000", 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041877700000000001 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.865281+0000", 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017945699999999998 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873242+0000", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079604710000000002 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873407+0000", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016511100000000001 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873527+0000", 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119981 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.495 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3366 3.38 3:1fa2a2cd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.425693163, 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025852145, 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.496 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3366 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960386+0000", 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.960390+0000", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3159999999999998e-06 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965634+0000", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052432850000000003 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965678+0000", 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4409999999999997e-05 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965699+0000", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0496000000000002e-05 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.965828+0000", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012986200000000001 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.966066+0000", 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237636 2024-04-22T19:57:20.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.966288+0000", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022157399999999999 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.983391+0000", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017103296 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.985922+0000", 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025309550000000001 2024-04-22T19:57:20.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.986099+0000", 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176584 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.986238+0000", 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013973100000000001 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.501 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:20.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:20.503 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:20.504 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:20.500+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:20.504 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:20.538 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:57:20.607 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:20.605+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:20.675 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:20.690 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:20.705 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:20.701+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:20.805 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:20.801+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:20.812 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:20.812 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:20.812 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:20.812 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:20.812 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:20.826 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:20.906 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:20.901+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:20.953 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:20.953 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:20.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:20.953 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:20.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 183.59555177300001, 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:20.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:20.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:20.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:20.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 83.672808234000001, 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:20.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:20.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:20.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 83.641591544999997, 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2285 3.20 3:06862867:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.908712308000005, 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024590638000000001, 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2285 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041807+0000", 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.041809+0000", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.716e-06 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046470+0000", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046616310000000003 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046504+0000", 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3219000000000002e-05 2024-04-22T19:57:20.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046520+0000", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6820000000000002e-05 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046606+0000", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5311999999999999e-05 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046746+0000", 2024-04-22T19:57:20.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014065099999999999 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.046875+0000", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012870399999999999 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.052990+0000", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061148590000000003 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066236+0000", 2024-04-22T19:57:20.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245717000000001 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066321+0000", 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4932000000000006e-05 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.066398+0000", 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7076999999999994e-05 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.723939442000002, 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:20.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:20.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:20.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.704731529, 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:20.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:20.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.106295307000003, 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.989 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:20.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:20.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2717 3.2c 3:3512fc40:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.855603416999998, 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024447963, 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:20.995 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2717 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094916+0000", 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:20.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.094920+0000", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4440000000000001e-06 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099040+0000", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041200560000000004 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099088+0000", 2024-04-22T19:57:20.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8041999999999998e-05 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099116+0000", 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7143000000000001e-05 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099293+0000", 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017787 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:20.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099543+0000", 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249869 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.099781+0000", 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023775200000000001 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.109711+0000", 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099299130000000003 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:20.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119199+0000", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094876170000000003 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119291+0000", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2075000000000002e-05 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.119364+0000", 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3182000000000005e-05 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.600200471000001, 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:21.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:21.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:21.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:21.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2738 3.10 3:0ae6a53e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.590739184999997, 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026089518999999999, 2024-04-22T19:57:21.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2738 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359780+0000", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.359783+0000", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8040000000000002e-06 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367304+0000", 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075208389999999996 2024-04-22T19:57:21.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367341+0000", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7021999999999999e-05 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367365+0000", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4587e-05 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367522+0000", 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000156737 2024-04-22T19:57:21.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.367773+0000", 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025045800000000001 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.368003+0000", 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022999300000000001 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376554+0000", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085515599999999997 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385581+0000", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090267639999999996 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385754+0000", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017320000000000001 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.385870+0000", 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115555 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.514760670000001, 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.174380214000003, 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:21.023 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.160204364999998, 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:21.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.156023931999997, 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.028 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:21.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2800 3.36 3:6dabb045:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.063530432999997, 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024624045000000001, 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2800 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.034 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886989+0000", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.886994+0000", 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7929999999999997e-06 2024-04-22T19:57:21.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891054+0000", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040606449999999999 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891102+0000", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8049e-05 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891123+0000", 2024-04-22T19:57:21.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0225999999999999e-05 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891236+0000", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011336900000000001 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891449+0000", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000213167 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.891656+0000", 2024-04-22T19:57:21.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020677099999999999 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.899795+0000", 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081390409999999996 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911463+0000", 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011667827 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911546+0000", 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3577000000000003e-05 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.911613+0000", 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6580000000000003e-05 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.039 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.463674684000001, 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:21.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:21.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3317 3.33 3:cdd532a6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8511843329999991, 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025528266000000001, 2024-04-22T19:57:21.045 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3317 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:21.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099335+0000", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.099338+0000", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7099999999999999e-06 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103472+0000", 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041343300000000003 2024-04-22T19:57:21.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103517+0000", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4532e-05 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103535+0000", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8323000000000001e-05 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103684+0000", 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014927199999999999 2024-04-22T19:57:21.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.103924+0000", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023997999999999999 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.104145+0000", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220504 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.113969+0000", 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098247479999999995 2024-04-22T19:57:21.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124565+0000", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010595597999999999 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124739+0000", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413699999999999 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.124863+0000", 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124132 2024-04-22T19:57:21.050 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3321 3.2c 3:35681247:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_250:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.7681224659999994, 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026053086, 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.051 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3321 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182397+0000", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.182400+0000", 2024-04-22T19:57:21.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0900000000000001e-06 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186489+0000", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040895039999999999 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186524+0000", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4136e-05 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186540+0000", 2024-04-22T19:57:21.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6753e-05 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186616+0000", 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5519999999999995e-05 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186729+0000", 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113496 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186832+0000", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010238099999999999 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.191251+0000", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044196019999999999 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208324+0000", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017072952999999998 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208376+0000", 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1752000000000002e-05 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.208450+0000", 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3899000000000005e-05 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3359 3.26 3:67f9ce04:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_288:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.08765468, 2024-04-22T19:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025005466, 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3359 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862865+0000", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.862869+0000", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9360000000000001e-06 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870370+0000", 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075017440000000003 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870409+0000", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8469e-05 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870433+0000", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4216999999999999e-05 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.870622+0000", 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018929999999999999 2024-04-22T19:57:21.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.871036+0000", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041361499999999999 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.871426+0000", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038962099999999999 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.884610+0000", 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013183942000000001 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887700+0000", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030907349999999998 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887797+0000", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7182000000000006e-05 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.887870+0000", 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2705000000000003e-05 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.061 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3399 3.3f e101/20 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head v 101'14, mlcod=101'12)", 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.6135707769999996, 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025146168, 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:21.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336949+0000", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336951+0000", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339852+0000", 2024-04-22T19:57:21.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029010009999999998 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339885+0000", 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2869e-05 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.339912+0000", 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7013e-05 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340045+0000", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133258 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340108+0000", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2508999999999994e-05 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361969+0000", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021861275999999999 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362095+0000", 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012573200000000001 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.066 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:21.067 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:21.068 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:21.065+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:21.168 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:21.164+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:21.195 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:21.195 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:21.195 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:21.209 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:21.301 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:21.300+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:21.370 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:21.368+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:21.386 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:21.386 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:21.386 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:21.386 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:21.386 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:21.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:21.489 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:21.488+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 204.63582116800001, 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 83.272013066, 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.954224921999995, 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.004532064000003, 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.443815768999997, 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.103535823999998, 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.937553811999997, 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.810723205999999, 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.794212532000003, 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.598962090000001, 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3278 3.16 e101/20 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head v 101'11, mlcod=100'8)", 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.016334860000001, 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024822087999999999, 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551454+0000", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.877e-06 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554034+0000", 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025798100000000001 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554067+0000", 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3232000000000003e-05 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554084+0000", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6996000000000001e-05 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556707+0000", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026228359999999999 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556755+0000", 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8489000000000003e-05 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576150+0000", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019395022000000001 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576274+0000", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123826 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.7022000639999995, 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3320 3.7 3:e02e5aff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.4053549610000005, 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023607379000000001, 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3320 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162434+0000", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166484+0000", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040498620000000004 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166518+0000", 2024-04-22T19:57:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3868999999999997e-05 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166534+0000", 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:57:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166695+0000", 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016118099999999999 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166964+0000", 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000268509 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.167217+0000", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025270400000000003 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.178741+0000", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011523950999999999 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185683+0000", 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069422479999999998 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185865+0000", 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181991 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186039+0000", 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017437400000000001 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3374 3.f 3:f24b7435:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5116313599999991, 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033085672000000003, 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3374 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056160+0000", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5399999999999997e-06 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063543+0000", 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007383265 2024-04-22T19:57:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063586+0000", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2363000000000001e-05 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063604+0000", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063742+0000", 2024-04-22T19:57:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138071 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064038+0000", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000296283 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064258+0000", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022030699999999999 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.083221+0000", 2024-04-22T19:57:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018962946000000001 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089044+0000", 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058230189999999996 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089144+0000", 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9046e-05 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089241+0000", 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3380 3.e 3:70445021:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_309:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.4480192929999998, 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026443379999999999, 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119801+0000", 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3569000000000003e-05 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127712+0000", 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079112230000000002 2024-04-22T19:57:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127756+0000", 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3205999999999999e-05 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127775+0000", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9643000000000001e-05 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127957+0000", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018173399999999999 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128368+0000", 2024-04-22T19:57:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041124899999999998 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128788+0000", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042035800000000002 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.144721+0000", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015932720000000001 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.145980+0000", 2024-04-22T19:57:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012590310000000001 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146082+0000", 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101326 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146211+0000", 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129321 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3387 3.e 3:708e763d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_316:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.3709206270000003, 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024449419, 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3387 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196870+0000", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7799999999999998e-06 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203634+0000", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067638339999999998 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203667+0000", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2756999999999998e-05 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203684+0000", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7356000000000001e-05 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203839+0000", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015536099999999999 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204091+0000", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025196000000000002 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204327+0000", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023566700000000001 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.213672+0000", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093453379999999999 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221143+0000", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074708880000000002 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221242+0000", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9209000000000005e-05 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221316+0000", 2024-04-22T19:57:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3269000000000006e-05 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3394 3.d 3:b0ab1424:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_323:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2944508100000007, 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030154717000000001, 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3394 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273340+0000", 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2729999999999996e-06 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279108+0000", 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057675139999999996 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279162+0000", 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3906000000000002e-05 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279183+0000", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1403000000000002e-05 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279330+0000", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014687500000000001 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279588+0000", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258063 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279888+0000", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.289608+0000", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097194659999999995 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303262+0000", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013653983 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303405+0000", 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014306200000000001 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303491+0000", 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5912e-05 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3399 3.3f 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2367429170000008, 2024-04-22T19:57:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031545288999999997, 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3399 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331047+0000", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0529999999999998e-06 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335945+0000", 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048978110000000002 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335986+0000", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.083e-05 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336004+0000", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8629000000000001e-05 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336185+0000", 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180898 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336448+0000", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026270699999999999 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336683+0000", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023544700000000001 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.348895+0000", 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012212015 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362409+0000", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013513588 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362506+0000", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7613000000000002e-05 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362589+0000", 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2698e-05 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3400 3.7 3:e3be52ca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2269131350000002, 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024819051000000002, 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3400 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340877+0000", 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1930000000000002e-06 2024-04-22T19:57:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345072+0000", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041953030000000001 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345118+0000", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5479999999999998e-05 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345145+0000", 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7368999999999998e-05 2024-04-22T19:57:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345315+0000", 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017041499999999999 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345717+0000", 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040180199999999999 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.346104+0000", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038631800000000002 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361555+0000", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015451327000000001 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365554+0000", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039992659999999996 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365635+0000", 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1071999999999999e-05 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365693+0000", 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7506000000000001e-05 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3402 3.e 3:7192c845:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.204359148, 2024-04-22T19:57:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847825999999999, 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3402 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363430+0000", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367479+0000", 2024-04-22T19:57:21.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040487550000000002 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367516+0000", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6980000000000002e-05 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367537+0000", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367686+0000", 2024-04-22T19:57:21.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994499999999999 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368010+0000", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032352200000000002 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368230+0000", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021993100000000001 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.380292+0000", 2024-04-22T19:57:21.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012061776 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387068+0000", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067766900000000001 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387203+0000", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013484200000000001 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387275+0000", 2024-04-22T19:57:21.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2245999999999999e-05 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:21.683 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:21.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:21.685 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:21.680+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:21.785 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:21.781+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:21.831 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:21.886 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:21.884+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:21.987 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:21.984+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:22.000 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:22.000 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:22.014 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:22.088 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:22.085+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 71.498278424000006, 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:22.141 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:22.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.538930933000003, 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:22.147 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.152 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.374080499999998, 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:22.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.153401559999999, 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:22.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:22.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2727 3.23 3:c759b3e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.917123236000002, 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020866947, 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2727 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221189+0000", 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9210000000000001e-06 2024-04-22T19:57:22.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223161+0000", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019713899999999999 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223204+0000", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3235999999999997e-05 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223232+0000", 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7869e-05 2024-04-22T19:57:22.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223346+0000", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011461899999999999 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223529+0000", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018233799999999999 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223699+0000", 2024-04-22T19:57:22.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170459 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.232297+0000", 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085980680000000004 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.241931+0000", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096342200000000006 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242001+0000", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9760999999999998e-05 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242053+0000", 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2065999999999999e-05 2024-04-22T19:57:22.170 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2752 3.32 3:4dcc7a09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.634720801, 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021065733999999999, 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.171 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2752 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503592+0000", 2024-04-22T19:57:22.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1640000000000001e-06 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505558+0000", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661930000000002 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505608+0000", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9957999999999998e-05 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505626+0000", 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7927999999999998e-05 2024-04-22T19:57:22.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505735+0000", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010932799999999999 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505919+0000", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000183356 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506080+0000", 2024-04-22T19:57:22.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016146800000000001 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.521592+0000", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015511723 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524530+0000", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029378490000000002 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524600+0000", 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9931000000000005e-05 2024-04-22T19:57:22.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524654+0000", 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4836000000000001e-05 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.428716819000002, 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.176 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:22.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:22.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2794 3.24 e93/89 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head v 93'8, mlcod=92'6)", 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.302196838999997, 2024-04-22T19:57:22.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021407932000000001, 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836114+0000", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.826e-06 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840272+0000", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00415745 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840291+0000", 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9398e-05 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840302+0000", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1134999999999999e-05 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840367+0000", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4573000000000007e-05 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840384+0000", 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6600999999999999e-05 2024-04-22T19:57:22.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857472+0000", 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017088431000000001 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857521+0000", 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8517999999999999e-05 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2795 3.1f 3:f85731d8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.186 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.300902694999998, 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020520294000000001, 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2795 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837409+0000", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.187e-06 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839272+0000", 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001863471 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839305+0000", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502999999999997e-05 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839319+0000", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4205e-05 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839391+0000", 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2092e-05 2024-04-22T19:57:22.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839533+0000", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014198100000000001 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839690+0000", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156429 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.851666+0000", 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01197669 2024-04-22T19:57:22.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857857+0000", 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061904270000000001 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857895+0000", 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7908999999999999e-05 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857927+0000", 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2400000000000001e-05 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:22.192 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.949855321000001, 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:22.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.932948756000002, 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:22.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:22.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:22.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:22.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.147576934, 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.206 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.141304278, 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:22.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:22.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3306 3.18 3:1adb3c90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.263001896, 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021117510999999999, 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3306 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875311+0000", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9299999999999996e-06 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878617+0000", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003305568 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878657+0000", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9696000000000001e-05 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3286999999999999e-05 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878844+0000", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016400799999999999 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879225+0000", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038060200000000001 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879617+0000", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039190299999999998 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.895969+0000", 2024-04-22T19:57:22.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016352717999999999 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896258+0000", 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000288774 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896356+0000", 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8412000000000006e-05 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896425+0000", 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8613000000000002e-05 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3356 3.1f 3:f9fbdd03:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3151464520000005, 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029944853, 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.217 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3356 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823167+0000", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4839999999999998e-06 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.828985+0000", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058170740000000002 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829040+0000", 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5145999999999997e-05 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829067+0000", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7436999999999998e-05 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829180+0000", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011269600000000001 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829385+0000", 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204754 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829546+0000", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016156800000000001 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.837701+0000", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081547240000000003 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.852993+0000", 2024-04-22T19:57:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015291677 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853045+0000", 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2627999999999998e-05 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853108+0000", 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2664999999999997e-05 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3360 3.32 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2519685840000001, 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.035914033999999997, 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3360 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886344+0000", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999998e-06 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890144+0000", 2024-04-22T19:57:22.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037993979999999998 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890187+0000", 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3365999999999998e-05 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890213+0000", 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6423000000000001e-05 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890323+0000", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109403 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890502+0000", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946999999999999 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890665+0000", 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016283000000000001 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.898657+0000", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079918620000000006 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922014+0000", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023356965 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922143+0000", 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128942 2024-04-22T19:57:22.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922255+0000", 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011208499999999999 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3361 3.32 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2407845749999993, 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025023626, 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.228 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3361 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:22.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897527+0000", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900583+0000", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003055107 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900614+0000", 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1318000000000001e-05 2024-04-22T19:57:22.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900629+0000", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900786+0000", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001571 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901175+0000", 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038931300000000002 2024-04-22T19:57:22.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901558+0000", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038239200000000001 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.915362+0000", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013804712 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922357+0000", 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069949610000000001 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922467+0000", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109147 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922549+0000", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2002999999999994e-05 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:22.233 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2047271580000007, 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024212230000000001, 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:22.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:22.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957714+0000", 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013487935 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957760+0000", 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5473000000000003e-05 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957795+0000", 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4959000000000002e-05 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3369 3.1f 3:fabda85a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.1426296330000003, 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021793924999999999, 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3369 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995684+0000", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6399999999999996e-06 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997670+0000", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019854859999999998 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997707+0000", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6900000000000002e-05 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997729+0000", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1664000000000001e-05 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997827+0000", 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8907999999999996e-05 2024-04-22T19:57:22.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998030+0000", 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020303500000000001 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998222+0000", 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019167899999999999 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.006416+0000", 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081937539999999993 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017349+0000", 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010933468999999999 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017418+0000", 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8910000000000003e-05 2024-04-22T19:57:22.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017474+0000", 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3375 3.1 3:806a9ea3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.0728800760000006, 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0241683, 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:22.244 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3375 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:22.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065432+0000", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.481e-06 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067370+0000", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001938104 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067399+0000", 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9442999999999999e-05 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067414+0000", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4516e-05 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067494+0000", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0456000000000004e-05 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067622+0000", 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793700000000001 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067749+0000", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126303 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.074448+0000", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0066994029999999996 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089457+0000", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015009039 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089518+0000", 2024-04-22T19:57:22.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1019e-05 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089598+0000", 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598999999999995e-05 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:22.249 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:22.250 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:22.251 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:22.249+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:22.351 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:22.348+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:22.425 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:22.425 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:22.425 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:22.425 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:22.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:22.452 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:22.448+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:22.505 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:22.553 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:22.549+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:22.566 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:57:22.567 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:22.567 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:22.567 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:22.567 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:22.567 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:22.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:22.647 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:22.648 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:22.654 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:22.652+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:22.665 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:22.665 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:22.683 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:22.683 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:22.716 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:22.716 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:22.752 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:22.752 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:22.754 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:22.749+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:22.777 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:22.777 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:22.788 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:22.788 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:22.794 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:22.809 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:22.810 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:22.830 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:22.830 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:22.856 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:22.852+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:22.922 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:22.922 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:22.936 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:22.987 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:22.985+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:23.053 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.054 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.058 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:23.053+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:23.067 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:23.159 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:23.157+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:23.239 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.239 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:23.260 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:23.256+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:23.360 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:23.356+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:23.421 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.421 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.435 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:23.483 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:23.481+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:23.554 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.554 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.562 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:23.557+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:23.569 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:57:23.662 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:23.657+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:23.705 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.705 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:23.765 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:23.764+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:23.850 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:23.850 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:23.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:23.865 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:23.861+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:23.965 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:23.961+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:24.027 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.027 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:24.089 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:24.088+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:24.161 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.161 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.167 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:24.165+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:24.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:24.268 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:24.269+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:24.336 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.336 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:24.397 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:24.396+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:24.470 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:24.468+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:24.471 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.471 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.485 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:24.570 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:24.565+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:24.651 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.651 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.665 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:24.672 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:24.669+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:24.773 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:24.769+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:24.787 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.787 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.802 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:24.847 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:24.874 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:24.872+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:24.921 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:24.921 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:24.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:24.975 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:24.969+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:25.002 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:25.002 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:25.018 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:25.018 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:25.035 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:25.035 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:25.051 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:25.051 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:25.071 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:25.071 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:25.075 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:25.072+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:25.091 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:25.091 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:25.102 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:25.102 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:25.111 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:25.112 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:25.116 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:25.132 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:25.132 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:25.191 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:25.189+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:25.277 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:25.276+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:25.278 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:25.278 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:25.278 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:25.278 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:25.293 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:25.381 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:25.380+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:25.460 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:25.460 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:25.460 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:25.460 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:25.460 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:25.474 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:25.480 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:25.477+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:25.581 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:25.577+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:25.602 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 208.70431725200001, 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:25.639 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:25.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.340509150000003, 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.645 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:25.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:25.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 75.022721005999998, 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:25.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:25.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:25.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.073028148000006, 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.656 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:25.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:25.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:25.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.512311853, 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.662 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:25.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:25.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:25.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:25.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.172031908000001, 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.006049896, 2024-04-22T19:57:25.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:25.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:25.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 36.879219290000002, 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.679 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 36.862708615999999, 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:25.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:25.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:25.688 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 36.667458173999997, 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:25.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3278 3.16 e101/20 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head v 101'11, mlcod=100'8)", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.084830944, 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024822087999999999, 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551454+0000", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.877e-06 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554034+0000", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025798100000000001 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554067+0000", 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3232000000000003e-05 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554084+0000", 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6996000000000001e-05 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556707+0000", 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026228359999999999 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556755+0000", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8489000000000003e-05 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576150+0000", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019395022000000001 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576274+0000", 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123826 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.698 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.770696148000001, 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.699 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:25.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:25.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3320 3.7 3:e02e5aff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.473851045, 2024-04-22T19:57:25.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023607379000000001, 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3320 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162434+0000", 2024-04-22T19:57:25.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166484+0000", 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040498620000000004 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166518+0000", 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3868999999999997e-05 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166534+0000", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166695+0000", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016118099999999999 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166964+0000", 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000268509 2024-04-22T19:57:25.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.167217+0000", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025270400000000003 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.178741+0000", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011523950999999999 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185683+0000", 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069422479999999998 2024-04-22T19:57:25.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185865+0000", 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181991 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186039+0000", 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017437400000000001 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3374 3.f 3:f24b7435:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.580127444, 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033085672000000003, 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3374 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056160+0000", 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5399999999999997e-06 2024-04-22T19:57:25.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063543+0000", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007383265 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063586+0000", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2363000000000001e-05 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063604+0000", 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063742+0000", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138071 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064038+0000", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000296283 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064258+0000", 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022030699999999999 2024-04-22T19:57:25.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.083221+0000", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018962946000000001 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089044+0000", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058230189999999996 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089144+0000", 2024-04-22T19:57:25.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9046e-05 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089241+0000", 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3380 3.e 3:70445021:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_309:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.516515376999999, 2024-04-22T19:57:25.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026443379999999999, 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119801+0000", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3569000000000003e-05 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127712+0000", 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079112230000000002 2024-04-22T19:57:25.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127756+0000", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3205999999999999e-05 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127775+0000", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9643000000000001e-05 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127957+0000", 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018173399999999999 2024-04-22T19:57:25.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128368+0000", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041124899999999998 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128788+0000", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042035800000000002 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.144721+0000", 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015932720000000001 2024-04-22T19:57:25.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.145980+0000", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012590310000000001 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146082+0000", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101326 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146211+0000", 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129321 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.721 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3387 3.e 3:708e763d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_316:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.439416711, 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024449419, 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3387 2024-04-22T19:57:25.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196870+0000", 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7799999999999998e-06 2024-04-22T19:57:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203634+0000", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067638339999999998 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203667+0000", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2756999999999998e-05 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203684+0000", 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7356000000000001e-05 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203839+0000", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015536099999999999 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204091+0000", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025196000000000002 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204327+0000", 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023566700000000001 2024-04-22T19:57:25.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.213672+0000", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093453379999999999 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221143+0000", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074708880000000002 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221242+0000", 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9209000000000005e-05 2024-04-22T19:57:25.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221316+0000", 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3269000000000006e-05 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3394 3.d 3:b0ab1424:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_323:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.362946894, 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030154717000000001, 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.727 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3394 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273340+0000", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2729999999999996e-06 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279108+0000", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057675139999999996 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279162+0000", 2024-04-22T19:57:25.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3906000000000002e-05 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279183+0000", 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1403000000000002e-05 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279330+0000", 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014687500000000001 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279588+0000", 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258063 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279888+0000", 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.289608+0000", 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097194659999999995 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303262+0000", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013653983 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303405+0000", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014306200000000001 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303491+0000", 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5912e-05 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3399 3.3f 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.305239001, 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031545288999999997, 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3399 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331047+0000", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0529999999999998e-06 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335945+0000", 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048978110000000002 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335986+0000", 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.083e-05 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336004+0000", 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8629000000000001e-05 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336185+0000", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180898 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336448+0000", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026270699999999999 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336683+0000", 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023544700000000001 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.348895+0000", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012212015 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362409+0000", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013513588 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362506+0000", 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7613000000000002e-05 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362589+0000", 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2698e-05 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3400 3.7 3:e3be52ca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.295409219, 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024819051000000002, 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.738 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3400 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340877+0000", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1930000000000002e-06 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345072+0000", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041953030000000001 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345118+0000", 2024-04-22T19:57:25.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5479999999999998e-05 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345145+0000", 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7368999999999998e-05 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345315+0000", 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017041499999999999 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345717+0000", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040180199999999999 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.346104+0000", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038631800000000002 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361555+0000", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015451327000000001 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365554+0000", 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039992659999999996 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365635+0000", 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1071999999999999e-05 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365693+0000", 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7506000000000001e-05 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3402 3.e 3:7192c845:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.272855232, 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847825999999999, 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3402 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.744 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363430+0000", 2024-04-22T19:57:25.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367479+0000", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040487550000000002 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367516+0000", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6980000000000002e-05 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367537+0000", 2024-04-22T19:57:25.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367686+0000", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994499999999999 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368010+0000", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032352200000000002 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368230+0000", 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021993100000000001 2024-04-22T19:57:25.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.380292+0000", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012061776 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387068+0000", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067766900000000001 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387203+0000", 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013484200000000001 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:25.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387275+0000", 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2245999999999999e-05 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:25.749 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:25.750 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:25.751 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:25.745+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:25.851 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:25.849+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:25.865 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:25.865 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:25.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:25.951 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:25.948+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:26.036 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:26.036 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:26.037 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:26.037 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:26.037 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:26.052 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:26.052 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:26.048+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:26.153 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:26.149+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:26.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 75.532348894999998, 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:26.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:26.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.573001404000003, 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:26.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.408150970999998, 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.190 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.187472030999999, 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:26.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:26.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2727 3.23 3:c759b3e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.951193707000002, 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020866947, 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.197 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2727 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221189+0000", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9210000000000001e-06 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223161+0000", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019713899999999999 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223204+0000", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3235999999999997e-05 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223232+0000", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7869e-05 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223346+0000", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011461899999999999 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223529+0000", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018233799999999999 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223699+0000", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170459 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.232297+0000", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085980680000000004 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.241931+0000", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096342200000000006 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242001+0000", 2024-04-22T19:57:26.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9760999999999998e-05 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242053+0000", 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2065999999999999e-05 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2752 3.32 3:4dcc7a09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.668791272, 2024-04-22T19:57:26.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021065733999999999, 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2752 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503592+0000", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1640000000000001e-06 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505558+0000", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661930000000002 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505608+0000", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9957999999999998e-05 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505626+0000", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7927999999999998e-05 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505735+0000", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010932799999999999 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505919+0000", 2024-04-22T19:57:26.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000183356 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506080+0000", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016146800000000001 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.521592+0000", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015511723 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524530+0000", 2024-04-22T19:57:26.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029378490000000002 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524600+0000", 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9931000000000005e-05 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524654+0000", 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4836000000000001e-05 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.207 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.462787290000001, 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2794 3.24 e93/89 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head v 93'8, mlcod=92'6)", 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.336267309999997, 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021407932000000001, 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.213 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836114+0000", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.826e-06 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840272+0000", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00415745 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840291+0000", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9398e-05 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840302+0000", 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1134999999999999e-05 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840367+0000", 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4573000000000007e-05 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840384+0000", 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6600999999999999e-05 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857472+0000", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017088431000000001 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857521+0000", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8517999999999999e-05 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2795 3.1f 3:f85731d8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.334973165999997, 2024-04-22T19:57:26.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020520294000000001, 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2795 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837409+0000", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.187e-06 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839272+0000", 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001863471 2024-04-22T19:57:26.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839305+0000", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502999999999997e-05 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839319+0000", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4205e-05 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839391+0000", 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2092e-05 2024-04-22T19:57:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839533+0000", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014198100000000001 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839690+0000", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156429 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.851666+0000", 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01197669 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857857+0000", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061904270000000001 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857895+0000", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7908999999999999e-05 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857927+0000", 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2400000000000001e-05 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.983925792000001, 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:26.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:26.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:26.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.967019227000002, 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.227 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:26.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:26.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.232 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.181647405, 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.236 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.175374748999999, 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:26.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:26.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:26.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:26.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:26.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3306 3.18 3:1adb3c90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:26.242 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.297072367, 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021117510999999999, 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3306 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875311+0000", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9299999999999996e-06 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878617+0000", 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003305568 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878657+0000", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9696000000000001e-05 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3286999999999999e-05 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878844+0000", 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016400799999999999 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879225+0000", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038060200000000001 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879617+0000", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039190299999999998 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.895969+0000", 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016352717999999999 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896258+0000", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000288774 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896356+0000", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8412000000000006e-05 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896425+0000", 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8613000000000002e-05 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.247 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3356 3.1f 3:f9fbdd03:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.349216923, 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029944853, 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3356 2024-04-22T19:57:26.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823167+0000", 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4839999999999998e-06 2024-04-22T19:57:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.828985+0000", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058170740000000002 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829040+0000", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5145999999999997e-05 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829067+0000", 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7436999999999998e-05 2024-04-22T19:57:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829180+0000", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011269600000000001 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829385+0000", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204754 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829546+0000", 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016156800000000001 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.837701+0000", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081547240000000003 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.852993+0000", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015291677 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853045+0000", 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2627999999999998e-05 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853108+0000", 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2664999999999997e-05 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3360 3.32 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.286039055, 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.035914033999999997, 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.253 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3360 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886344+0000", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999998e-06 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890144+0000", 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037993979999999998 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890187+0000", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3365999999999998e-05 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890213+0000", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6423000000000001e-05 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890323+0000", 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109403 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890502+0000", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946999999999999 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890665+0000", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016283000000000001 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.898657+0000", 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079918620000000006 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922014+0000", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023356965 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922143+0000", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128942 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922255+0000", 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011208499999999999 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3361 3.32 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.274855046000001, 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025023626, 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3361 2024-04-22T19:57:26.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897527+0000", 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:26.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900583+0000", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003055107 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900614+0000", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1318000000000001e-05 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900629+0000", 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:57:26.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900786+0000", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001571 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901175+0000", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038931300000000002 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901558+0000", 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038239200000000001 2024-04-22T19:57:26.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.915362+0000", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013804712 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922357+0000", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069949610000000001 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922467+0000", 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109147 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922549+0000", 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2002999999999994e-05 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.238797629, 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024212230000000001, 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:26.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957714+0000", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013487935 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957760+0000", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5473000000000003e-05 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957795+0000", 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4959000000000002e-05 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3369 3.1f 3:fabda85a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.176700104, 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021793924999999999, 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3369 2024-04-22T19:57:26.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995684+0000", 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6399999999999996e-06 2024-04-22T19:57:26.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997670+0000", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019854859999999998 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997707+0000", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6900000000000002e-05 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997729+0000", 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1664000000000001e-05 2024-04-22T19:57:26.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997827+0000", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8907999999999996e-05 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998030+0000", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020303500000000001 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998222+0000", 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019167899999999999 2024-04-22T19:57:26.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.006416+0000", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081937539999999993 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017349+0000", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010933468999999999 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017418+0000", 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8910000000000003e-05 2024-04-22T19:57:26.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017474+0000", 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3375 3.1 3:806a9ea3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.106950547, 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0241683, 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3375 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.276 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065432+0000", 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.481e-06 2024-04-22T19:57:26.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067370+0000", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001938104 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067399+0000", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9442999999999999e-05 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067414+0000", 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4516e-05 2024-04-22T19:57:26.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067494+0000", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0456000000000004e-05 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067622+0000", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793700000000001 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067749+0000", 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126303 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.074448+0000", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0066994029999999996 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089457+0000", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015009039 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089518+0000", 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1019e-05 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089598+0000", 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598999999999995e-05 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.281 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:26.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:26.282 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:26.281+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:26.384 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:26.380+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:26.453 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:26.453 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:26.468 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:26.484 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:26.484+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:26.586 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:26.584+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:26.589 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:57:26.593 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:26.593 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:26.593 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:26.593 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:26.593 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:26.609 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:26.695 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:26.693+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 193.41836716399999, 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:57:26.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:57:26.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2700 3.31 3:8d36a364:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.852143198999997, 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019117091999999999, 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.774 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2700 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913956+0000", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4800000000000001e-06 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915283+0000", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001326867 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915308+0000", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5065000000000001e-05 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915319+0000", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1028e-05 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915387+0000", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7853000000000002e-05 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915538+0000", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015074700000000001 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915661+0000", 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012310500000000001 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.923345+0000", 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076839170000000002 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.932949+0000", 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096048420000000006 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.933014+0000", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4187000000000001e-05 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.933070+0000", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6001000000000001e-05 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2711 3.8 3:13621148:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.733158545999999, 2024-04-22T19:57:26.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020635379999999998, 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2711 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032941+0000", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034590+0000", 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016493219999999999 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034617+0000", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7367000000000001e-05 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034627+0000", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8130000000000007e-06 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034698+0000", 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0747999999999994e-05 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034896+0000", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019808 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.035090+0000", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019395600000000001 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.041596+0000", 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065056209999999996 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053466+0000", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011870041 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053521+0000", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.554e-05 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053573+0000", 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1467e-05 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2714 3.31 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.703540472, 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024560974999999999, 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2714 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062558+0000", 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.469e-06 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064166+0000", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016086519999999999 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064192+0000", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5829999999999998e-05 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064203+0000", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.112e-05 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064300+0000", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6817999999999994e-05 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064432+0000", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131681 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064585+0000", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000153153 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.068903+0000", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004318194 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.086976+0000", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018072357000000001 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087053+0000", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7615999999999997e-05 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087116+0000", 2024-04-22T19:57:26.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3084999999999997e-05 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2715 3.31 3:8f62fb2c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.693683219, 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019512254999999999, 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2715 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072415+0000", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1349999999999999e-06 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074206+0000", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017915800000000001 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074238+0000", 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1878999999999998e-05 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074253+0000", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4508000000000001e-05 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074355+0000", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102039 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074494+0000", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139715 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074673+0000", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017902799999999999 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.081603+0000", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069298349999999996 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091780+0000", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010176665999999999 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091847+0000", 2024-04-22T19:57:26.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6890999999999994e-05 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091925+0000", 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7979000000000007e-05 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2785 3.8 3:131c8255:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.028592015999997, 2024-04-22T19:57:26.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021038193, 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2785 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737507+0000", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8609999999999998e-06 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739887+0000", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023801930000000001 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739907+0000", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739917+0000", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4849999999999998e-06 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739991+0000", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4096000000000003e-05 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740181+0000", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190595 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740356+0000", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017416600000000001 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.748776+0000", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084208140000000004 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758402+0000", 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096257080000000002 2024-04-22T19:57:26.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758481+0000", 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9159000000000006e-05 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758542+0000", 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0643000000000002e-05 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.800 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2791 3.33 e93/89 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head v 93'6, mlcod=75'4)", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.964419618999997, 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022223125, 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801678+0000", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4279999999999999e-06 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806397+0000", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047191079999999996 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806413+0000", 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019e-05 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806423+0000", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.815e-06 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806489+0000", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6087999999999995e-05 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806511+0000", 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2286e-05 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823847+0000", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017336154999999999 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823899+0000", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2225999999999998e-05 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2792 3.4 3:20cf0ea2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.962467236000002, 2024-04-22T19:57:26.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02057749, 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2792 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803632+0000", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0510000000000001e-06 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806383+0000", 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027517869999999999 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806415+0000", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1644999999999999e-05 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806425+0000", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0443e-05 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806484+0000", 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8557999999999997e-05 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806616+0000", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013203999999999999 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806720+0000", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104109 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823724+0000", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017004063999999999 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824086+0000", 2024-04-22T19:57:26.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036203100000000002 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824153+0000", 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6854999999999996e-05 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824206+0000", 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2907e-05 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2819 3.8 3:137d30ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.608173733999998, 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020533365000000001, 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2819 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157925+0000", 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.32e-06 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160741+0000", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028155179999999999 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160788+0000", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6780000000000003e-05 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160813+0000", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5049e-05 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160995+0000", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018263399999999999 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161309+0000", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313956 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161568+0000", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025827599999999999 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.169671+0000", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081033689999999992 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178301+0000", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086300609999999996 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178386+0000", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5118999999999996e-05 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178455+0000", 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9282999999999994e-05 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2848 3.29 e93/89 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head v 93'12, mlcod=93'10)", 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.987898993000002, 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020717856, 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778200+0000", 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.467e-06 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785343+0000", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071423520000000002 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785385+0000", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2821999999999998e-05 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785404+0000", 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785580+0000", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017512100000000001 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785624+0000", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4159000000000002e-05 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798838+0000", 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013214066999999999 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798915+0000", 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6908000000000003e-05 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2859 3.31 3:8df1a3fb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.860458446000003, 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022181747000000002, 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2859 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905641+0000", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5540000000000002e-06 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907825+0000", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021841780000000002 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907854+0000", 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:57:26.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907866+0000", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907972+0000", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010562 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908172+0000", 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020041500000000001 2024-04-22T19:57:26.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908341+0000", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168577 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.912566+0000", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042252330000000001 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927689+0000", 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015123202000000001 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927764+0000", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4472000000000001e-05 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927819+0000", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2861 3.19 3:9b000d1b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:26.824 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.837057129000002, 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034056910000000003, 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2861 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929042+0000", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.852e-06 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.930981+0000", 2024-04-22T19:57:26.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001939068 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931006+0000", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5395e-05 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931016+0000", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0069e-05 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931096+0000", 2024-04-22T19:57:26.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598000000000006e-05 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931246+0000", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015064200000000001 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931345+0000", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9223999999999997e-05 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.937009+0000", 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056634379999999998 2024-04-22T19:57:26.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.962963+0000", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025954222999999998 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963037+0000", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3887999999999995e-05 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963096+0000", 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8513e-05 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.829 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3233 3.0 3:009d57d0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.713104331, 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019816088999999999, 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3233 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052994+0000", 2024-04-22T19:57:26.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6919999999999998e-06 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054663+0000", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001669048 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054692+0000", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773999999999999e-05 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054706+0000", 2024-04-22T19:57:26.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4336e-05 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054803+0000", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6668000000000003e-05 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055007+0000", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020395100000000001 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055187+0000", 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017976999999999999 2024-04-22T19:57:26.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.070365+0000", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015178759999999999 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072674+0000", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002308245 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072739+0000", 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5164000000000002e-05 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072808+0000", 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8681000000000002e-05 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3317 3.33 e101/89 3:cdd532a6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_246:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.661810756, 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019447335999999999, 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104286+0000", 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2399999999999997e-07 2024-04-22T19:57:26.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109751+0000", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054647680000000001 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109790+0000", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9616000000000002e-05 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109814+0000", 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3980000000000001e-05 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109975+0000", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016105500000000001 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.110042+0000", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6562000000000004e-05 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.123591+0000", 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013549052000000001 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.123732+0000", 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014147899999999999 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3324 3.31 3:8ee13d9a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_253:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.538651282, 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021984026, 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.839 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3324 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:26.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227449+0000", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1829999999999996e-06 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231194+0000", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037452499999999999 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231245+0000", 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0936000000000002e-05 2024-04-22T19:57:26.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231271+0000", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6605999999999999e-05 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231384+0000", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112958 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231542+0000", 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000157248 2024-04-22T19:57:26.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231656+0000", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114286 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.240332+0000", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086758349999999998 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249282+0000", 2024-04-22T19:57:26.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089503229999999996 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249364+0000", 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1871000000000003e-05 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249429+0000", 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4529999999999994e-05 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.844 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3340 3.1a e101/20 3:5a7c4462:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_269:head v 101'7, mlcod=93'5)", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.264189761000001, 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019383912999999999, 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:26.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501909+0000", 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4400000000000001e-06 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507480+0000", 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055705269999999996 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507513+0000", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3336000000000001e-05 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507531+0000", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7626999999999999e-05 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507681+0000", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015031500000000001 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507746+0000", 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4350000000000006e-05 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.521191+0000", 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013445642000000001 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.521290+0000", 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8676000000000002e-05 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.848 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3355 3.25 3:a46ca720:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.958181784000001, 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022146777999999999, 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3355 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807919+0000", 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8899999999999998e-06 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813214+0000", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052952169999999996 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813260+0000", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5646000000000003e-05 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813280+0000", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9816000000000001e-05 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813404+0000", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012438999999999999 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813632+0000", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022820100000000001 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813849+0000", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216419 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.826358+0000", 2024-04-22T19:57:26.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012509823 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829913+0000", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035546729999999999 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829996+0000", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2871e-05 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.830061+0000", 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832000000000005e-05 2024-04-22T19:57:26.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3360 3.32 e101/20 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.875268678999999, 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028198335000000001, 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890830+0000", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2629999999999999e-06 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894425+0000", 2024-04-22T19:57:26.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035946009999999998 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894463+0000", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8420000000000001e-05 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894480+0000", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6736999999999999e-05 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894667+0000", 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186911 2024-04-22T19:57:26.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894735+0000", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7476000000000002e-05 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.918902+0000", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024167477999999999 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.919025+0000", 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123449 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3361 3.32 e101/20 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head v 101'17, mlcod=100'14)", 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.864316209, 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019721044, 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:26.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901782+0000", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6910000000000002e-06 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907163+0000", 2024-04-22T19:57:26.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053810170000000001 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907208+0000", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4814000000000002e-05 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907240+0000", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1537e-05 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907759+0000", 2024-04-22T19:57:26.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00051904299999999996 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907825+0000", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6435999999999999e-05 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921378+0000", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013552878000000001 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921501+0000", 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012262800000000001 2024-04-22T19:57:26.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3383 3.31 3:8c620c97:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_312:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.612785903000001, 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020532287999999999, 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3383 2024-04-22T19:57:26.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153313+0000", 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3459999999999998e-06 2024-04-22T19:57:26.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155061+0000", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001748108 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155093+0000", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1902000000000001e-05 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155108+0000", 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4450999999999999e-05 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155202+0000", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4598999999999993e-05 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155388+0000", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018557099999999999 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155566+0000", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017860799999999999 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:26.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.163059+0000", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074921390000000001 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173733+0000", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010674141999999999 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173787+0000", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4132000000000003e-05 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:26.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173842+0000", 2024-04-22T19:57:26.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5290000000000001e-05 2024-04-22T19:57:26.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.869 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:26.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:26.870 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:26.872 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:26.872 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:26.869+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:26.973 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:26.968+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:27.046 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:27.046 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:27.046 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:27.046 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:27.061 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:27.107 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:27.105+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:27.151 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:27.178 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:27.178 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:27.179 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:27.179 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:27.179 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:27.179 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:27.177+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:27.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:27.283 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:27.281+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:27.311 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:27.311 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:27.329 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:27.346 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:27.363 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:27.363 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:27.373 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:27.373 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:27.375 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:27.372+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:27.384 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:27.385 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:27.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:27.405 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:27.406 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:27.426 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:27.426 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:27.447 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:27.447 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:27.507 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:27.505+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:27.523 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:27.523 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:27.538 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:27.583 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:27.581+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:27.676 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:27.673+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:27.706 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:27.707 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:27.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:27.811 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:27.809+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:27.879 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:27.877+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:27.885 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:27.885 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:27.899 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:27.979 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:27.976+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:28.027 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.027 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.041 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:28.080 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:28.077+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:28.181 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:28.180+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:28.208 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.208 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.224 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:28.282 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:28.277+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:28.383 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:28.380+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:28.389 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.389 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:28.484 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:28.481+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:28.574 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.574 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.584 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:28.581+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:28.588 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:28.611 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:57:28.685 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:28.681+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:28.706 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.706 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:28.785 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:28.784+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:28.843 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:28.843 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:28.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:28.901 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:28.900+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:28.987 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:28.984+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:29.028 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:29.028 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:29.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:29.087 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:29.085+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:29.188 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:29.184+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:29.207 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:29.207 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:29.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records in 2024-04-22T19:57:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:200+0 records out 2024-04-22T19:57:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.6682 s, 153 MB/s 2024-04-22T19:57:29.309 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:29.308+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:29.390 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:29.388+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:29.396 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:29.396 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:29.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:29.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:29.474 INFO:tasks.workunit.client.0.smithi111.stdout:Bucket Created: buck_2024_03_22_19_57_29 2024-04-22T19:57:29.491 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:29.489+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:29.580 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:29.581 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:29.592 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:29.588+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:29.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:29.611 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:57:29.626 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:29.626 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:29.644 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:29.645 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:29.666 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:29.666 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:29.683 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:29.683 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:29.693 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:29.689+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:29.703 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:29.703 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:29.724 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:29.724 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:29.744 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:29.744 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:29.763 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:29.764 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:29.770 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:29.770 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:29.771 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:29.771 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:29.771 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:29.786 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:29.789 INFO:tasks.workunit.client.0.smithi111.stdout:bucket quota max size set for the given user: buck_2024_03_22_19_57_29 2024-04-22T19:57:29.794 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:29.789+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:29.895 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:29.892+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 212.98264274100001, 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025638079000000001, 2024-04-22T19:57:29.917 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4201", 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/3620472375", 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931966+0000", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931967+0000", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.06e-06 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931976+0000", 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9630000000000004e-06 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931986+0000", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0013000000000001e-05 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.931993+0000", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1239999999999999e-06 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951667+0000", 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019674628 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.951814+0000", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014667900000000001 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.952004+0000", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019018099999999999 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.953785+0000", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017808570000000001 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957453+0000", 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036678589999999999 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957541+0000", 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7619000000000003e-05 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:53:56.957604+0000", 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3095999999999994e-05 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.922 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1328 3.d 3:b03ecd09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.618834638999999, 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025281768, 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1328 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.923 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295774+0000", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.295777+0000", 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-06 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301048+0000", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052711449999999997 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301089+0000", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1412999999999998e-05 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301113+0000", 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4162999999999999e-05 2024-04-22T19:57:29.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301218+0000", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104913 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301401+0000", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182843 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.301958+0000", 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055732199999999996 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.314161+0000", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012203123999999999 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.320922+0000", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067609009999999997 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321001+0000", 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8442000000000006e-05 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.321056+0000", 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4688999999999998e-05 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2243 3.e 3:739245c4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.301046494999994, 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025456596000000001, 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2243 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613562+0000", 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.613564+0000", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.39e-06 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617800+0000", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042357540000000004 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617824+0000", 2024-04-22T19:57:29.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4357000000000001e-05 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617837+0000", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3022e-05 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.617970+0000", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132838 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618196+0000", 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000225827 2024-04-22T19:57:29.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.618401+0000", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020471700000000001 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633329+0000", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014928017 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638682+0000", 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053533419999999996 2024-04-22T19:57:29.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.638841+0000", 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015922700000000001 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639018+0000", 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017710499999999999 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.933 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2334 3.39 3:9c73f935:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 78.351353637000003, 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025824382999999999, 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2334 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563255+0000", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.563258+0000", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1329999999999999e-06 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567142+0000", 2024-04-22T19:57:29.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038836399999999998 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567176+0000", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4091000000000003e-05 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567191+0000", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5548000000000001e-05 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567284+0000", 2024-04-22T19:57:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3125e-05 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.567291+0000", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.438e-06 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.569957+0000", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026663849999999998 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570151+0000", 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000193418 2024-04-22T19:57:29.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.570338+0000", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018733899999999999 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.575293+0000", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049547419999999998 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.588947+0000", 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013654856999999999 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589021+0000", 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3915e-05 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.589079+0000", 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7751999999999999e-05 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2720 3.d 3:b1263fba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:29.939 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.790637341999997, 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026222776, 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2720 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.123971+0000", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.124002+0000", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1322999999999998e-05 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128551+0000", 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045490180000000002 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128590+0000", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9113000000000003e-05 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128610+0000", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616e-05 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.128746+0000", 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000135714 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129015+0000", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026914499999999999 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.129242+0000", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022702200000000001 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.141734+0000", 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012491893 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.149973+0000", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082387190000000003 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150076+0000", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103225 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.150194+0000", 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117988 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2748 3.d 3:b3308d01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.450357396999998, 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024838147000000001, 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2748 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464251+0000", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.464255+0000", 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6500000000000002e-06 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468657+0000", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044026830000000001 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468707+0000", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9685000000000003e-05 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.468733+0000", 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.622e-05 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469001+0000", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026820300000000001 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469235+0000", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233907 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.469398+0000", 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162397 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.485226+0000", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015828392 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488399+0000", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031726670000000001 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.488986+0000", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000586755 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.489089+0000", 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103588 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.284375384999997, 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.950 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:29.955 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.157544778999998, 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:29.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:29.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.141034105000003, 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2806 3.f 3:f24e1a2f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 40.945783663, 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025355778999999998, 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2806 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968825+0000", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.968830+0000", 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8330000000000001e-06 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974823+0000", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059934150000000002 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974859+0000", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5932000000000001e-05 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.974882+0000", 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3227e-05 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975019+0000", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013729399999999999 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975257+0000", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023770599999999999 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.975476+0000", 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021931899999999999 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.990785+0000", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015308242999999999 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.993903+0000", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031182990000000002 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994052+0000", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014909299999999999 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.994180+0000", 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012841799999999999 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3278 3.16 e101/20 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head v 101'11, mlcod=100'8)", 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.363156433, 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024822087999999999, 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551452+0000", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551454+0000", 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.877e-06 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554034+0000", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025798100000000001 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554067+0000", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3232000000000003e-05 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.554084+0000", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6996000000000001e-05 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556707+0000", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026228359999999999 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.556755+0000", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8489000000000003e-05 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576150+0000", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019395022000000001 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576274+0000", 2024-04-22T19:57:29.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123826 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.049021636999999, 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.974 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:29.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:29.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:29.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3320 3.7 3:e02e5aff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.752176534, 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023607379000000001, 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.979 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3320 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162432+0000", 2024-04-22T19:57:29.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.162434+0000", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6400000000000001e-06 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166484+0000", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040498620000000004 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166518+0000", 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3868999999999997e-05 2024-04-22T19:57:29.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166534+0000", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.605e-05 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166695+0000", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016118099999999999 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.166964+0000", 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000268509 2024-04-22T19:57:29.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.167217+0000", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025270400000000003 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.178741+0000", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011523950999999999 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185683+0000", 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069422479999999998 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.185865+0000", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181991 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.186039+0000", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017437400000000001 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3374 3.f 3:f24b7435:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:29.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.858452932999999, 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033085672000000003, 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3374 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056160+0000", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5399999999999997e-06 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063543+0000", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007383265 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063586+0000", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2363000000000001e-05 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063604+0000", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063742+0000", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138071 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064038+0000", 2024-04-22T19:57:29.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000296283 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064258+0000", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022030699999999999 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.083221+0000", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018962946000000001 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089044+0000", 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058230189999999996 2024-04-22T19:57:29.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089144+0000", 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9046e-05 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089241+0000", 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3380 3.e 3:70445021:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_309:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.794840866000001, 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026443379999999999, 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119801+0000", 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3569000000000003e-05 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127712+0000", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079112230000000002 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127756+0000", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3205999999999999e-05 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127775+0000", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9643000000000001e-05 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127957+0000", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018173399999999999 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128368+0000", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041124899999999998 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128788+0000", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042035800000000002 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.144721+0000", 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015932720000000001 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.145980+0000", 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012590310000000001 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146082+0000", 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101326 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146211+0000", 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129321 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3387 3.e 3:708e763d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_316:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.7177422, 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024449419, 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:29.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3387 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196866+0000", 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.196870+0000", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7799999999999998e-06 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203634+0000", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067638339999999998 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203667+0000", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2756999999999998e-05 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:29.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203684+0000", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7356000000000001e-05 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.203839+0000", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015536099999999999 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204091+0000", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025196000000000002 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.204327+0000", 2024-04-22T19:57:29.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023566700000000001 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.213672+0000", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093453379999999999 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221143+0000", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074708880000000002 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221242+0000", 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9209000000000005e-05 2024-04-22T19:57:29.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.221316+0000", 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3269000000000006e-05 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3394 3.d 3:b0ab1424:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_323:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.641272383, 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030154717000000001, 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:30.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3394 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:30.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273340+0000", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2729999999999996e-06 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279108+0000", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057675139999999996 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279162+0000", 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3906000000000002e-05 2024-04-22T19:57:30.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279183+0000", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1403000000000002e-05 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279330+0000", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014687500000000001 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279588+0000", 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258063 2024-04-22T19:57:30.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279888+0000", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.289608+0000", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097194659999999995 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303262+0000", 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013653983 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303405+0000", 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014306200000000001 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303491+0000", 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5912e-05 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3399 3.3f 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.005 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.583564490000001, 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031545288999999997, 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3399 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331047+0000", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0529999999999998e-06 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335945+0000", 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048978110000000002 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335986+0000", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.083e-05 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336004+0000", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8629000000000001e-05 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336185+0000", 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180898 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336448+0000", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026270699999999999 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336683+0000", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023544700000000001 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.348895+0000", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012212015 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362409+0000", 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013513588 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362506+0000", 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7613000000000002e-05 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362589+0000", 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2698e-05 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3400 3.7 3:e3be52ca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.573734708, 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024819051000000002, 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3400 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:30.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340874+0000", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.340877+0000", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1930000000000002e-06 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:30.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345072+0000", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041953030000000001 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345118+0000", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5479999999999998e-05 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345145+0000", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7368999999999998e-05 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:30.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345315+0000", 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017041499999999999 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.345717+0000", 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040180199999999999 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.346104+0000", 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038631800000000002 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.361555+0000", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015451327000000001 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365554+0000", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039992659999999996 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365635+0000", 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1071999999999999e-05 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.365693+0000", 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7506000000000001e-05 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3402 3.e 3:7192c845:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.551180721000001, 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847825999999999, 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:30.016 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3402 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363428+0000", 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.363430+0000", 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367479+0000", 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040487550000000002 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367516+0000", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6980000000000002e-05 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367537+0000", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.367686+0000", 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994499999999999 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368010+0000", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032352200000000002 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.368230+0000", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021993100000000001 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.380292+0000", 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012061776 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387068+0000", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067766900000000001 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387203+0000", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013484200000000001 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.387275+0000", 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2245999999999999e-05 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:30.021 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:30.022 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:30.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:30.023 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:30.021+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:30.124 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:30.120+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:30.143 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:30.143 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:30.143 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:30.143 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:30.156 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:30.224 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:30.221+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:30.264 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:30.264 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:30.265 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:30.265 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:30.265 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:30.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:30.325 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:30.324+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:30.426 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:30.421+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:30.436 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:30.436 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 79.795533204999998, 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:30.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.836185714000003, 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:30.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:30.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.671335280999998, 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:30.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:30.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.450656340999998, 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:30.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:30.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:30.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2727 3.23 3:c759b3e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.214378017000001, 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020866947, 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.458 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2727 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221189+0000", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9210000000000001e-06 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223161+0000", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019713899999999999 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223204+0000", 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3235999999999997e-05 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223232+0000", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7869e-05 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223346+0000", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011461899999999999 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223529+0000", 2024-04-22T19:57:30.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018233799999999999 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223699+0000", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170459 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.232297+0000", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085980680000000004 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.241931+0000", 2024-04-22T19:57:30.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096342200000000006 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242001+0000", 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9760999999999998e-05 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242053+0000", 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2065999999999999e-05 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.463 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2752 3.32 3:4dcc7a09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.931975582, 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021065733999999999, 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2752 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:30.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503592+0000", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1640000000000001e-06 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505558+0000", 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661930000000002 2024-04-22T19:57:30.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505608+0000", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9957999999999998e-05 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505626+0000", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7927999999999998e-05 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505735+0000", 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010932799999999999 2024-04-22T19:57:30.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505919+0000", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000183356 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506080+0000", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016146800000000001 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.521592+0000", 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015511723 2024-04-22T19:57:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524530+0000", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029378490000000002 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524600+0000", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9931000000000005e-05 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524654+0000", 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4836000000000001e-05 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.725971600000001, 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:30.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:30.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2794 3.24 e93/89 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head v 93'8, mlcod=92'6)", 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.599451619999996, 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021407932000000001, 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836114+0000", 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.826e-06 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840272+0000", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00415745 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840291+0000", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9398e-05 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840302+0000", 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1134999999999999e-05 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840367+0000", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4573000000000007e-05 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840384+0000", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6600999999999999e-05 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857472+0000", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017088431000000001 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857521+0000", 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8517999999999999e-05 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2795 3.1f 3:f85731d8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.598157475999997, 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020520294000000001, 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.478 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2795 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837409+0000", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.187e-06 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839272+0000", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001863471 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839305+0000", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502999999999997e-05 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839319+0000", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4205e-05 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839391+0000", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2092e-05 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839533+0000", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014198100000000001 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839690+0000", 2024-04-22T19:57:30.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156429 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.851666+0000", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01197669 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857857+0000", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061904270000000001 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857895+0000", 2024-04-22T19:57:30.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7908999999999999e-05 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857927+0000", 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2400000000000001e-05 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.247110102000001, 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.483 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:30.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.230203537000001, 2024-04-22T19:57:30.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.444831714999999, 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.496 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.438559058999999, 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:30.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.502 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3306 3.18 3:1adb3c90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.560256677000002, 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021117510999999999, 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3306 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:30.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875311+0000", 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9299999999999996e-06 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878617+0000", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003305568 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878657+0000", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9696000000000001e-05 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3286999999999999e-05 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878844+0000", 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016400799999999999 2024-04-22T19:57:30.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879225+0000", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038060200000000001 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879617+0000", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039190299999999998 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.895969+0000", 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016352717999999999 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896258+0000", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000288774 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896356+0000", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8412000000000006e-05 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896425+0000", 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8613000000000002e-05 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.507 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3356 3.1f 3:f9fbdd03:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.612401233, 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029944853, 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3356 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.508 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823167+0000", 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4839999999999998e-06 2024-04-22T19:57:30.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.828985+0000", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058170740000000002 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829040+0000", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5145999999999997e-05 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829067+0000", 2024-04-22T19:57:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7436999999999998e-05 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829180+0000", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011269600000000001 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829385+0000", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204754 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829546+0000", 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016156800000000001 2024-04-22T19:57:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.837701+0000", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081547240000000003 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.852993+0000", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015291677 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853045+0000", 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2627999999999998e-05 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853108+0000", 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2664999999999997e-05 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3360 3.32 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.549223365, 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.035914033999999997, 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3360 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886344+0000", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999998e-06 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890144+0000", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037993979999999998 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890187+0000", 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3365999999999998e-05 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890213+0000", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6423000000000001e-05 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890323+0000", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109403 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890502+0000", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946999999999999 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890665+0000", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016283000000000001 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.898657+0000", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079918620000000006 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922014+0000", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023356965 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922143+0000", 2024-04-22T19:57:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128942 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922255+0000", 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011208499999999999 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3361 3.32 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.538039355999999, 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025023626, 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3361 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897527+0000", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900583+0000", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003055107 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900614+0000", 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1318000000000001e-05 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900629+0000", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900786+0000", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001571 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901175+0000", 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038931300000000002 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901558+0000", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038239200000000001 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.915362+0000", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013804712 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922357+0000", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069949610000000001 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922467+0000", 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109147 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922549+0000", 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2002999999999994e-05 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.501981939, 2024-04-22T19:57:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024212230000000001, 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957714+0000", 2024-04-22T19:57:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013487935 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957760+0000", 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5473000000000003e-05 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957795+0000", 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4959000000000002e-05 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3369 3.1f 3:fabda85a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.439884414000002, 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021793924999999999, 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3369 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995684+0000", 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6399999999999996e-06 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997670+0000", 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019854859999999998 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997707+0000", 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6900000000000002e-05 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997729+0000", 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1664000000000001e-05 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997827+0000", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8907999999999996e-05 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998030+0000", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020303500000000001 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998222+0000", 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019167899999999999 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.006416+0000", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081937539999999993 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017349+0000", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010933468999999999 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017418+0000", 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8910000000000003e-05 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017474+0000", 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3375 3.1 3:806a9ea3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.370134857, 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0241683, 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3375 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065432+0000", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.481e-06 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067370+0000", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001938104 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067399+0000", 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9442999999999999e-05 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067414+0000", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4516e-05 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067494+0000", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0456000000000004e-05 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067622+0000", 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793700000000001 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067749+0000", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126303 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.074448+0000", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0066994029999999996 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089457+0000", 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015009039 2024-04-22T19:57:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089518+0000", 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1019e-05 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089598+0000", 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598999999999995e-05 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:30.539 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:30.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:30.541 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:30.537+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:30.642 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:30.640+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:30.706 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:30.706 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:30.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:30.742 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:30.740+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:30.843 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:30.841+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:30.844 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:30.844 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:30.844 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:30.844 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:30.844 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:30.859 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:30.947 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:30.945+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 197.67567977600001, 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:57:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:57:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2700 3.31 3:8d36a364:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.109455810999997, 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019117091999999999, 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2700 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913953+0000", 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.913956+0000", 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4800000000000001e-06 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915283+0000", 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001326867 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915308+0000", 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5065000000000001e-05 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915319+0000", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1028e-05 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915387+0000", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7853000000000002e-05 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915538+0000", 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015074700000000001 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.915661+0000", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012310500000000001 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.923345+0000", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076839170000000002 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.932949+0000", 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096048420000000006 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.933014+0000", 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4187000000000001e-05 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.933070+0000", 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6001000000000001e-05 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2711 3.8 3:13621148:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.990471157999998, 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020635379999999998, 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2711 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032941+0000", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034590+0000", 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016493219999999999 2024-04-22T19:57:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034617+0000", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7367000000000001e-05 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034627+0000", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8130000000000007e-06 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034698+0000", 2024-04-22T19:57:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0747999999999994e-05 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034896+0000", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019808 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.035090+0000", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019395600000000001 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.041596+0000", 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065056209999999996 2024-04-22T19:57:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053466+0000", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011870041 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053521+0000", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.554e-05 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053573+0000", 2024-04-22T19:57:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1467e-05 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2714 3.31 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.960853084, 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024560974999999999, 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2714 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062558+0000", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.469e-06 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064166+0000", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016086519999999999 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064192+0000", 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5829999999999998e-05 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064203+0000", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.112e-05 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064300+0000", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6817999999999994e-05 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064432+0000", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131681 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064585+0000", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000153153 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.068903+0000", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004318194 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.086976+0000", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018072357000000001 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087053+0000", 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7615999999999997e-05 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087116+0000", 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3084999999999997e-05 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2715 3.31 3:8f62fb2c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.950995831, 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019512254999999999, 2024-04-22T19:57:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2715 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072413+0000", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.072415+0000", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1349999999999999e-06 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074206+0000", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017915800000000001 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074238+0000", 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1878999999999998e-05 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074253+0000", 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4508000000000001e-05 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074355+0000", 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102039 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074494+0000", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139715 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.074673+0000", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017902799999999999 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.081603+0000", 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069298349999999996 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091780+0000", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010176665999999999 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091847+0000", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6890999999999994e-05 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.091925+0000", 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7979000000000007e-05 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2785 3.8 3:131c8255:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.285904627999997, 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021038193, 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2785 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737507+0000", 2024-04-22T19:57:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8609999999999998e-06 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739887+0000", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023801930000000001 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739907+0000", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739917+0000", 2024-04-22T19:57:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4849999999999998e-06 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739991+0000", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4096000000000003e-05 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740181+0000", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190595 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740356+0000", 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017416600000000001 2024-04-22T19:57:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.748776+0000", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084208140000000004 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758402+0000", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096257080000000002 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758481+0000", 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9159000000000006e-05 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758542+0000", 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0643000000000002e-05 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2791 3.33 e93/89 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head v 93'6, mlcod=75'4)", 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.221732230999997, 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022223125, 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801678+0000", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4279999999999999e-06 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806397+0000", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047191079999999996 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806413+0000", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019e-05 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806423+0000", 2024-04-22T19:57:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.815e-06 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806489+0000", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6087999999999995e-05 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806511+0000", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2286e-05 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823847+0000", 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017336154999999999 2024-04-22T19:57:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823899+0000", 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2225999999999998e-05 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2792 3.4 3:20cf0ea2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.219779848000002, 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02057749, 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2792 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803632+0000", 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0510000000000001e-06 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806383+0000", 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027517869999999999 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806415+0000", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1644999999999999e-05 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806425+0000", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0443e-05 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806484+0000", 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8557999999999997e-05 2024-04-22T19:57:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806616+0000", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013203999999999999 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806720+0000", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104109 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823724+0000", 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017004063999999999 2024-04-22T19:57:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824086+0000", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036203100000000002 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824153+0000", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6854999999999996e-05 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824206+0000", 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2907e-05 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2819 3.8 3:137d30ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.865486345999997, 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020533365000000001, 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2819 2024-04-22T19:57:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157925+0000", 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.32e-06 2024-04-22T19:57:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160741+0000", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028155179999999999 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160788+0000", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6780000000000003e-05 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160813+0000", 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5049e-05 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160995+0000", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018263399999999999 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161309+0000", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313956 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161568+0000", 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025827599999999999 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.169671+0000", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081033689999999992 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178301+0000", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086300609999999996 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178386+0000", 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5118999999999996e-05 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178455+0000", 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9282999999999994e-05 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2848 3.29 e93/89 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head v 93'12, mlcod=93'10)", 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.245211605000001, 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020717856, 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778200+0000", 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.467e-06 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785343+0000", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071423520000000002 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785385+0000", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2821999999999998e-05 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785404+0000", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785580+0000", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017512100000000001 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785624+0000", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4159000000000002e-05 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798838+0000", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013214066999999999 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798915+0000", 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6908000000000003e-05 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2859 3.31 3:8df1a3fb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.117771058000002, 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022181747000000002, 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2859 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905641+0000", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5540000000000002e-06 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907825+0000", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021841780000000002 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907854+0000", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907866+0000", 2024-04-22T19:57:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907972+0000", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010562 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908172+0000", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020041500000000001 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908341+0000", 2024-04-22T19:57:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168577 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.912566+0000", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042252330000000001 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927689+0000", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015123202000000001 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927764+0000", 2024-04-22T19:57:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4472000000000001e-05 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927819+0000", 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2861 3.19 3:9b000d1b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.094369741000001, 2024-04-22T19:57:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034056910000000003, 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2861 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929042+0000", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.852e-06 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.930981+0000", 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001939068 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931006+0000", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5395e-05 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931016+0000", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0069e-05 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931096+0000", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598000000000006e-05 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931246+0000", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015064200000000001 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931345+0000", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9223999999999997e-05 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.937009+0000", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056634379999999998 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.962963+0000", 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025954222999999998 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963037+0000", 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3887999999999995e-05 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963096+0000", 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8513e-05 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3233 3.0 3:009d57d0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.970416943, 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019816088999999999, 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3233 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052994+0000", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6919999999999998e-06 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054663+0000", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001669048 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054692+0000", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773999999999999e-05 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054706+0000", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4336e-05 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054803+0000", 2024-04-22T19:57:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6668000000000003e-05 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055007+0000", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020395100000000001 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055187+0000", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017976999999999999 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.070365+0000", 2024-04-22T19:57:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015178759999999999 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072674+0000", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002308245 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072739+0000", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5164000000000002e-05 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072808+0000", 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8681000000000002e-05 2024-04-22T19:57:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3317 3.33 e101/89 3:cdd532a6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_246:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.919123368000001, 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019447335999999999, 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104285+0000", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.104286+0000", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2399999999999997e-07 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109751+0000", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054647680000000001 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109790+0000", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9616000000000002e-05 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109814+0000", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3980000000000001e-05 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.109975+0000", 2024-04-22T19:57:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016105500000000001 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.110042+0000", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6562000000000004e-05 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.123591+0000", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013549052000000001 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.123732+0000", 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014147899999999999 2024-04-22T19:57:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3324 3.31 3:8ee13d9a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_253:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.795963894, 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021984026, 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3324 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227449+0000", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1829999999999996e-06 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231194+0000", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037452499999999999 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231245+0000", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0936000000000002e-05 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231271+0000", 2024-04-22T19:57:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6605999999999999e-05 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231384+0000", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112958 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231542+0000", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000157248 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231656+0000", 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114286 2024-04-22T19:57:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.240332+0000", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086758349999999998 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249282+0000", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089503229999999996 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249364+0000", 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1871000000000003e-05 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249429+0000", 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4529999999999994e-05 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3340 3.1a e101/20 3:5a7c4462:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_269:head v 101'7, mlcod=93'5)", 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.521502373000001, 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019383912999999999, 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501906+0000", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.501909+0000", 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4400000000000001e-06 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507480+0000", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055705269999999996 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507513+0000", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3336000000000001e-05 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507531+0000", 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7626999999999999e-05 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507681+0000", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015031500000000001 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.507746+0000", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4350000000000006e-05 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.521191+0000", 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013445642000000001 2024-04-22T19:57:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.521290+0000", 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8676000000000002e-05 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3355 3.25 3:a46ca720:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.215494396, 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022146777999999999, 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3355 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807919+0000", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8899999999999998e-06 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813214+0000", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052952169999999996 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813260+0000", 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5646000000000003e-05 2024-04-22T19:57:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813280+0000", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9816000000000001e-05 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813404+0000", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012438999999999999 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813632+0000", 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022820100000000001 2024-04-22T19:57:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813849+0000", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216419 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.826358+0000", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012509823 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829913+0000", 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035546729999999999 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829996+0000", 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2871e-05 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.830061+0000", 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832000000000005e-05 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3360 3.32 e101/20 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.132581291000001, 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028198335000000001, 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890830+0000", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2629999999999999e-06 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894425+0000", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035946009999999998 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894463+0000", 2024-04-22T19:57:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8420000000000001e-05 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894480+0000", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6736999999999999e-05 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894667+0000", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186911 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894735+0000", 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7476000000000002e-05 2024-04-22T19:57:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.918902+0000", 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024167477999999999 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.919025+0000", 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123449 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3361 3.32 e101/20 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head v 101'17, mlcod=100'14)", 2024-04-22T19:57:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.121628821000002, 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019721044, 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901782+0000", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6910000000000002e-06 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907163+0000", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053810170000000001 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907208+0000", 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4814000000000002e-05 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907240+0000", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1537e-05 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907759+0000", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00051904299999999996 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907825+0000", 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6435999999999999e-05 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921378+0000", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013552878000000001 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921501+0000", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012262800000000001 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3383 3.31 3:8c620c97:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_312:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.870098514999999, 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020532287999999999, 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3383 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153313+0000", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3459999999999998e-06 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155061+0000", 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001748108 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155093+0000", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1902000000000001e-05 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155108+0000", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4450999999999999e-05 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155202+0000", 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4598999999999993e-05 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155388+0000", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018557099999999999 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155566+0000", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017860799999999999 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.163059+0000", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074921390000000001 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173733+0000", 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010674141999999999 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173787+0000", 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4132000000000003e-05 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173842+0000", 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5290000000000001e-05 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.125 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:31.126 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:31.126 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:31.124+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:31.226 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:31.221+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:31.287 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:31.287 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:31.287 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:31.287 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:31.300 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:31.328 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:31.324+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:31.429 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:31.424+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:31.463 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:31.463 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:31.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:31.529 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:31.528+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:31.603 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.161343384999995, 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:57:31.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:57:31.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:31.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.130441949000002, 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:57:31.609 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:57:31.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 81.058066788000005, 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:57:31.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:57:31.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:57:31.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:57:31.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2275 3.2d e75/20 3:b77de023:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_84:head v 75'2, mlcod=0'0)", 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.663794194000005, 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017422361000000001, 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.620 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938982+0000", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.938984+0000", 2024-04-22T19:57:31.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.182e-06 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942975+0000", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039904449999999996 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.942997+0000", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2456999999999999e-05 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943007+0000", 2024-04-22T19:57:31.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.961e-06 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943077+0000", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0399000000000001e-05 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.943103+0000", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5162000000000001e-05 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956360+0000", 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0132579 2024-04-22T19:57:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.956404+0000", 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3854999999999999e-05 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2317 3.2f 3:f407c900:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.226501115999994, 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017106421, 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.624 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2317 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376275+0000", 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.376277+0000", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9719999999999999e-06 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378310+0000", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020325080000000001 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378332+0000", 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2104999999999999e-05 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378343+0000", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1685000000000001e-05 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378413+0000", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9287000000000003e-05 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378574+0000", 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000161822 2024-04-22T19:57:31.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.378686+0000", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111908 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.385101+0000", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064146259999999997 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393270+0000", 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081694409999999995 2024-04-22T19:57:31.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393336+0000", 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5198999999999997e-05 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.393381+0000", 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5868000000000002e-05 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.629 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.059967087000004, 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.635 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 79.619861494000006, 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:57:31.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 79.327335063999996, 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:57:31.641 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.646 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 79.096925009000003, 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:57:31.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:57:31.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:57:31.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:57:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:57:31.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2698 3.2f 3:f41a50d2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.706725624000001, 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021500624999999999, 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2698 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896054+0000", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4070000000000002e-06 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897731+0000", 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001677373 2024-04-22T19:57:31.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897757+0000", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5320000000000002e-05 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897767+0000", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0601000000000001e-05 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897831+0000", 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3792000000000002e-05 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897974+0000", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014317799999999999 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.898075+0000", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010082900000000001 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.904482+0000", 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064069060000000004 2024-04-22T19:57:31.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917373+0000", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012891316999999999 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917470+0000", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6773000000000003e-05 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917551+0000", 2024-04-22T19:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1129000000000002e-05 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2719 3.2e 3:74fbf0ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.489253943000001, 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017402009999999999, 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2719 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113522+0000", 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.113526+0000", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4079999999999998e-06 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116022+0000", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024959040000000002 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116051+0000", 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9099999999999999e-05 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116066+0000", 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5158e-05 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116194+0000", 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793400000000001 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116432+0000", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023872100000000001 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.116604+0000", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017193500000000001 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.123935+0000", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073304930000000004 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130792+0000", 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068571559999999997 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130857+0000", 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4929000000000001e-05 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.130924+0000", 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7272000000000002e-05 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2751 3.5 e93/89 3:a2f28dd9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_100:head v 93'4, mlcod=76'2)", 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 43.101794327999997, 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018490064, 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500982+0000", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.500993+0000", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0903e-05 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505906+0000", 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049134399999999998 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505929+0000", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3059000000000001e-05 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505940+0000", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0356e-05 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505995+0000", 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5452999999999999e-05 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506013+0000", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8298e-05 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.519379+0000", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013365432 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.519472+0000", 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3122999999999996e-05 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.667 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2793 3.2f 3:f78624fc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.783944922000003, 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020778125000000001, 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2793 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.668 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818834+0000", 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820707+0000", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001873612 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820737+0000", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9379000000000001e-05 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820749+0000", 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2045000000000001e-05 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820826+0000", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7217000000000003e-05 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820939+0000", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001132 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.821048+0000", 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108346 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.826602+0000", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055548079999999996 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839518+0000", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012915908 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839559+0000", 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0311000000000001e-05 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839609+0000", 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0668999999999999e-05 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2821 3.3d e93/20 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head v 93'4, mlcod=92'2)", 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.391228628, 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020536564, 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.673 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211550+0000", 2024-04-22T19:57:31.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8729999999999999e-06 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215215+0000", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036646729999999998 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215253+0000", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7438999999999998e-05 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215270+0000", 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7552999999999999e-05 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215405+0000", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134492 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215444+0000", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9523000000000001e-05 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.231920+0000", 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016475447000000001 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232084+0000", 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016456399999999999 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2844 3.1e e93/89 3:7a153530:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_183:head v 93'9, mlcod=77'7)", 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.917408319000003, 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017882711999999999, 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685368+0000", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.685371+0000", 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3830000000000001e-06 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692780+0000", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074083359999999997 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692819+0000", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9378999999999997e-05 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692838+0000", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8717000000000001e-05 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.692971+0000", 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013354400000000001 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.693008+0000", 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6770000000000002e-05 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.703100+0000", 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010091961 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.703251+0000", 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000150622 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2863 3.2e 3:779cdc9f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.650198598000003, 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018555156, 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2863 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952580+0000", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953897+0000", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013164940000000001 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953929+0000", 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2506999999999999e-05 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953945+0000", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6055000000000001e-05 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954048+0000", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102167 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954175+0000", 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012748499999999999 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954289+0000", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114183 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963999+0000", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097093709999999996 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.970984+0000", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069854069999999999 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971069+0000", 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4777999999999994e-05 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971133+0000", 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3983e-05 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3286 3.21 3:87ffc809:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:31.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.979657432, 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019563710000000002, 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3286 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623122+0000", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5140000000000002e-06 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625595+0000", 2024-04-22T19:57:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002472864 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625621+0000", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199000000000001e-05 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625632+0000", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0229e-05 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625696+0000", 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3997000000000004e-05 2024-04-22T19:57:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625703+0000", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5680000000000002e-06 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.628940+0000", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032365340000000001 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629200+0000", 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025989999999999997 2024-04-22T19:57:31.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629474+0000", 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000274524 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642151+0000", 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012676979999999999 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642613+0000", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000461552 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642651+0000", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8677000000000003e-05 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642682+0000", 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3305 3.3b e101/20 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head v 101'13, mlcod=100'11)", 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.732418494000001, 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024596092999999999, 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:31.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870360+0000", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5689999999999999e-06 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878492+0000", 2024-04-22T19:57:31.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081312869999999992 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878539+0000", 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6984999999999998e-05 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878562+0000", 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3093999999999999e-05 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118836 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878708+0000", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7385999999999998e-05 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894800+0000", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016092008000000001 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894954+0000", 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015392800000000001 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3315 3.2f 3:f537b68d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.550834823999999, 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019250771, 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3315 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051944+0000", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9040000000000001e-06 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055166+0000", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032220500000000002 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055208+0000", 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1786999999999998e-05 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055228+0000", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055356+0000", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012841999999999999 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055679+0000", 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032306700000000002 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055982+0000", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000303014 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.067690+0000", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011707917 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.070905+0000", 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032146330000000002 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071068+0000", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163041 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071192+0000", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124146 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3370 3.21 3:866d6ca8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_299:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:31.702 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.590060837999999, 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019362226, 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3370 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:31.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012719+0000", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.49e-06 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015600+0000", 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028813810000000001 2024-04-22T19:57:31.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015637+0000", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6324e-05 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015653+0000", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6096999999999999e-05 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015771+0000", 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011813500000000001 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015978+0000", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020772799999999999 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.016172+0000", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019356000000000001 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.029314+0000", 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013141774 2024-04-22T19:57:31.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.031975+0000", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026608309999999998 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032022+0000", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7580999999999997e-05 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032078+0000", 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325000000000003e-05 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:31.708 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:31.708 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:31.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-22T19:57:31.709 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:31.710 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:31.708+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:31.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:31.839 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:31.837+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:31.869 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:31.869 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:31.869 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:31.869 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:31.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:31.911 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:31.908+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:31.930 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:31.930 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:31.962 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:31.962 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:31.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:31.980 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:32.012 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:32.009+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:32.018 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:32.018 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:32.038 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:32.038 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:32.041 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.041 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.054 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:32.058 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:32.059 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:32.079 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:32.079 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:32.113 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:32.112+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:32.168 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.169 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.181 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:32.225 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:32.224+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:32.312 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.312 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.315 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:32.309+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:32.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:32.416 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:32.413+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:32.495 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.495 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.509 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:32.553 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:32.552+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:32.612 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is set 2024-04-22T19:57:32.622 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:32.617+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:32.627 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.627 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:32.719 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:32.717+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:32.810 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.810 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:32.820 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:32.816+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:32.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:32.921 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:32.916+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.001 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:33.045 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:33.044+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:33.122 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:33.117+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:33.164 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.164 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.178 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:33.225 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:33.224+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:33.296 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.296 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.310 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:33.354 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:33.352+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:33.424 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:33.421+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:33.476 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.476 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:33.537 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:33.536+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:33.610 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.610 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.625 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:33.625 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:33.621+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:33.726 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:33.721+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:33.798 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.799 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:33.865 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:33.864+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:33.928 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:33.924+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:33.951 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:33.951 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:33.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:34.029 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:34.025+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:34.095 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:34.130 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:34.128+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:34.156 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:34.156 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:34.176 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:34.231 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:34.229+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:34.310 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:34.311 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:34.314 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:34.314 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:34.332 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:34.328+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:34.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:34.346 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:34.382 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:34.382 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:34.414 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:34.414 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:34.432 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:34.429+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:34.453 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:34.491 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:34.491 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:34.514 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:34.514 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:34.514 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:34.514 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:34.514 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:34.526 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:34.526 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:34.533 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:34.529+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:34.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:34.553 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:34.553 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:34.635 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:34.633+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:34.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:57:34.695 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.054751678000002, 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.095404187, 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.930553754000002, 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.709874814000003, 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2727 3.23 3:c759b3e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.473596489999998, 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020866947, 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2727 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221186+0000", 2024-04-22T19:57:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.221189+0000", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9210000000000001e-06 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223161+0000", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019713899999999999 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223204+0000", 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3235999999999997e-05 2024-04-22T19:57:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223232+0000", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7869e-05 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223346+0000", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011461899999999999 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223529+0000", 2024-04-22T19:57:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018233799999999999 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.223699+0000", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170459 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.232297+0000", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085980680000000004 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.241931+0000", 2024-04-22T19:57:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096342200000000006 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242001+0000", 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9760999999999998e-05 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.242053+0000", 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2065999999999999e-05 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2752 3.32 3:4dcc7a09:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.191194054999997, 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021065733999999999, 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2752 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503589+0000", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.503592+0000", 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1640000000000001e-06 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505558+0000", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661930000000002 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505608+0000", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9957999999999998e-05 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505626+0000", 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7927999999999998e-05 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505735+0000", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010932799999999999 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.505919+0000", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000183356 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.506080+0000", 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016146800000000001 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.521592+0000", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015511723 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524530+0000", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029378490000000002 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524600+0000", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9931000000000005e-05 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.524654+0000", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4836000000000001e-05 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.985190072999998, 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2794 3.24 e93/89 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head v 93'8, mlcod=92'6)", 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.858670093000001, 2024-04-22T19:57:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021407932000000001, 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836113+0000", 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.836114+0000", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.826e-06 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840272+0000", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00415745 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840291+0000", 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9398e-05 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840302+0000", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1134999999999999e-05 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840367+0000", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4573000000000007e-05 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.840384+0000", 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6600999999999999e-05 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857472+0000", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017088431000000001 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857521+0000", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8517999999999999e-05 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2795 3.1f 3:f85731d8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.857375949000001, 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020520294000000001, 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2795 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837407+0000", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.837409+0000", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.187e-06 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839272+0000", 2024-04-22T19:57:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001863471 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839305+0000", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2502999999999997e-05 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839319+0000", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4205e-05 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839391+0000", 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2092e-05 2024-04-22T19:57:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839533+0000", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014198100000000001 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839690+0000", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156429 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.851666+0000", 2024-04-22T19:57:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01197669 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857857+0000", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061904270000000001 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857895+0000", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7908999999999999e-05 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.857927+0000", 2024-04-22T19:57:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2400000000000001e-05 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.506328574999998, 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.489422009999998, 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.704050187999997, 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.697777532000003, 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3306 3.18 3:1adb3c90:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.819475149999999, 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021117510999999999, 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3306 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875308+0000", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.875311+0000", 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9299999999999996e-06 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878617+0000", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003305568 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878657+0000", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9696000000000001e-05 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3286999999999999e-05 2024-04-22T19:57:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878844+0000", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016400799999999999 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879225+0000", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038060200000000001 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.879617+0000", 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039190299999999998 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.895969+0000", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016352717999999999 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896258+0000", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000288774 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896356+0000", 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8412000000000006e-05 2024-04-22T19:57:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.896425+0000", 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8613000000000002e-05 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3356 3.1f 3:f9fbdd03:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.871619706000001, 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029944853, 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3356 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823167+0000", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4839999999999998e-06 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.828985+0000", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058170740000000002 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829040+0000", 2024-04-22T19:57:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5145999999999997e-05 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829067+0000", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7436999999999998e-05 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829180+0000", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011269600000000001 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829385+0000", 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204754 2024-04-22T19:57:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829546+0000", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016156800000000001 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.837701+0000", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081547240000000003 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.852993+0000", 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015291677 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853045+0000", 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2627999999999998e-05 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853108+0000", 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2664999999999997e-05 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3360 3.32 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.808441838, 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.035914033999999997, 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3360 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886344+0000", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999998e-06 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890144+0000", 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037993979999999998 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890187+0000", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3365999999999998e-05 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890213+0000", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6423000000000001e-05 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890323+0000", 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109403 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890502+0000", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946999999999999 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890665+0000", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016283000000000001 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.898657+0000", 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079918620000000006 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922014+0000", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023356965 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922143+0000", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128942 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922255+0000", 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011208499999999999 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3361 3.32 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.797257828999999, 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025023626, 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3361 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897527+0000", 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900583+0000", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003055107 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900614+0000", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1318000000000001e-05 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900629+0000", 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900786+0000", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001571 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901175+0000", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038931300000000002 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901558+0000", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038239200000000001 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.915362+0000", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013804712 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922357+0000", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069949610000000001 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922467+0000", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109147 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922549+0000", 2024-04-22T19:57:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2002999999999994e-05 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.761200412000001, 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024212230000000001, 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957714+0000", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013487935 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957760+0000", 2024-04-22T19:57:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5473000000000003e-05 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957795+0000", 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4959000000000002e-05 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3369 3.1f 3:fabda85a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.699102886999999, 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021793924999999999, 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3369 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995680+0000", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.995684+0000", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6399999999999996e-06 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997670+0000", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019854859999999998 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997707+0000", 2024-04-22T19:57:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6900000000000002e-05 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997729+0000", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1664000000000001e-05 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.997827+0000", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8907999999999996e-05 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998030+0000", 2024-04-22T19:57:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020303500000000001 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.998222+0000", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019167899999999999 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.006416+0000", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081937539999999993 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017349+0000", 2024-04-22T19:57:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010933468999999999 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017418+0000", 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8910000000000003e-05 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.017474+0000", 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3375 3.1 3:806a9ea3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.629353330000001, 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0241683, 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3375 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065432+0000", 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.481e-06 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067370+0000", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001938104 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067399+0000", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9442999999999999e-05 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067414+0000", 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4516e-05 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067494+0000", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0456000000000004e-05 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067622+0000", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793700000000001 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067749+0000", 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126303 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.074448+0000", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0066994029999999996 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089457+0000", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015009039 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089518+0000", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1019e-05 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089598+0000", 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598999999999995e-05 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:34.801 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:34.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:34.803 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:34.800+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:34.903 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:34.901+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:34.989 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:34.989 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:34.989 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:34.990 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:35.004 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:35.001+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:35.013 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:35.105 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:35.100+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:35.206 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:35.204+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:35.247 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:35.247 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:35.247 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:35.248 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:35.248 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:35.271 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:35.315 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:35.313+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:35.408 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:35.404+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 202.070233946, 2024-04-22T19:57:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:35.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2711 3.8 3:13621148:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.385025327999998, 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020635379999999998, 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.426 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2711 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:35.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032941+0000", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034590+0000", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016493219999999999 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034617+0000", 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7367000000000001e-05 2024-04-22T19:57:35.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034627+0000", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8130000000000007e-06 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034698+0000", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0747999999999994e-05 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034896+0000", 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019808 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.035090+0000", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019395600000000001 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.041596+0000", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065056209999999996 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053466+0000", 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011870041 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053521+0000", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.554e-05 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053573+0000", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1467e-05 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2714 3.31 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.355407253999999, 2024-04-22T19:57:35.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024560974999999999, 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2714 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062558+0000", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.469e-06 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064166+0000", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016086519999999999 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064192+0000", 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5829999999999998e-05 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064203+0000", 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.112e-05 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064300+0000", 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6817999999999994e-05 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064432+0000", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131681 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064585+0000", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000153153 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.068903+0000", 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004318194 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.086976+0000", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018072357000000001 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087053+0000", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7615999999999997e-05 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087116+0000", 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3084999999999997e-05 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.436 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2785 3.8 3:131c8255:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.680458797999997, 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021038193, 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2785 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737507+0000", 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8609999999999998e-06 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739887+0000", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023801930000000001 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739907+0000", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739917+0000", 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4849999999999998e-06 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739991+0000", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4096000000000003e-05 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740181+0000", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190595 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740356+0000", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017416600000000001 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.748776+0000", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084208140000000004 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758402+0000", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096257080000000002 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758481+0000", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9159000000000006e-05 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758542+0000", 2024-04-22T19:57:35.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0643000000000002e-05 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2791 3.33 e93/89 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head v 93'6, mlcod=75'4)", 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.616286400999996, 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022223125, 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801678+0000", 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4279999999999999e-06 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806397+0000", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047191079999999996 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806413+0000", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019e-05 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806423+0000", 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.815e-06 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806489+0000", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6087999999999995e-05 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806511+0000", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2286e-05 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823847+0000", 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017336154999999999 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823899+0000", 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2225999999999998e-05 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2792 3.4 3:20cf0ea2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.614334018000001, 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02057749, 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.446 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2792 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803632+0000", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0510000000000001e-06 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806383+0000", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027517869999999999 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806415+0000", 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1644999999999999e-05 2024-04-22T19:57:35.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806425+0000", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0443e-05 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806484+0000", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8557999999999997e-05 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806616+0000", 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013203999999999999 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806720+0000", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104109 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823724+0000", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017004063999999999 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824086+0000", 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036203100000000002 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824153+0000", 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6854999999999996e-05 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824206+0000", 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2907e-05 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2819 3.8 3:137d30ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.260040515999997, 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020533365000000001, 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2819 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157925+0000", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.32e-06 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160741+0000", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028155179999999999 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160788+0000", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6780000000000003e-05 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160813+0000", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5049e-05 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160995+0000", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018263399999999999 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161309+0000", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313956 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161568+0000", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025827599999999999 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.169671+0000", 2024-04-22T19:57:35.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081033689999999992 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178301+0000", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086300609999999996 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178386+0000", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5118999999999996e-05 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178455+0000", 2024-04-22T19:57:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9282999999999994e-05 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2848 3.29 e93/89 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head v 93'12, mlcod=93'10)", 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.639765775000001, 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020717856, 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778200+0000", 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.467e-06 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785343+0000", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071423520000000002 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785385+0000", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2821999999999998e-05 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785404+0000", 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785580+0000", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017512100000000001 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785624+0000", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4159000000000002e-05 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798838+0000", 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013214066999999999 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798915+0000", 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6908000000000003e-05 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2859 3.31 3:8df1a3fb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.512325228000002, 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022181747000000002, 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.461 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2859 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905641+0000", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5540000000000002e-06 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907825+0000", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021841780000000002 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907854+0000", 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907866+0000", 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907972+0000", 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010562 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908172+0000", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020041500000000001 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908341+0000", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168577 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.912566+0000", 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042252330000000001 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927689+0000", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015123202000000001 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927764+0000", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4472000000000001e-05 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927819+0000", 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.466 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2861 3.19 3:9b000d1b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.488923911000001, 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034056910000000003, 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2861 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929042+0000", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.852e-06 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.930981+0000", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001939068 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931006+0000", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5395e-05 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931016+0000", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0069e-05 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931096+0000", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598000000000006e-05 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931246+0000", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015064200000000001 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:35.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931345+0000", 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9223999999999997e-05 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.937009+0000", 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056634379999999998 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.962963+0000", 2024-04-22T19:57:35.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025954222999999998 2024-04-22T19:57:35.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963037+0000", 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3887999999999995e-05 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963096+0000", 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8513e-05 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.473 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3233 3.0 3:009d57d0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.364971112999999, 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019816088999999999, 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3233 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052991+0000", 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.052994+0000", 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6919999999999998e-06 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054663+0000", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001669048 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054692+0000", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773999999999999e-05 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054706+0000", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4336e-05 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.054803+0000", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6668000000000003e-05 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055007+0000", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020395100000000001 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.055187+0000", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017976999999999999 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.070365+0000", 2024-04-22T19:57:35.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015178759999999999 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072674+0000", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002308245 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072739+0000", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5164000000000002e-05 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.072808+0000", 2024-04-22T19:57:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8681000000000002e-05 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3324 3.31 3:8ee13d9a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_253:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.190518063999999, 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021984026, 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.479 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3324 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227449+0000", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1829999999999996e-06 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231194+0000", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037452499999999999 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231245+0000", 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0936000000000002e-05 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231271+0000", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6605999999999999e-05 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231384+0000", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112958 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231542+0000", 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000157248 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231656+0000", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114286 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.240332+0000", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086758349999999998 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249282+0000", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089503229999999996 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249364+0000", 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1871000000000003e-05 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249429+0000", 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4529999999999994e-05 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3355 3.25 3:a46ca720:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:35.484 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.610048566, 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022146777999999999, 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3355 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807919+0000", 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8899999999999998e-06 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813214+0000", 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052952169999999996 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813260+0000", 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5646000000000003e-05 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813280+0000", 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9816000000000001e-05 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813404+0000", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012438999999999999 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813632+0000", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022820100000000001 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813849+0000", 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216419 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.826358+0000", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012509823 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829913+0000", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035546729999999999 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829996+0000", 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2871e-05 2024-04-22T19:57:35.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.830061+0000", 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832000000000005e-05 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3360 3.32 e101/20 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.527135461, 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028198335000000001, 2024-04-22T19:57:35.490 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890830+0000", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2629999999999999e-06 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894425+0000", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035946009999999998 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894463+0000", 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8420000000000001e-05 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894480+0000", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6736999999999999e-05 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894667+0000", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186911 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894735+0000", 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7476000000000002e-05 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.918902+0000", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024167477999999999 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.919025+0000", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123449 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3361 3.32 e101/20 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head v 101'17, mlcod=100'14)", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:35.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.516182991000001, 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019721044, 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901780+0000", 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901782+0000", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6910000000000002e-06 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907163+0000", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053810170000000001 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907208+0000", 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4814000000000002e-05 2024-04-22T19:57:35.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907240+0000", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1537e-05 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907759+0000", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00051904299999999996 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.907825+0000", 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6435999999999999e-05 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921378+0000", 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013552878000000001 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.921501+0000", 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012262800000000001 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.498 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3383 3.31 3:8c620c97:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_312:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.264652685000001, 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020532287999999999, 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3383 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153313+0000", 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3459999999999998e-06 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155061+0000", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001748108 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155093+0000", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1902000000000001e-05 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155108+0000", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4450999999999999e-05 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155202+0000", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4598999999999993e-05 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155388+0000", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018557099999999999 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155566+0000", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017860799999999999 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.163059+0000", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074921390000000001 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173733+0000", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010674141999999999 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173787+0000", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4132000000000003e-05 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173842+0000", 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5290000000000001e-05 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3813 3.25 3:a6cab3b3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.79176882299999995, 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020933044000000001, 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3813 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626197+0000", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.371e-06 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628121+0000", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001923789 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628142+0000", 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1251e-05 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628152+0000", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8360000000000004e-06 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628217+0000", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4548000000000006e-05 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628378+0000", 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016110500000000001 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628505+0000", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127081 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.642420+0000", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013914805000000001 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.646901+0000", 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044811010000000004 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.647036+0000", 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135069 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.647127+0000", 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1088000000000006e-05 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3825 3.8 3:11872a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.66140053099999996, 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020237891000000001, 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3825 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756565+0000", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6699999999999998e-06 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758932+0000", 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023673850000000001 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758962+0000", 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9430000000000001e-05 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758976+0000", 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4415e-05 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759059+0000", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3479999999999994e-05 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759207+0000", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000147978 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759346+0000", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138429 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.768298+0000", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089525239999999999 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776679+0000", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083801799999999992 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776744+0000", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5356000000000002e-05 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776800+0000", 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6044000000000001e-05 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3831 3.1a e108/20 3:59880038:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_82:head v 108'15, mlcod=102'13)", 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.58733488599999994, 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021972061000000001, 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830630+0000", 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1799999999999999e-06 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835032+0000", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044018870000000002 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835065+0000", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3701000000000001e-05 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835080+0000", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4999e-05 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835175+0000", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4129000000000006e-05 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835204+0000", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9862999999999999e-05 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.852537+0000", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017332500000000001 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.852600+0000", 2024-04-22T19:57:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2801999999999999e-05 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3854 3.4 3:235fa5bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.34184420900000001, 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021805609, 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3854 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076122+0000", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8449999999999996e-06 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077874+0000", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001751739 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077897+0000", 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3030000000000001e-05 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077909+0000", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077992+0000", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2971000000000002e-05 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078166+0000", 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017426799999999999 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078327+0000", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016065400000000001 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.089937+0000", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011609974 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097802+0000", 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078649089999999998 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097873+0000", 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0845000000000004e-05 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097924+0000", 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1085000000000003e-05 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:35.524 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:35.525 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:35.526 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:35.524+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:35.627 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:35.625+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:57:35.720 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:35.720 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:35.720 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:35.720 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:35.728 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:35.725+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:35.738 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:35.829 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:35.825+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:35.912 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:35.912 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:35.912 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:35.930 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:35.925+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:35.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:36.031 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:36.028+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:36.115 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.673173023000004, 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:36.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:57:36.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:57:36.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:57:36.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.120 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2231 3.37 3:eca085ac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.642271586999996, 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018938714999999998, 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2231 2024-04-22T19:57:36.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472334+0000", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.472338+0000", 2024-04-22T19:57:36.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4340000000000001e-06 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473845+0000", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001506971 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473870+0000", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5041e-05 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473880+0000", 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0519e-05 2024-04-22T19:57:36.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.473953+0000", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2502999999999993e-05 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474091+0000", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138252 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.474187+0000", 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6099000000000003e-05 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.479894+0000", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057067139999999999 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491178+0000", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011283922 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491219+0000", 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1232000000000001e-05 2024-04-22T19:57:36.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.491273+0000", 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4027999999999998e-05 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.569896426, 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.126 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:57:36.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:57:36.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.571796724999999, 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:57:36.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:57:36.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.137 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.131691132, 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:36.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:57:36.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:57:36.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.839164702000005, 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.143 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:57:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:57:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:57:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 83.608754646999998, 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.148 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:36.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:57:36.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:57:36.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2698 3.2f 3:f41a50d2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:36.153 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 48.218555262000002, 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021500624999999999, 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2698 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896054+0000", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4070000000000002e-06 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897731+0000", 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001677373 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897757+0000", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5320000000000002e-05 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897767+0000", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0601000000000001e-05 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897831+0000", 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3792000000000002e-05 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897974+0000", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014317799999999999 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.898075+0000", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010082900000000001 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.904482+0000", 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064069060000000004 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917373+0000", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012891316999999999 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917470+0000", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6773000000000003e-05 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917551+0000", 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1129000000000002e-05 2024-04-22T19:57:36.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2793 3.2f 3:f78624fc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.295774559999998, 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020778125000000001, 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2793 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818834+0000", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820707+0000", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001873612 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820737+0000", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9379000000000001e-05 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820749+0000", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2045000000000001e-05 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820826+0000", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7217000000000003e-05 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820939+0000", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001132 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.821048+0000", 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108346 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.826602+0000", 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055548079999999996 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839518+0000", 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012915908 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839559+0000", 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0311000000000001e-05 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839609+0000", 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0668999999999999e-05 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2821 3.3d e93/20 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head v 93'4, mlcod=92'2)", 2024-04-22T19:57:36.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.903058266000002, 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020536564, 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:36.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211550+0000", 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8729999999999999e-06 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215215+0000", 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036646729999999998 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215253+0000", 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7438999999999998e-05 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215270+0000", 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7552999999999999e-05 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215405+0000", 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134492 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215444+0000", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9523000000000001e-05 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.231920+0000", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016475447000000001 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232084+0000", 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016456399999999999 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2863 3.2e 3:779cdc9f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.162028235999998, 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018555156, 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2863 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952578+0000", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.952580+0000", 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7259999999999998e-06 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953897+0000", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013164940000000001 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953929+0000", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2506999999999999e-05 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.953945+0000", 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6055000000000001e-05 2024-04-22T19:57:36.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954048+0000", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102167 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954175+0000", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012748499999999999 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.954289+0000", 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114183 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963999+0000", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097093709999999996 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.970984+0000", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069854069999999999 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971069+0000", 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4777999999999994e-05 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.971133+0000", 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3983e-05 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3286 3.21 3:87ffc809:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.491487070000002, 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019563710000000002, 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.174 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3286 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623122+0000", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5140000000000002e-06 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625595+0000", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002472864 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625621+0000", 2024-04-22T19:57:36.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199000000000001e-05 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625632+0000", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0229e-05 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625696+0000", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3997000000000004e-05 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625703+0000", 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5680000000000002e-06 2024-04-22T19:57:36.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.628940+0000", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032365340000000001 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629200+0000", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025989999999999997 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629474+0000", 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000274524 2024-04-22T19:57:36.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642151+0000", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012676979999999999 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642613+0000", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000461552 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642651+0000", 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8677000000000003e-05 2024-04-22T19:57:36.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642682+0000", 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3305 3.3b e101/20 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head v 101'13, mlcod=100'11)", 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.244248131999999, 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024596092999999999, 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.180 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870360+0000", 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5689999999999999e-06 2024-04-22T19:57:36.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878492+0000", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081312869999999992 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878539+0000", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6984999999999998e-05 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878562+0000", 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3093999999999999e-05 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118836 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878708+0000", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7385999999999998e-05 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894800+0000", 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016092008000000001 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894954+0000", 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015392800000000001 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3315 3.2f 3:f537b68d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.062664462000001, 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019250771, 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.184 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3315 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051944+0000", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9040000000000001e-06 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055166+0000", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032220500000000002 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055208+0000", 2024-04-22T19:57:36.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1786999999999998e-05 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055228+0000", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055356+0000", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012841999999999999 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055679+0000", 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032306700000000002 2024-04-22T19:57:36.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055982+0000", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000303014 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.067690+0000", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011707917 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.070905+0000", 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032146330000000002 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071068+0000", 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163041 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071192+0000", 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124146 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3370 3.21 3:866d6ca8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_299:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:36.189 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.101890476000001, 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019362226, 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3370 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:36.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012719+0000", 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.49e-06 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015600+0000", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028813810000000001 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015637+0000", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6324e-05 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015653+0000", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6096999999999999e-05 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015771+0000", 2024-04-22T19:57:36.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011813500000000001 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015978+0000", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020772799999999999 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.016172+0000", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019356000000000001 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.029314+0000", 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013141774 2024-04-22T19:57:36.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.031975+0000", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026608309999999998 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032022+0000", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7580999999999997e-05 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032078+0000", 2024-04-22T19:57:36.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325000000000003e-05 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3812 3.3b e108/20 3:dc89476b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_63:head v 108'21, mlcod=101'19)", 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.4914204170000001, 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020873282, 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623187+0000", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.635e-06 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627477+0000", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042899130000000002 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627512+0000", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4881e-05 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627527+0000", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5464e-05 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627658+0000", 2024-04-22T19:57:36.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013029400000000001 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627689+0000", 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0984e-05 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.643998+0000", 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016309636999999998 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.644059+0000", 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0473999999999997e-05 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3822 3.2f 3:f4f6347d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.393289352, 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023717291000000001, 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3822 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721319+0000", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6649999999999999e-06 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723264+0000", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001945174 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723288+0000", 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3703999999999999e-05 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723299+0000", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0784e-05 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723380+0000", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1168999999999995e-05 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723568+0000", 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188235 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723673+0000", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104743 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.731285+0000", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076124390000000004 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.744914+0000", 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013628144999999999 2024-04-22T19:57:36.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.744984+0000", 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0641000000000003e-05 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.745034+0000", 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9592000000000002e-05 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3847 3.2f 3:f4be1876:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:36.204 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1045116749999999, 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020204878999999999, 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3847 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010097+0000", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0170000000000001e-06 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012017+0000", 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019202749999999999 2024-04-22T19:57:36.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012049+0000", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1390000000000003e-05 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012063+0000", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4233000000000001e-05 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012137+0000", 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3540000000000004e-05 2024-04-22T19:57:36.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012265+0000", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128064 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012386+0000", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121457 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.023337+0000", 2024-04-22T19:57:36.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010950797999999999 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030168+0000", 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068313380000000002 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030247+0000", 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8588e-05 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030299+0000", 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2179000000000003e-05 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3853 3.2d e108/20 3:b54725bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_104:head v 108'18, mlcod=101'16)", 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.0423161270000001, 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021241927000000001, 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072291+0000", 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0979999999999999e-06 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077032+0000", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047411500000000004 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077064+0000", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2527000000000002e-05 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077081+0000", 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6252e-05 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077171+0000", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0481000000000003e-05 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077190+0000", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9029999999999999e-05 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.093471+0000", 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016280913000000001 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.093532+0000", 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0476000000000002e-05 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3854 3.4 e108/20 3:235fa5bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_105:head v 108'22, mlcod=101'20)", 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.078434+0000", 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.036171951, 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019151604999999999, 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078434+0000", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078434+0000", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078435+0000", 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4890000000000001e-06 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.080973+0000", 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025373290000000001 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.080992+0000", 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9609000000000001e-05 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.081005+0000", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2616000000000001e-05 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.081092+0000", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6639999999999997e-05 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.081117+0000", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5491e-05 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097547+0000", 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016429671999999999 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097585+0000", 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8758999999999999e-05 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.218 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:36.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:36.220 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:36.216+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:36.320 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:36.316+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:36.360 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:36.360 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:36.360 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:36.361 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:36.382 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:36.422 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:36.420+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:36.522 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:36.516+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:36.562 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:36.562 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:36.562 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:36.562 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:36.562 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:36.579 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:36.581 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-22T19:57:36.623 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:36.620+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:36.724 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:36.720+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.256080061000006, 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.120281681999998, 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:57:36.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:57:36.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:57:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:57:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.917563904000005, 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:57:36.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:57:36.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.656248000000005, 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:57:36.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.597101756000001, 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.804 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:57:36.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:36.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.497742873999997, 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:57:36.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.353899206999998, 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:57:36.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:57:36.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:57:36.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.305057955999999, 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.819 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.247324488999993, 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:57:36.824 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:36.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:57:36.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.829 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.155682580999994, 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:57:36.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:57:36.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.757776059999998, 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.835 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:57:36.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.707083811999993, 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.840 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:57:36.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:57:36.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:57:36.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:57:36.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.437512056000003, 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:57:36.845 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.353874301999994, 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:57:36.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.317332234000006, 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.856 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:36.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:57:36.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:57:36.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:57:36.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.861 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.252294105000004, 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:57:36.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:57:36.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.234558100000001, 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.867 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:57:36.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:57:36.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.067726386000004, 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:57:36.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:57:36.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.062529135999995, 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 84.024281625, 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:36.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:36.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:57:36.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:57:36.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:57:36.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:36.887 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:36.889 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:36.889 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:36.889 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:36.890 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:36.890 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:36.890 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:36.890 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:36.891 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:36.891 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:36.891 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:36.884+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:36.894 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:36.894 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:36.931 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:36.931 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:36.965 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:36.965 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:36.986 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:36.986 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:36.989 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:36.988+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:37.039 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.040 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:37.101 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:37.100+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:37.191 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:37.188+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:37.246 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.246 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:37.292 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:37.288+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:37.393 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:37.392+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:37.446 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.446 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.462 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:37.494 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:37.488+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:37.595 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:37.592+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:37.638 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.639 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.654 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:37.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:57:37.697 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:37.696+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:37.785 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.785 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.796 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:37.792+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:37.806 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:37.897 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:37.896+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:37.987 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:37.988 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:37.998 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:37.992+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:38.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:38.099 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:38.096+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:38.181 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:38.181 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:38.200 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-22T19:57:38.196+0000 7ff2222dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25250) UID: 0 2024-04-22T19:57:38.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:38.301 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:38.296+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:38.380 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:38.380 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:38.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:38.401 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:38.400+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:38.502 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:38.496+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:38.531 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:38.531 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:38.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:38.603 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:38.600+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:38.658 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:57:38.692 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:38.693 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:38.713 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:38.743 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-22T19:57:38.740+0000 7fcb59eeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25168) UID: 0 2024-04-22T19:57:38.806 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:38.800+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:38.846 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:38.847 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:38.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:38.906 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:38.900+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:39.007 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:39.004+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:39.007 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-22T19:57:39.010 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-22T19:57:39.010 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-22T19:57:39.029 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-22T19:57:39.107 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:39.104+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:39.197 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0: {} 2024-04-22T19:57:39.198 INFO:teuthology.orchestra.run.smithi111.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-22T19:57:39.208 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:39.204+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:39.213 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:39.213 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:39.213 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:39.213 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:39.222 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1: {} 2024-04-22T19:57:39.222 INFO:teuthology.orchestra.run.smithi111.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-22T19:57:39.239 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-22T19:57:39.248 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2: {} 2024-04-22T19:57:39.248 INFO:teuthology.orchestra.run.smithi111.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-22T19:57:39.273 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3: {} 2024-04-22T19:57:39.273 INFO:teuthology.orchestra.run.smithi111.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-22T19:57:39.306 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4: {} 2024-04-22T19:57:39.307 INFO:teuthology.orchestra.run.smithi111.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-22T19:57:39.309 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:39.304+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:39.340 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5: {} 2024-04-22T19:57:39.340 INFO:teuthology.orchestra.run.smithi111.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-22T19:57:39.372 INFO:teuthology.orchestra.run.smithi111.stdout:osd.6: {} 2024-04-22T19:57:39.372 INFO:teuthology.orchestra.run.smithi111.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-22T19:57:39.410 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:39.408+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:39.411 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:39.411 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:39.411 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:39.412 INFO:teuthology.orchestra.run.smithi111.stdout:osd.7: {} 2024-04-22T19:57:39.412 INFO:teuthology.orchestra.run.smithi111.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-22T19:57:39.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-22T19:57:39.527 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-22T19:57:39.524+0000 7f0fd1c1c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-22T19:57:39.612 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:39.608+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:39.621 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2246 3.17 3:e86cb9fe:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.978944505000001, 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025377452000000002, 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.622 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2246 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640031+0000", 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.640034+0000", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642462+0000", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024281210000000001 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642505+0000", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.316e-05 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642516+0000", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0954999999999999e-05 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642605+0000", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8738000000000003e-05 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642716+0000", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110858 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.642811+0000", 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4870000000000005e-05 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.649241+0000", 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006429911 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665292+0000", 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016051097 2024-04-22T19:57:39.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665355+0000", 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3723e-05 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.665408+0000", 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3128999999999999e-05 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.627 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2671 3.b 3:d196524a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.019597013999999, 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024669902, 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2671 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599379+0000", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.599381+0000", 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8499999999999998e-06 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601913+0000", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025311449999999998 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601969+0000", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6910999999999998e-05 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.601985+0000", 2024-04-22T19:57:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5488000000000001e-05 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602066+0000", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0753000000000004e-05 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602226+0000", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160116 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.602367+0000", 2024-04-22T19:57:39.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014117200000000001 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.609761+0000", 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073935700000000004 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623949+0000", 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014188773999999999 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.623991+0000", 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1560999999999997e-05 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.624048+0000", 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7562000000000002e-05 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2686 3.17 3:eac6bdcc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.854746581000001, 2024-04-22T19:57:39.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02411145, 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2686 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:39.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764229+0000", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.764232+0000", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.604e-06 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765959+0000", 2024-04-22T19:57:39.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001727557 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.765988+0000", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8668999999999999e-05 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766003+0000", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5511000000000001e-05 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766102+0000", 2024-04-22T19:57:39.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8498000000000005e-05 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766295+0000", 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000193606 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.766488+0000", 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019297800000000001 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.771554+0000", 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050656970000000001 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788239+0000", 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684590999999999 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788289+0000", 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0368999999999998e-05 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.788340+0000", 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1369999999999998e-05 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2707 3.23 3:c6e00e24:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.634067641000001, 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023665505999999999, 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.639 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2707 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984908+0000", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.984910+0000", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2570000000000002e-06 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986634+0000", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017237730000000001 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986657+0000", 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3129000000000002e-05 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986671+0000", 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3918e-05 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986749+0000", 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7676000000000006e-05 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986876+0000", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012698700000000001 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.986969+0000", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3287000000000003e-05 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.991392+0000", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044226040000000001 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008439+0000", 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017047757 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008508+0000", 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8926999999999999e-05 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.008573+0000", 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5191000000000007e-05 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2782 3.2b 3:d46ac037:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.909382899999997, 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024133403000000001, 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2782 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709593+0000", 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.709597+0000", 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8970000000000001e-06 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711015+0000", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014185650000000001 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711043+0000", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7715000000000001e-05 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711058+0000", 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5298000000000002e-05 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711148+0000", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9806e-05 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711319+0000", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000170896 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.711472+0000", 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015296299999999999 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.716730+0000", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052577759999999996 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733624+0000", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016894196 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733672+0000", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8229999999999997e-05 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.733726+0000", 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4061000000000003e-05 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2820 3.30 e93/20 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head v 93'9, mlcod=93'7)", 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.430521401999997, 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024204702000000002, 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.650 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188454+0000", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.188456+0000", 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2709999999999999e-06 2024-04-22T19:57:39.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193009+0000", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045521399999999997 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193045+0000", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6659999999999998e-05 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193062+0000", 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7186000000000001e-05 2024-04-22T19:57:39.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193212+0000", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000149128 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.193273+0000", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1099000000000006e-05 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212549+0000", 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019276565999999998 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.212659+0000", 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109652 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2821 3.3d 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.413614836999997, 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028240553000000002, 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.654 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2821 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205361+0000", 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.205366+0000", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9830000000000004e-06 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210280+0000", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049142070000000003 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210315+0000", 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4724999999999997e-05 2024-04-22T19:57:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210333+0000", 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7887e-05 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210502+0000", 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016926500000000001 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.210909+0000", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000407284 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211331+0000", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042204699999999999 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232393+0000", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021062171000000001 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233309+0000", 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091599400000000005 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233482+0000", 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000172731 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.233601+0000", 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119259 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2866 3.24 e93/89 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head v 93'10, mlcod=93'8)", 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.628243015000002, 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023817523, 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:39.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990733+0000", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.990734+0000", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994643+0000", 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039084999999999996 2024-04-22T19:57:39.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994674+0000", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892000000000002e-05 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994688+0000", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4138000000000001e-05 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994783+0000", 2024-04-22T19:57:39.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440999999999996e-05 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.994812+0000", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8475000000000001e-05 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014479+0000", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019667069999999998 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.014550+0000", 2024-04-22T19:57:39.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1237999999999998e-05 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2867 3.17 3:e9226dae:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.621970359000002, 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023464801, 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.664 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2867 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997005+0000", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.997008+0000", 2024-04-22T19:57:39.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8320000000000002e-06 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999205+0000", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021974389999999998 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999237+0000", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1118999999999998e-05 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999250+0000", 2024-04-22T19:57:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3742e-05 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999345+0000", 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5097000000000001e-05 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999530+0000", 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018424399999999999 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.999693+0000", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163141 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.015081+0000", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015388265999999999 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020336+0000", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052554089999999999 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020409+0000", 2024-04-22T19:57:39.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2510999999999997e-05 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:50.020470+0000", 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1001000000000001e-05 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3356 3.1f 3:f9fbdd03:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.795812532999999, 2024-04-22T19:57:39.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029944853, 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3356 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823163+0000", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.823167+0000", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4839999999999998e-06 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.828985+0000", 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058170740000000002 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829040+0000", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5145999999999997e-05 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829067+0000", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7436999999999998e-05 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829180+0000", 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011269600000000001 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829385+0000", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204754 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829546+0000", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016156800000000001 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.837701+0000", 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081547240000000003 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.852993+0000", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015291677 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853045+0000", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2627999999999998e-05 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.853108+0000", 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2664999999999997e-05 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.674 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3360 3.32 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.732634664999999, 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.035914033999999997, 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.675 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3360 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886341+0000", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.886344+0000", 2024-04-22T19:57:39.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999998e-06 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890144+0000", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037993979999999998 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890187+0000", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3365999999999998e-05 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890213+0000", 2024-04-22T19:57:39.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6423000000000001e-05 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890323+0000", 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109403 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890502+0000", 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946999999999999 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890665+0000", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016283000000000001 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.898657+0000", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079918620000000006 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922014+0000", 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023356965 2024-04-22T19:57:39.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922143+0000", 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128942 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922255+0000", 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011208499999999999 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3361 3.32 3:4eb32968:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:39.680 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.721450656000002, 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025023626, 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3361 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:39.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897525+0000", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.897527+0000", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5100000000000001e-06 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900583+0000", 2024-04-22T19:57:39.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003055107 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900614+0000", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1318000000000001e-05 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900629+0000", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5063e-05 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.900786+0000", 2024-04-22T19:57:39.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001571 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901175+0000", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038931300000000002 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.901558+0000", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038239200000000001 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.915362+0000", 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013804712 2024-04-22T19:57:39.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922357+0000", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069949610000000001 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922467+0000", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109147 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.922549+0000", 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2002999999999994e-05 2024-04-22T19:57:39.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3364 3.b 3:d1140f6d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.685393239, 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024212230000000001, 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.686 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3364 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933582+0000", 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.933585+0000", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0280000000000001e-06 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936048+0000", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024623420000000002 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936092+0000", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000002e-05 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936130+0000", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8074999999999997e-05 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936257+0000", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127229 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936552+0000", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029445399999999998 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.936796+0000", 2024-04-22T19:57:39.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024396300000000001 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.944226+0000", 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007430412 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957714+0000", 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013487935 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957760+0000", 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5473000000000003e-05 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.957795+0000", 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4959000000000002e-05 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3375 3.1 3:806a9ea3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.553546157, 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0241683, 2024-04-22T19:57:39.691 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3375 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065429+0000", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.065432+0000", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.481e-06 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067370+0000", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001938104 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067399+0000", 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9442999999999999e-05 2024-04-22T19:57:39.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067414+0000", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4516e-05 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067494+0000", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0456000000000004e-05 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067622+0000", 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012793700000000001 2024-04-22T19:57:39.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.067749+0000", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126303 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.074448+0000", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0066994029999999996 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089457+0000", 2024-04-22T19:57:39.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015009039 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089518+0000", 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1019e-05 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.089598+0000", 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598999999999995e-05 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3802 3.22 e108/89 3:479db8f4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_53:head v 108'15, mlcod=100'13)", 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.513428+0000", 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1055476420000003, 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023929491000000001, 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.513428+0000", 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.513428+0000", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.513428+0000", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6699999999999999e-07 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.522749+0000", 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093207329999999994 2024-04-22T19:57:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.522809+0000", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0293e-05 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.522834+0000", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.493e-05 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.522917+0000", 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2604999999999999e-05 2024-04-22T19:57:39.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.522936+0000", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9426999999999999e-05 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.537309+0000", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014372484 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.537357+0000", 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8652000000000001e-05 2024-04-22T19:57:39.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3805 3.12 3:4a5c9a54:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.539734+0000", 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.0792414240000001, 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021946994000000001, 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.701 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3805 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.539734+0000", 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.539734+0000", 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.539736+0000", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0389999999999999e-06 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541350+0000", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00161393 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541381+0000", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1189999999999998e-05 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541396+0000", 2024-04-22T19:57:39.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4282e-05 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541472+0000", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6857e-05 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541593+0000", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012029899999999999 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.541691+0000", 2024-04-22T19:57:39.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8474000000000006e-05 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.548134+0000", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064429159999999999 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.561554+0000", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013419883000000001 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.561624+0000", 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9709999999999995e-05 2024-04-22T19:57:39.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.561681+0000", 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7414000000000003e-05 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3874 3.17 3:ea1be11e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.315589+0000", 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3033864489999996, 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022675456, 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.706 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3874 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.315589+0000", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.315589+0000", 2024-04-22T19:57:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.315592+0000", 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3979999999999999e-06 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.317993+0000", 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002400068 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.318010+0000", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7411e-05 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.318023+0000", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3047999999999999e-05 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.318095+0000", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2052999999999996e-05 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.318247+0000", 2024-04-22T19:57:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015194500000000001 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.318357+0000", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110041 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.324880+0000", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065232329999999998 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.338159+0000", 2024-04-22T19:57:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013278978 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.338215+0000", 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6008999999999999e-05 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.338265+0000", 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9271999999999999e-05 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3924 3.17 3:ea6097c6:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.858031+0000", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.7609445689999998, 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025841128000000001, 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3924 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.858031+0000", 2024-04-22T19:57:39.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.858031+0000", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.858033+0000", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5270000000000001e-06 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.859701+0000", 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001667984 2024-04-22T19:57:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.859725+0000", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3852000000000001e-05 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.859735+0000", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9979999999999998e-06 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.859816+0000", 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0791000000000006e-05 2024-04-22T19:57:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.860013+0000", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019706199999999999 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.860200+0000", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018696300000000001 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.869498+0000", 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092975409999999994 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.883773+0000", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014275138999999999 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.883834+0000", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1558999999999998e-05 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.883872+0000", 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7712000000000001e-05 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:4216 3.12 3:494fc4b4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:39.264990+0000", 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.35398600699999999, 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025750208, 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4216 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.264990+0000", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.264990+0000", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.264993+0000", 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3909999999999998e-06 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.266743+0000", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017504689999999999 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.266774+0000", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0133000000000001e-05 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.266787+0000", 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3838e-05 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.266881+0000", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3901999999999996e-05 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.267072+0000", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190831 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.267235+0000", 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016270600000000001 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.274022+0000", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067868249999999998 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.290608+0000", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016586476999999999 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.290686+0000", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7776999999999998e-05 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.290740+0000", 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3859000000000001e-05 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:4233 3.12 3:4bb49246:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_474:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:39.443548+0000", 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.17542785299999999, 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027214813000000001, 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4233 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.443548+0000", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.443548+0000", 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.443551+0000", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1089999999999998e-06 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445039+0000", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014877549999999999 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445065+0000", 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6945e-05 2024-04-22T19:57:39.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445079+0000", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3131e-05 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445142+0000", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3674000000000001e-05 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445274+0000", 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013124799999999999 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.445385+0000", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111233 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.451591+0000", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062060090000000002 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.470683+0000", 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019092449000000001 2024-04-22T19:57:39.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.470729+0000", 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5488000000000002e-05 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:39.470762+0000", 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3772000000000001e-05 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:39.727 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:39.729 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-22T19:57:39.729 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:39.724+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:39.800 INFO:tasks.workunit.client.0.smithi111.stdout:quota disabled for the bucket: buck_2024_03_22_19_57_29 2024-04-22T19:57:39.801 INFO:tasks.workunit.client.0.smithi111.stdout:adding file to bucket: 2Gb. 2024-04-22T19:57:39.801 INFO:tasks.workunit.client.0.smithi111.stdout:upload file successful 2024-04-22T19:57:39.801 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:57:39.801 INFO:tasks.workunit.client.0.smithi111.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-22T19:57:39.801 INFO:tasks.workunit.client.0.smithi111.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-22T19:57:39.829 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:39.824+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:39.895 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:39.896 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:39.909 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-22T19:57:39.951 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-22T19:57:39.948+0000 7f0b7965a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25172) UID: 0 2024-04-22T19:57:40.031 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:40.028+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:40.067 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:40.067 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.080 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-22T19:57:40.097 INFO:tasks.workunit.client.0.smithi111.stdout:user qa_user deleted 2024-04-22T19:57:40.097 INFO:tasks.workunit.client.0.smithi111.stdout:bucket delete succeeded 2024-04-22T19:57:40.101 INFO:tasks.workunit.client.0.smithi111.stdout:OK 2024-04-22T19:57:40.101 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-22T19:57:40.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-22T19:57:40.132 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:40.128+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:40.155 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-22T19:57:40.156 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-22T19:57:40.187 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.187 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:40.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:40.187 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4373.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 206.83918572900001, 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028412920000000001, 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4373", 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/906104519", 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347729+0000", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347731+0000", 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6570000000000001e-06 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347741+0000", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7380000000000006e-06 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347761+0000", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9709000000000001e-05 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.347781+0000", 2024-04-22T19:57:40.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-05 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352211+0000", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044292969999999996 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.352228+0000", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7200000000000001e-05 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376003+0000", 2024-04-22T19:57:40.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023774994000000001 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:54:13.376142+0000", 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138565 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2711 3.8 3:13621148:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.153977111000003, 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020635379999999998, 2024-04-22T19:57:40.192 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2711 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032937+0000", 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.032941+0000", 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4249999999999998e-06 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034590+0000", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016493219999999999 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034617+0000", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7367000000000001e-05 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034627+0000", 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8130000000000007e-06 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034698+0000", 2024-04-22T19:57:40.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0747999999999994e-05 2024-04-22T19:57:40.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.034896+0000", 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019808 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.035090+0000", 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019395600000000001 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.041596+0000", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065056209999999996 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053466+0000", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011870041 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053521+0000", 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.554e-05 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.053573+0000", 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1467e-05 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2714 3.31 3:8fff2425:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.124359036999998, 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024560974999999999, 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2714 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062555+0000", 2024-04-22T19:57:40.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.062558+0000", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.469e-06 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064166+0000", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016086519999999999 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064192+0000", 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5829999999999998e-05 2024-04-22T19:57:40.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064203+0000", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.112e-05 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064300+0000", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6817999999999994e-05 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064432+0000", 2024-04-22T19:57:40.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131681 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.064585+0000", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000153153 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.068903+0000", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004318194 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.086976+0000", 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018072357000000001 2024-04-22T19:57:40.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087053+0000", 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7615999999999997e-05 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.087116+0000", 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3084999999999997e-05 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2785 3.8 3:131c8255:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.204 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.449410581000002, 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021038193, 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2785 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737504+0000", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.737507+0000", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8609999999999998e-06 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739887+0000", 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023801930000000001 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739907+0000", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0472999999999999e-05 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739917+0000", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4849999999999998e-06 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.739991+0000", 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4096000000000003e-05 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740181+0000", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000190595 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.740356+0000", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017416600000000001 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.748776+0000", 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084208140000000004 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758402+0000", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096257080000000002 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758481+0000", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9159000000000006e-05 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.758542+0000", 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0643000000000002e-05 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2791 3.33 e93/89 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head v 93'6, mlcod=75'4)", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.385238184000002, 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022223125, 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801676+0000", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.801678+0000", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4279999999999999e-06 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806397+0000", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047191079999999996 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806413+0000", 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6019e-05 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806423+0000", 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.815e-06 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806489+0000", 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6087999999999995e-05 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806511+0000", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2286e-05 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823847+0000", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017336154999999999 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823899+0000", 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2225999999999998e-05 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2792 3.4 3:20cf0ea2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.383285801, 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02057749, 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2792 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.214 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803629+0000", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.803632+0000", 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0510000000000001e-06 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806383+0000", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027517869999999999 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806415+0000", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1644999999999999e-05 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806425+0000", 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0443e-05 2024-04-22T19:57:40.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806484+0000", 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8557999999999997e-05 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806616+0000", 2024-04-22T19:57:40.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013203999999999999 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.806720+0000", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104109 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.823724+0000", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017004063999999999 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824086+0000", 2024-04-22T19:57:40.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036203100000000002 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824153+0000", 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6854999999999996e-05 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.824206+0000", 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2907e-05 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.219 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2819 3.8 3:137d30ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.028992299000002, 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020533365000000001, 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2819 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157922+0000", 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.157925+0000", 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.32e-06 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160741+0000", 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028155179999999999 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160788+0000", 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6780000000000003e-05 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160813+0000", 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5049e-05 2024-04-22T19:57:40.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.160995+0000", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018263399999999999 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161309+0000", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000313956 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.161568+0000", 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025827599999999999 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.169671+0000", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081033689999999992 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178301+0000", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086300609999999996 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178386+0000", 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5118999999999996e-05 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.178455+0000", 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9282999999999994e-05 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2848 3.29 e93/89 3:97a8a794:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_187:head v 93'12, mlcod=93'10)", 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.408717557999999, 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020717856, 2024-04-22T19:57:40.226 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778197+0000", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.778200+0000", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.467e-06 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785343+0000", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071423520000000002 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785385+0000", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2821999999999998e-05 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785404+0000", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785580+0000", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017512100000000001 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.785624+0000", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4159000000000002e-05 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798838+0000", 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013214066999999999 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.798915+0000", 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6908000000000003e-05 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2859 3.31 3:8df1a3fb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.281277011, 2024-04-22T19:57:40.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022181747000000002, 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2859 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905637+0000", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.905641+0000", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5540000000000002e-06 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907825+0000", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021841780000000002 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907854+0000", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8636000000000002e-05 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907866+0000", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.907972+0000", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010562 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908172+0000", 2024-04-22T19:57:40.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020041500000000001 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.908341+0000", 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168577 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.912566+0000", 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042252330000000001 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927689+0000", 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015123202000000001 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927764+0000", 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4472000000000001e-05 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.927819+0000", 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2861 3.19 3:9b000d1b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.257875693999999, 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034056910000000003, 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2861 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929039+0000", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.929042+0000", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.852e-06 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.930981+0000", 2024-04-22T19:57:40.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001939068 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931006+0000", 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5395e-05 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931016+0000", 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0069e-05 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931096+0000", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9598000000000006e-05 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931246+0000", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015064200000000001 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.931345+0000", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9223999999999997e-05 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.937009+0000", 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056634379999999998 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.962963+0000", 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025954222999999998 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963037+0000", 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3887999999999995e-05 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.963096+0000", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8513e-05 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3324 3.31 3:8ee13d9a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_253:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.959469847000001, 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021984026, 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.241 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3324 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227444+0000", 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.227449+0000", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1829999999999996e-06 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231194+0000", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037452499999999999 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231245+0000", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0936000000000002e-05 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231271+0000", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6605999999999999e-05 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231384+0000", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112958 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231542+0000", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000157248 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.231656+0000", 2024-04-22T19:57:40.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114286 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.240332+0000", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086758349999999998 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249282+0000", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089503229999999996 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249364+0000", 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1871000000000003e-05 2024-04-22T19:57:40.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.249429+0000", 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4529999999999994e-05 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3355 3.25 3:a46ca720:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.379000349000002, 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022146777999999999, 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.246 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3355 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807914+0000", 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.807919+0000", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8899999999999998e-06 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813214+0000", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052952169999999996 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813260+0000", 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5646000000000003e-05 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813280+0000", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9816000000000001e-05 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813404+0000", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012438999999999999 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813632+0000", 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022820100000000001 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.813849+0000", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216419 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.826358+0000", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012509823 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829913+0000", 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035546729999999999 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.829996+0000", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2871e-05 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.830061+0000", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4832000000000005e-05 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3360 3.32 e101/20 3:4e9e0ae3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_289:head v 101'16, mlcod=100'14)", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.296087243999999, 2024-04-22T19:57:40.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028198335000000001, 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890827+0000", 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.890830+0000", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2629999999999999e-06 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894425+0000", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035946009999999998 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894463+0000", 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8420000000000001e-05 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894480+0000", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6736999999999999e-05 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894667+0000", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186911 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.894735+0000", 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7476000000000002e-05 2024-04-22T19:57:40.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.918902+0000", 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024167477999999999 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.919025+0000", 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123449 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.255 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3383 3.31 3:8c620c97:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_312:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.033604468, 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020532287999999999, 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3383 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153310+0000", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.153313+0000", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3459999999999998e-06 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155061+0000", 2024-04-22T19:57:40.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001748108 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155093+0000", 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1902000000000001e-05 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155108+0000", 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4450999999999999e-05 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155202+0000", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4598999999999993e-05 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155388+0000", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018557099999999999 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.155566+0000", 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017860799999999999 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.163059+0000", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074921390000000001 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173733+0000", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010674141999999999 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173787+0000", 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4132000000000003e-05 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.173842+0000", 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5290000000000001e-05 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3813 3.25 3:a6cab3b3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5607206060000003, 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020933044000000001, 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3813 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626194+0000", 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.626197+0000", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.371e-06 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628121+0000", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001923789 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628142+0000", 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1251e-05 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628152+0000", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8360000000000004e-06 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628217+0000", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4548000000000006e-05 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628378+0000", 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016110500000000001 2024-04-22T19:57:40.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.628505+0000", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127081 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.642420+0000", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013914805000000001 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.646901+0000", 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044811010000000004 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.647036+0000", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135069 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.647127+0000", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1088000000000006e-05 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3825 3.8 3:11872a3d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:40.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.4303523140000003, 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020237891000000001, 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3825 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756562+0000", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.756565+0000", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6699999999999998e-06 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758932+0000", 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023673850000000001 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758962+0000", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9430000000000001e-05 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.758976+0000", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4415e-05 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759059+0000", 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3479999999999994e-05 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759207+0000", 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000147978 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.759346+0000", 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138429 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.768298+0000", 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089525239999999999 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776679+0000", 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083801799999999992 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776744+0000", 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5356000000000002e-05 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.776800+0000", 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6044000000000001e-05 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3831 3.1a e108/20 3:59880038:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_82:head v 108'15, mlcod=102'13)", 2024-04-22T19:57:40.273 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.3562866690000002, 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021972061000000001, 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830628+0000", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.830630+0000", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1799999999999999e-06 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835032+0000", 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044018870000000002 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835065+0000", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3701000000000001e-05 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835080+0000", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4999e-05 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835175+0000", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4129000000000006e-05 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.835204+0000", 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9862999999999999e-05 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.852537+0000", 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017332500000000001 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.852600+0000", 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2801999999999999e-05 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3854 3.4 3:235fa5bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1107959919999999, 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021805609, 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3854 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076118+0000", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.076122+0000", 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8449999999999996e-06 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077874+0000", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001751739 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077897+0000", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3030000000000001e-05 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077909+0000", 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2289e-05 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077992+0000", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2971000000000002e-05 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078166+0000", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017426799999999999 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.078327+0000", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016065400000000001 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.089937+0000", 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011609974 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097802+0000", 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078649089999999998 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097873+0000", 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0845000000000004e-05 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.097924+0000", 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1085000000000003e-05 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3922 3.19 3:9aba0e66:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.836344+0000", 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.350570147, 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020449846000000001, 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3922 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.836344+0000", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.836344+0000", 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.836347+0000", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6520000000000002e-06 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838402+0000", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020549019999999999 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838426+0000", 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4683999999999999e-05 2024-04-22T19:57:40.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838436+0000", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5349999999999993e-06 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838510+0000", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4513999999999998e-05 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838664+0000", 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015396299999999999 2024-04-22T19:57:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.838769+0000", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104368 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.850706+0000", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011937592 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.856666+0000", 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059598020000000002 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.856737+0000", 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0994999999999994e-05 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.856794+0000", 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6839000000000002e-05 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:4010 3.19 3:9aca0074:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_261:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:36.735583+0000", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.4513315370000002, 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021180572000000002, 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4010 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.735583+0000", 2024-04-22T19:57:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.735583+0000", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.735586+0000", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8959999999999999e-06 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737303+0000", 2024-04-22T19:57:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001717512 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737332+0000", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9274000000000001e-05 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737347+0000", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4174e-05 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737459+0000", 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112533 2024-04-22T19:57:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737657+0000", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019811199999999999 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.737818+0000", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016102 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.745617+0000", 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077986679999999999 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.756643+0000", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011026340000000001 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.756712+0000", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8666999999999998e-05 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.756763+0000", 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1375999999999997e-05 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.294 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.294 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-22T19:57:40.296 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-22T19:57:40.292+0000 7fbd2d5c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25170) UID: 0 2024-04-22T19:57:40.396 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:40.392+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:40.411 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:40.411 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:40.411 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.424 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-22T19:57:40.497 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-22T19:57:40.496+0000 7fc584816640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25252) UID: 0 2024-04-22T19:57:40.536 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.537 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:40.537 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:40.537 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:40.537 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-22T19:57:40.576 DEBUG:teuthology.parallel:result is None 2024-04-22T19:57:40.576 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T19:57:40.598 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-22T19:57:40.596+0000 7f4a803e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25254) UID: 0 2024-04-22T19:57:40.629 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T19:57:40.629 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2228 3.2e 3:772e0ceb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.221601331000002, 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019336836, 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2228 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441433+0000", 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.441436+0000", 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2179999999999999e-06 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443829+0000", 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023927380000000002 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443860+0000", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1241000000000001e-05 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443876+0000", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.443955+0000", 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8689999999999994e-05 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444094+0000", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013966299999999999 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.444186+0000", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2011999999999999e-05 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.450092+0000", 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005905932 2024-04-22T19:57:40.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460648+0000", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010555501 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460712+0000", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4084999999999994e-05 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.460770+0000", 2024-04-22T19:57:40.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7837999999999997e-05 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2237 3.2f 3:f7642786:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.118324733999998, 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020656816000000001, 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.671 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2237 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544709+0000", 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.544712+0000", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0469999999999998e-06 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546626+0000", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019132719999999999 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546646+0000", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0517e-05 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546656+0000", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5729999999999997e-06 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546727+0000", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1525000000000004e-05 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546847+0000", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.546946+0000", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8659000000000005e-05 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.555083+0000", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081376190000000004 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565252+0000", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010168183000000001 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565314+0000", 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1983000000000006e-05 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.565366+0000", 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2667999999999998e-05 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2332 3.37 3:ef035359:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:40.677 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.120225032999997, 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025275902999999999, 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2332 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542809+0000", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.542812+0000", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7149999999999998e-06 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544524+0000", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001712196 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544547+0000", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544559+0000", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-05 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544639+0000", 2024-04-22T19:57:40.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9789000000000005e-05 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544649+0000", 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0363999999999999e-05 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549374+0000", 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047248610000000003 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549549+0000", 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017511299999999999 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.549708+0000", 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015878600000000001 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.556009+0000", 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063005559999999997 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568010+0000", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012001011000000001 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568052+0000", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1993000000000003e-05 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.568085+0000", 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.324e-05 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.683 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2374 3.2f 3:f76e7742:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.680119439999999, 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020749166999999999, 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2374 2024-04-22T19:57:40.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982915+0000", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.982917+0000", 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6029999999999999e-06 2024-04-22T19:57:40.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985726+0000", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028085369999999998 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985752+0000", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6562000000000001e-05 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985766+0000", 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.402e-05 2024-04-22T19:57:40.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985841+0000", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4757000000000003e-05 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.985980+0000", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013897200000000001 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.986100+0000", 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119638 2024-04-22T19:57:40.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.991285+0000", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051850810000000002 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003566+0000", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012281475 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003628+0000", 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1470000000000006e-05 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.003664+0000", 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6052e-05 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2394 3.2e 3:775b6d5c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.387593010000003, 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021188186000000001, 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2394 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.690 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275441+0000", 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.275444+0000", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6730000000000001e-06 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278367+0000", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029235070000000001 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278414+0000", 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7113000000000001e-05 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278433+0000", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8567999999999999e-05 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278573+0000", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013991200000000001 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.278885+0000", 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000312152 2024-04-22T19:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.279162+0000", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276576 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.288210+0000", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090483739999999997 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296404+0000", 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081942620000000008 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296496+0000", 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1791000000000003e-05 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.296629+0000", 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133258 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2406 3.27 3:e5e7c6f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.157182954999996, 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020371305999999999, 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2406 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:40.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505851+0000", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.505856+0000", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7840000000000003e-06 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508344+0000", 2024-04-22T19:57:40.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024884909999999998 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508402+0000", 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7198999999999999e-05 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508432+0000", 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9879999999999999e-05 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.508662+0000", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000230289 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509048+0000", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038661000000000001 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.509392+0000", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000343331 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.522143+0000", 2024-04-22T19:57:40.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012751518 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.525965+0000", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038216119999999998 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526090+0000", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012518499999999999 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.526222+0000", 2024-04-22T19:57:40.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013240699999999999 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2698 3.2f 3:f41a50d2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.766983570000001, 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021500624999999999, 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2698 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896051+0000", 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.896054+0000", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4070000000000002e-06 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897731+0000", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001677373 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897757+0000", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5320000000000002e-05 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897767+0000", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0601000000000001e-05 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897831+0000", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3792000000000002e-05 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.897974+0000", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014317799999999999 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.898075+0000", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010082900000000001 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.904482+0000", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064069060000000004 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917373+0000", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012891316999999999 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917470+0000", 2024-04-22T19:57:40.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6773000000000003e-05 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:47.917551+0000", 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1129000000000002e-05 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2793 3.2f 3:f78624fc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:40.706 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.844202867999996, 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020778125000000001, 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.707 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2793 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818831+0000", 2024-04-22T19:57:40.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.818834+0000", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6299999999999998e-06 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820707+0000", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001873612 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820737+0000", 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9379000000000001e-05 2024-04-22T19:57:40.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820749+0000", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2045000000000001e-05 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820826+0000", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7217000000000003e-05 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.820939+0000", 2024-04-22T19:57:40.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001132 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.821048+0000", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000108346 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.826602+0000", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055548079999999996 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839518+0000", 2024-04-22T19:57:40.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012915908 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839559+0000", 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0311000000000001e-05 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:48.839609+0000", 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0668999999999999e-05 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2821 3.3d e93/20 3:bc1001e4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_160:head v 93'4, mlcod=92'2)", 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.451486574, 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020536564, 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211548+0000", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.211550+0000", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8729999999999999e-06 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215215+0000", 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036646729999999998 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215253+0000", 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7438999999999998e-05 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215270+0000", 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7552999999999999e-05 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215405+0000", 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000134492 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.215444+0000", 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9523000000000001e-05 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.231920+0000", 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016475447000000001 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:49.232084+0000", 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016456399999999999 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3286 3.21 3:87ffc809:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.039915378, 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019563710000000002, 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3286 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623119+0000", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.623122+0000", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5140000000000002e-06 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625595+0000", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002472864 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625621+0000", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6199000000000001e-05 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625632+0000", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0229e-05 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625696+0000", 2024-04-22T19:57:40.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3997000000000004e-05 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.625703+0000", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5680000000000002e-06 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.628940+0000", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032365340000000001 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629200+0000", 2024-04-22T19:57:40.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025989999999999997 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.629474+0000", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000274524 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642151+0000", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012676979999999999 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642613+0000", 2024-04-22T19:57:40.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000461552 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642651+0000", 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8677000000000003e-05 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.642682+0000", 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1171999999999999e-05 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3305 3.3b e101/20 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head v 101'13, mlcod=100'11)", 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.792676440000001, 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024596092999999999, 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870358+0000", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.870360+0000", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5689999999999999e-06 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878492+0000", 2024-04-22T19:57:40.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081312869999999992 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878539+0000", 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6984999999999998e-05 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878562+0000", 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3093999999999999e-05 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878680+0000", 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118836 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.878708+0000", 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7385999999999998e-05 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894800+0000", 2024-04-22T19:57:40.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016092008000000001 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:11.894954+0000", 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015392800000000001 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3315 3.2f 3:f537b68d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:40.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.611092769999999, 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019250771, 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3315 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051941+0000", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.051944+0000", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9040000000000001e-06 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055166+0000", 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032220500000000002 2024-04-22T19:57:40.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055208+0000", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1786999999999998e-05 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055228+0000", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055356+0000", 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012841999999999999 2024-04-22T19:57:40.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055679+0000", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032306700000000002 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.055982+0000", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000303014 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.067690+0000", 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011707917 2024-04-22T19:57:40.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.070905+0000", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032146330000000002 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071068+0000", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000163041 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:12.071192+0000", 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124146 2024-04-22T19:57:40.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3370 3.21 3:866d6ca8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_299:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.650318784, 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019362226, 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3370 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012715+0000", 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.012719+0000", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.49e-06 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015600+0000", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028813810000000001 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015637+0000", 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6324e-05 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015653+0000", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6096999999999999e-05 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015771+0000", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011813500000000001 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.015978+0000", 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020772799999999999 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.016172+0000", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019356000000000001 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.029314+0000", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013141774 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.031975+0000", 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026608309999999998 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032022+0000", 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7580999999999997e-05 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:13.032078+0000", 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325000000000003e-05 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3812 3.3b e108/20 3:dc89476b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_63:head v 108'21, mlcod=101'19)", 2024-04-22T19:57:40.740 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.0398487249999997, 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020873282, 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623185+0000", 2024-04-22T19:57:40.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.623187+0000", 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.635e-06 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627477+0000", 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042899130000000002 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627512+0000", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4881e-05 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627527+0000", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5464e-05 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627658+0000", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013029400000000001 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.627689+0000", 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0984e-05 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.643998+0000", 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016309636999999998 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.644059+0000", 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0473999999999997e-05 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3822 3.2f 3:f4f6347d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.9417176600000001, 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023717291000000001, 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3822 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721316+0000", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.721319+0000", 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6649999999999999e-06 2024-04-22T19:57:40.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723264+0000", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001945174 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723288+0000", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3703999999999999e-05 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723299+0000", 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0784e-05 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723380+0000", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1168999999999995e-05 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723568+0000", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188235 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.723673+0000", 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000104743 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.731285+0000", 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076124390000000004 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.744914+0000", 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013628144999999999 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.744984+0000", 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0641000000000003e-05 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:34.745034+0000", 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9592000000000002e-05 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.750 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3847 3.2f 3:f4be1876:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.6529399829999996, 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020204878999999999, 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3847 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.751 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010094+0000", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.010097+0000", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0170000000000001e-06 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012017+0000", 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019202749999999999 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012049+0000", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1390000000000003e-05 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012063+0000", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4233000000000001e-05 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012137+0000", 2024-04-22T19:57:40.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3540000000000004e-05 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012265+0000", 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000128064 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.012386+0000", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121457 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.023337+0000", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010950797999999999 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030168+0000", 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068313380000000002 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030247+0000", 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8588e-05 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.030299+0000", 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2179000000000003e-05 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:3853 3.2d e108/20 3:b54725bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_104:head v 108'18, mlcod=101'16)", 2024-04-22T19:57:40.757 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5907444349999995, 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021241927000000001, 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072290+0000", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.072291+0000", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0979999999999999e-06 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077032+0000", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047411500000000004 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077064+0000", 2024-04-22T19:57:40.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2527000000000002e-05 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077081+0000", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6252e-05 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077171+0000", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0481000000000003e-05 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.077190+0000", 2024-04-22T19:57:40.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9029999999999999e-05 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.093471+0000", 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016280913000000001 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:35.093532+0000", 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0476000000000002e-05 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3981 3.2f 3:f70705c9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:36.438154+0000", 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2248801089999999, 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024655518000000001, 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3981 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.762 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.438154+0000", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.438154+0000", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.438157+0000", 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4640000000000002e-06 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.439783+0000", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001625261 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.439812+0000", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9725000000000001e-05 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.439827+0000", 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4980999999999999e-05 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.439925+0000", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.713e-05 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.440103+0000", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017890199999999999 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.440266+0000", 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016241199999999999 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.446097+0000", 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058314109999999999 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.462689+0000", 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016592137 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.462755+0000", 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5382000000000005e-05 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.462810+0000", 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4713000000000003e-05 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:3995 3.2e 3:754d1fca:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:36.577280+0000", 2024-04-22T19:57:40.768 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0857542980000003, 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023993857, 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 3995 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.577280+0000", 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.577280+0000", 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.577283+0000", 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7839999999999999e-06 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.578621+0000", 2024-04-22T19:57:40.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013386310000000001 2024-04-22T19:57:40.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.578653+0000", 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1704e-05 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.578667+0000", 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4031e-05 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.578740+0000", 2024-04-22T19:57:40.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2848000000000005e-05 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.578893+0000", 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015367500000000001 2024-04-22T19:57:40.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.579025+0000", 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013195000000000001 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.587844+0000", 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088187820000000007 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.601194+0000", 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013349709 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.601236+0000", 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2539e-05 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.601274+0000", 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7203999999999998e-05 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:4009 3.21 3:856eb474:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_260:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:57:36.725301+0000", 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.937733089, 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02007681, 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4009 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:40.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.725301+0000", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.725301+0000", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.725304+0000", 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.456e-06 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727226+0000", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001921461 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727253+0000", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7036999999999999e-05 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727266+0000", 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2712e-05 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727342+0000", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6341999999999995e-05 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727510+0000", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016834099999999999 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.727630+0000", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011954 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:40.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.742085+0000", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014454915 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.745246+0000", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00316088 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.745322+0000", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5859000000000007e-05 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:40.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:57:36.745378+0000", 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6267000000000002e-05 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:40.781 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-22T19:57:40.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-22T19:57:40.784 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-22T19:57:40.780+0000 7f1b1bf12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25248) UID: 0 2024-04-22T19:57:40.793 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T19:57:40.793 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-22T19:57:40.803 INFO:tasks.thrashosds:joining thrashosds 2024-04-22T19:57:40.953 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-22T19:57:40.953 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:40.968 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-22T19:57:41.080 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:41.080 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-22T19:57:41.080 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-22T19:57:41.080 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-22T19:57:41.080 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:41.093 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2235 3.7 3:e30cb851:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.677180101999994, 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194794, 2024-04-22T19:57:41.205 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2235 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525055+0000", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.525058+0000", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.903e-06 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526232+0000", 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001174006 2024-04-22T19:57:41.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526259+0000", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7044000000000001e-05 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526273+0000", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3671e-05 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526359+0000", 2024-04-22T19:57:41.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6098000000000001e-05 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526556+0000", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019661200000000001 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.526736+0000", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017997799999999999 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.532861+0000", 2024-04-22T19:57:41.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061254819999999998 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543151+0000", 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010289678999999999 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543201+0000", 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0288999999999999e-05 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.543250+0000", 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9032000000000001e-05 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2248 3.2 3:417767ff:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.541381723000001, 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023873401999999998, 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.211 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2248 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660854+0000", 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.660856+0000", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2809999999999998e-06 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662936+0000", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020802099999999999 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662962+0000", 2024-04-22T19:57:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5528e-05 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.662976+0000", 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.485e-05 2024-04-22T19:57:41.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663055+0000", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8702000000000006e-05 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663196+0000", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014039099999999999 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.663337+0000", 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141674 2024-04-22T19:57:41.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.671347+0000", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080094229999999999 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684604+0000", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013257181999999999 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684672+0000", 2024-04-22T19:57:41.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7970000000000001e-05 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.684727+0000", 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5191000000000001e-05 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2268 3.29 3:96140eb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.338663944999993, 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016833154999999999, 2024-04-22T19:57:41.217 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2268 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863571+0000", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.863574+0000", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5220000000000002e-06 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865257+0000", 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016827120000000001 2024-04-22T19:57:41.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865289+0000", 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2257e-05 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865305+0000", 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5733e-05 2024-04-22T19:57:41.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865402+0000", 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865559+0000", 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015674999999999999 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.865702+0000", 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014331599999999999 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.871874+0000", 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006171335 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880301+0000", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084277359999999999 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880347+0000", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5689000000000003e-05 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:10.880405+0000", 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7568999999999997e-05 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.223 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2293 3.1e 3:7ab4a27d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.077348040999993, 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017244908, 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2293 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124887+0000", 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.124890+0000", 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7269999999999999e-06 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126254+0000", 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001363476 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126285+0000", 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1025999999999997e-05 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126298+0000", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3824e-05 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126382+0000", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3665999999999995e-05 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126518+0000", 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013594099999999999 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.126606+0000", 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8418999999999995e-05 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.132577+0000", 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059706969999999996 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.141957+0000", 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093797099999999994 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142047+0000", 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0488000000000005e-05 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.142132+0000", 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4933999999999997e-05 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2298 3.24 3:27fcaacb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.018201797000003, 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016980830999999998, 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.230 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2298 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184034+0000", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.184036+0000", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7180000000000001e-06 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185815+0000", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001778586 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185843+0000", 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8521e-05 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185858+0000", 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4121000000000001e-05 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.185931+0000", 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3215999999999998e-05 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186055+0000", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012417600000000001 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.186160+0000", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105492 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.192124+0000", 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059636029999999996 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200912+0000", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087882440000000006 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.200968+0000", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5479999999999997e-05 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.201014+0000", 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6674000000000001e-05 2024-04-22T19:57:41.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2308 3.38 3:1d0b667d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.918842914999999, 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018039294000000001, 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2308 2024-04-22T19:57:41.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283392+0000", 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.283395+0000", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.892e-06 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284967+0000", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015720020000000001 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.284991+0000", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4091e-05 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285002+0000", 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105999999999999e-05 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285095+0000", 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3068999999999999e-05 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285289+0000", 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019396499999999999 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.285422+0000", 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013340499999999999 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.290252+0000", 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048295889999999996 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301243+0000", 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010991327 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301354+0000", 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011152199999999999 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.301432+0000", 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7325999999999998e-05 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2321 3.3c e75/20 3:3ebe1abd:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_130:head v 75'1, mlcod=0'0)", 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.774999248, 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017681756, 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427236+0000", 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.427238+0000", 2024-04-22T19:57:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8500000000000001e-06 2024-04-22T19:57:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431346+0000", 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041077479999999996 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431373+0000", 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7390999999999999e-05 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431386+0000", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3268000000000001e-05 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431456+0000", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9627000000000003e-05 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.431475+0000", 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8858000000000001e-05 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444829+0000", 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013354184 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.444918+0000", 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8830000000000002e-05 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2326 3.2 3:424b5e8e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.248 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.726157997000001, 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436363, 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2326 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476077+0000", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.476081+0000", 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.517e-06 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478047+0000", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019661290000000001 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478075+0000", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8191000000000002e-05 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478088+0000", 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2510999999999999e-05 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478176+0000", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8746999999999996e-05 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478329+0000", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015219100000000001 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.478510+0000", 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181323 2024-04-22T19:57:41.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.484984+0000", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064743830000000002 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493424+0000", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084396709999999993 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493462+0000", 2024-04-22T19:57:41.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8151000000000001e-05 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.493514+0000", 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1548999999999997e-05 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2331 3.1e 3:78343787:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.668424529999996, 2024-04-22T19:57:41.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016501657999999999, 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2331 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533811+0000", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.533814+0000", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0970000000000002e-06 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536502+0000", 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026878990000000001 2024-04-22T19:57:41.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536533+0000", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1411999999999997e-05 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536547+0000", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3604000000000001e-05 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536619+0000", 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2297000000000003e-05 2024-04-22T19:57:41.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536763+0000", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014344 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.536855+0000", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1954999999999996e-05 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.544456+0000", 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076018539999999999 2024-04-22T19:57:41.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550182+0000", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005725923 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550254+0000", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1365000000000005e-05 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.550312+0000", 2024-04-22T19:57:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8811999999999999e-05 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2340 3.29 3:9781546d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.576782621999996, 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016693205999999999, 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.260 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2340 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625453+0000", 2024-04-22T19:57:41.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.625455+0000", 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1689999999999999e-06 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627138+0000", 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016829690000000001 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627165+0000", 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6784e-05 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627178+0000", 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3708e-05 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627270+0000", 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1508999999999994e-05 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627467+0000", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019721300000000001 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.627624+0000", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015702899999999999 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.634383+0000", 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006758918 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642071+0000", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076877930000000001 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642111+0000", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0392999999999998e-05 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:11.642146+0000", 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4721000000000002e-05 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.265 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2378 3.38 3:1eec4aab:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.178876101, 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021293829, 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2378 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023359+0000", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.023363+0000", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.393e-06 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026264+0000", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029012869999999998 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026288+0000", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4138000000000002e-05 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026298+0000", 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0097e-05 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026386+0000", 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7792000000000002e-05 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026590+0000", 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020403700000000001 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.026772+0000", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000181657 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.032226+0000", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00545408 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044578+0000", 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012351825 2024-04-22T19:57:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044618+0000", 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0064999999999997e-05 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.044653+0000", 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5457999999999998e-05 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2382 3.24 3:2673b415:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.128183852999996, 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015953426999999999, 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2382 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074051+0000", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.074055+0000", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-06 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077170+0000", 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003115062 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077196+0000", 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6356e-05 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077210+0000", 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3881e-05 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077364+0000", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015419199999999999 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077730+0000", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036570800000000002 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.077960+0000", 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023052700000000001 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.086343+0000", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083829920000000006 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089937+0000", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035937790000000001 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.089973+0000", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5806999999999998e-05 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.090005+0000", 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2023000000000002e-05 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2397 3.29 3:978b22ec:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.858612097000005, 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01764402, 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2397 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343623+0000", 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.343627+0000", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346539+0000", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029122330000000002 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346578+0000", 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8482999999999997e-05 2024-04-22T19:57:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346597+0000", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9123e-05 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346725+0000", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012815600000000001 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.346946+0000", 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000220709 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.347147+0000", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201137 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.356205+0000", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090584099999999994 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361038+0000", 2024-04-22T19:57:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048323730000000001 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361167+0000", 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012922500000000001 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.361267+0000", 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010029100000000001 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2402 3.18 3:1a43d6d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.774974342999997, 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018095706999999999, 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2402 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427261+0000", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.427263+0000", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432441+0000", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051774569999999999 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432490+0000", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8983000000000002e-05 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432508+0000", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8703e-05 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432650+0000", 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014156499999999999 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.432885+0000", 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023528700000000001 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.433096+0000", 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021092699999999999 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.444198+0000", 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011101644000000001 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445126+0000", 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00092808300000000001 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445239+0000", 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113411 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.445357+0000", 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000117521 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2404 3.18 3:18267d48:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.738432274999994, 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017026887000000001, 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2404 2024-04-22T19:57:41.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463803+0000", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.463807+0000", 2024-04-22T19:57:41.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0640000000000004e-06 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466654+0000", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028473330000000001 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466711+0000", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6452000000000001e-05 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466731+0000", 2024-04-22T19:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0322999999999998e-05 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.466894+0000", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016258700000000001 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467282+0000", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038858700000000003 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.467667+0000", 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00038485700000000001 2024-04-22T19:57:41.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.479454+0000", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01178702 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480664+0000", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012097900000000001 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480758+0000", 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4112999999999998e-05 2024-04-22T19:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.480830+0000", 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1761000000000006e-05 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2407 3.38 3:1e219a1e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.673394146000007, 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018540138000000001, 2024-04-22T19:57:41.295 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2407 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528841+0000", 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.528845+0000", 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5559999999999999e-06 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532402+0000", 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035575559999999999 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532448+0000", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5948999999999997e-05 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532467+0000", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8887000000000001e-05 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532610+0000", 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000143046 2024-04-22T19:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.532827+0000", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021642100000000001 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.533001+0000", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017414199999999999 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.540400+0000", 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073988939999999996 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547241+0000", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068410839999999999 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547318+0000", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7019000000000002e-05 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.547381+0000", 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3584000000000007e-05 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2408 3.b 3:d09f2639:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.655658141000004, 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018044134999999999, 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.301 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2408 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546577+0000", 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.546582+0000", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5700000000000003e-06 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549161+0000", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025790600000000002 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549297+0000", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135678 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549323+0000", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6628999999999999e-05 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549521+0000", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019741100000000001 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549712+0000", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000191041 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.549877+0000", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016516 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.557997+0000", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081206490000000006 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564535+0000", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065372429999999999 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564584+0000", 2024-04-22T19:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9212999999999998e-05 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.564621+0000", 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7481000000000002e-05 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4473.0:2420 3.22 e77/20 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head v 77'8, mlcod=75'6)", 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.488826427000006, 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017907421, 2024-04-22T19:57:41.306 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713409+0000", 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.713414+0000", 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0679999999999996e-06 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718924+0000", 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055102980000000003 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718952+0000", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7949e-05 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718967+0000", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5244e-05 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719068+0000", 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010023500000000001 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.719108+0000", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9861999999999999e-05 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731266+0000", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012158175 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731316+0000", 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0590000000000002e-05 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2422 3.24 3:25999489:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.483629176999997, 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017877008999999999, 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2422 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718606+0000", 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.718610+0000", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.284e-06 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720825+0000", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002214415 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720854+0000", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9173e-05 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720871+0000", 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7059999999999999e-05 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.720946+0000", 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4957999999999996e-05 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721059+0000", 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112728 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.721172+0000", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011292499999999999 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.731951+0000", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01077944 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736360+0000", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044085629999999999 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736424+0000", 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4344999999999995e-05 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.736483+0000", 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9117999999999999e-05 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4473.0:2425 3.1e 3:7a7284d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.445381666000003, 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016620315, 2024-04-22T19:57:41.316 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4473", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 2425 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-22T19:57:41.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756854+0000", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.756857+0000", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6940000000000001e-06 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758800+0000", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019421830000000001 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-22T19:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758825+0000", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5371000000000002e-05 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758839+0000", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.758954+0000", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011458799999999999 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-22T19:57:41.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759231+0000", 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000276734 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.759440+0000", 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020932599999999999 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.766802+0000", 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073622890000000002 2024-04-22T19:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773312+0000", 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006509501 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773409+0000", 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7409000000000002e-05 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-22T19:57:41.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-22T19:56:12.773474+0000", 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4968999999999994e-05 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-22T19:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:57:41.323 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-22T19:57:41.456 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:41.457 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:41.457 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:41.457 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:41.471 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-22T19:57:41.588 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:41.588 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:41.588 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:41.588 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:41.588 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:41.602 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-22T19:57:41.696 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is set 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1325 3.34 3:2d793388:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.2__shadow_.8MLfH25aSoSa-Q76YC8CEsTekC6JQK7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.46514719300001, 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027482671, 2024-04-22T19:57:41.733 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1325 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265106+0000", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.265109+0000", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5129999999999999e-06 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270183+0000", 2024-04-22T19:57:41.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050744780000000003 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270225+0000", 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2329000000000001e-05 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270245+0000", 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.969e-05 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270384+0000", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013897700000000001 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.270758+0000", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037384700000000001 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.271143+0000", 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038540200000000002 2024-04-22T19:57:41.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.288014+0000", 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016870904999999999 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292281+0000", 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042667629999999998 2024-04-22T19:57:41.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292444+0000", 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162714 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:58.292589+0000", 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000145053 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2244 3.14 3:2be3729d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.107068011999999, 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031480415999999997, 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2244 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623185+0000", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.623189+0000", 2024-04-22T19:57:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3500000000000001e-06 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629819+0000", 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066307960000000004 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629857+0000", 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.629878+0000", 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.092e-05 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630078+0000", 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020002999999999999 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630514+0000", 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043536300000000003 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.630917+0000", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040317400000000001 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.653529+0000", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022611617000000001 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654382+0000", 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085389500000000002 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654545+0000", 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016294399999999999 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.654666+0000", 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120221 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2682 3.15 e92/89 3:a9094df8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_31:head v 92'8, mlcod=77'6)", 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.006923733000001, 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031839320999999997, 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723329+0000", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.723332+0000", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4040000000000002e-06 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727108+0000", 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003776101 2024-04-22T19:57:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727152+0000", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3853000000000002e-05 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727176+0000", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4375999999999998e-05 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727314+0000", 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001373 2024-04-22T19:57:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727369+0000", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5429000000000001e-05 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.754987+0000", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027617561999999998 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755169+0000", 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182296 2024-04-22T19:57:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2683 3.1c e92/20 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head v 92'9, mlcod=77'7)", 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.996411887000001, 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042764414000000001, 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733841+0000", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733845+0000", 2024-04-22T19:57:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.54e-06 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738419+0000", 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004573672 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738451+0000", 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2351999999999998e-05 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738472+0000", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1290000000000001e-05 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738861+0000", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038872499999999998 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.738931+0000", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0401999999999994e-05 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776388+0000", 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.037456697999999997 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776606+0000", 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021773499999999999 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2684 3.2c e92/20 3:3779f477:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_33:head v 92'7, mlcod=75'5)", 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.980943367999998, 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032945639999999998, 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749310+0000", 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.749312+0000", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.553e-06 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755415+0000", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061026170000000003 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755448+0000", 2024-04-22T19:57:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3195999999999999e-05 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.755470+0000", 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1302999999999999e-05 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757104+0000", 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016341859999999999 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.757158+0000", 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4008999999999997e-05 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782135+0000", 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024977428999999999 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.782255+0000", 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120347 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2687 3.1d e93/20 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head v 93'3, mlcod=75'1)", 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.946333981999999, 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028276740000000002, 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783919+0000", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783921+0000", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.623e-06 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787256+0000", 2024-04-22T19:57:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033348739999999998 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787293+0000", 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6933e-05 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787307+0000", 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4611e-05 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787412+0000", 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010505099999999999 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.787451+0000", 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8930999999999997e-05 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812092+0000", 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024640704999999999 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812196+0000", 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010401200000000001 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2789 3.a e93/20 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head v 93'7, mlcod=76'5)", 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.947992655, 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031890114999999997, 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782261+0000", 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782263+0000", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4260000000000002e-06 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789623+0000", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073601609999999996 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789648+0000", 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5085000000000001e-05 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789665+0000", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7062e-05 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789780+0000", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114287 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789821+0000", 2024-04-22T19:57:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1609000000000001e-05 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814068+0000", 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02424728 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814151+0000", 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2205000000000003e-05 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2794 3.24 3:27b96e01:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.901562601999998, 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029467394000000001, 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2794 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828691+0000", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.828694+0000", 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0759999999999999e-06 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835121+0000", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064273400000000001 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835164+0000", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2876000000000001e-05 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835183+0000", 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9259e-05 2024-04-22T19:57:41.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835387+0000", 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020336700000000001 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.835709+0000", 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032233700000000001 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.836065+0000", 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035655700000000002 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.846931+0000", 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010865649999999999 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858029+0000", 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011097721 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858102+0000", 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2970000000000001e-05 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.858158+0000", 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6240999999999999e-05 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2866 3.24 3:254b206f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:41.773 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.743765486000001, 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028710040999999999, 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2866 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986488+0000", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.986496+0000", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5490000000000006e-06 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990351+0000", 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038546040000000002 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990378+0000", 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7152999999999999e-05 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990389+0000", 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0533000000000001e-05 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990471+0000", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2395e-05 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990613+0000", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142115 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.990730+0000", 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116711 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.998090+0000", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073602399999999997 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015088+0000", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016997844000000002 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015143+0000", 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4792e-05 2024-04-22T19:57:41.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:50.015198+0000", 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105000000000002e-05 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3363 3.14 3:2afd8c43:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.921089+0000", 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.809164357, 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029726096, 2024-04-22T19:57:41.779 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3363 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.921089+0000", 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.921089+0000", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.921092+0000", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5470000000000001e-06 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.926877+0000", 2024-04-22T19:57:41.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057842370000000002 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.926935+0000", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8662999999999997e-05 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.926955+0000", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9636e-05 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.927141+0000", 2024-04-22T19:57:41.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186391 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.927537+0000", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039578699999999998 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.927950+0000", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041281899999999998 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.940203+0000", 2024-04-22T19:57:41.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012252732000000001 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.950483+0000", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280291 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.950683+0000", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020024800000000001 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.950815+0000", 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013174500000000001 2024-04-22T19:57:41.784 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3820 3.24 3:25f31dac:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.699733+0000", 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.0305205930000003, 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026563440000000001, 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.785 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3820 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.699733+0000", 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.699733+0000", 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.699736+0000", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.737e-06 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705279+0000", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055425370000000002 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705311+0000", 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2407999999999999e-05 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705335+0000", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3547999999999999e-05 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705467+0000", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132626 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705718+0000", 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025085500000000002 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.705968+0000", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024996099999999999 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.715173+0000", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092050069999999994 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.726141+0000", 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010968024999999999 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.726231+0000", 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0076999999999998e-05 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.726296+0000", 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4659000000000006e-05 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.790 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3831 3.1a 3:59880038:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.824185+0000", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.9060682360000003, 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029045356000000001, 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3831 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.824185+0000", 2024-04-22T19:57:41.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.824185+0000", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.824190+0000", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7389999999999999e-06 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.829853+0000", 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056634540000000001 2024-04-22T19:57:41.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.829889+0000", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5679999999999997e-05 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.829908+0000", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8695999999999999e-05 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.830043+0000", 2024-04-22T19:57:41.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013512299999999999 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.830311+0000", 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026808799999999999 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.830546+0000", 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235128 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.841397+0000", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010851464 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.853059+0000", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011662135000000001 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.853158+0000", 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8393999999999993e-05 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.853230+0000", 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2454999999999997e-05 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3844 3.14 3:2ba690e1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.975287+0000", 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.7549664729999996, 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034770344000000002, 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3844 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.975287+0000", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.975287+0000", 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.975289+0000", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3870000000000002e-06 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.985009+0000", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097198900000000001 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.985041+0000", 2024-04-22T19:57:41.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1804999999999998e-05 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.985056+0000", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4934e-05 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.985215+0000", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015941499999999999 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.985633+0000", 2024-04-22T19:57:41.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041759399999999997 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.986030+0000", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000397623 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.999276+0000", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013245471 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.009759+0000", 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010483515000000001 2024-04-22T19:57:41.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.009932+0000", 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172888 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.010057+0000", 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012482199999999999 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.801 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:3927 3.11 e109/20 3:8a9627ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_178:head v 109'12, mlcod=101'10)", 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.897561+0000", 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8326927099999999, 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030112116000000001, 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.897561+0000", 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.897561+0000", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.897563+0000", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5179999999999999e-06 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.904520+0000", 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069568379999999999 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.904550+0000", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0043e-05 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.904565+0000", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5029e-05 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.904745+0000", 2024-04-22T19:57:41.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017963000000000001 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.904805+0000", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0232999999999997e-05 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.927600+0000", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022795040999999999 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.927673+0000", 2024-04-22T19:57:41.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2784e-05 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3928 3.29 3:95319d1d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.899202+0000", 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8310516159999999, 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.038734862000000002, 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3928 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.899202+0000", 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.899202+0000", 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.899205+0000", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8800000000000001e-06 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.905962+0000", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006756616 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.906034+0000", 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1785999999999993e-05 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.906079+0000", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5544999999999998e-05 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.906247+0000", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016713200000000001 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.906462+0000", 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215066 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.906669+0000", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020739900000000001 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.927659+0000", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020989476999999999 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.937708+0000", 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010049017 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.937848+0000", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000140731 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.937936+0000", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8213000000000004e-05 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3929 3.14 3:2b0ad6e7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.908470+0000", 2024-04-22T19:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.8217828730000001, 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029765436999999999, 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3929 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.908470+0000", 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.908470+0000", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.908473+0000", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8770000000000002e-06 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.914917+0000", 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064437990000000001 2024-04-22T19:57:41.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.914947+0000", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0419000000000001e-05 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.914964+0000", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6184e-05 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.915118+0000", 2024-04-22T19:57:41.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015449300000000001 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.915385+0000", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026651700000000002 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.915634+0000", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024955399999999998 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.931438+0000", 2024-04-22T19:57:41.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015804253000000001 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.938079+0000", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066409110000000002 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.938186+0000", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010710299999999999 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.938236+0000", 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9326999999999997e-05 2024-04-22T19:57:41.816 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3940 3.9 3:908d23f4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.028565+0000", 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7016880849999998, 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027430818999999999, 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3940 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.028565+0000", 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.028565+0000", 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.028568+0000", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8229999999999999e-06 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.032657+0000", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004088586 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.032693+0000", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5967000000000003e-05 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.032710+0000", 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7056999999999999e-05 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.032897+0000", 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018765899999999999 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.033346+0000", 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044901000000000001 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.033772+0000", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042527400000000001 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.049623+0000", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015851938999999999 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.055755+0000", 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006131259 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.055897+0000", 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014268500000000001 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.055996+0000", 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000005e-05 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.822 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3965 3.34 3:2de1c10c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.278705+0000", 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.4515482579999999, 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027489135000000001, 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3965 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.278705+0000", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.278705+0000", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.278708+0000", 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1389999999999999e-06 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.283415+0000", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047064020000000002 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.283456+0000", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1764999999999997e-05 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.283475+0000", 2024-04-22T19:57:41.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8709999999999999e-05 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.283617+0000", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014247700000000001 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.283883+0000", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026544399999999999 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.284133+0000", 2024-04-22T19:57:41.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024983399999999999 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.294279+0000", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01014663 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.305569+0000", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011289422 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.305996+0000", 2024-04-22T19:57:41.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042711600000000001 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.306194+0000", 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019819600000000001 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3994 3.34 3:2fa7d005:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.567048+0000", 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.1632052169999998, 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028498991000000001, 2024-04-22T19:57:41.828 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3994 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.567048+0000", 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.567048+0000", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.567051+0000", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7379999999999999e-06 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.574633+0000", 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075824029999999997 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.574664+0000", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0719000000000002e-05 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.574678+0000", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.432e-05 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.574793+0000", 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114465 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.575054+0000", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026142400000000001 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.575285+0000", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023121799999999999 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.593315+0000", 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018029565000000001 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595327+0000", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020122730000000002 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595430+0000", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103034 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595547+0000", 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116832 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.833 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4224 3.14 3:28086a82:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_465:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.353344+0000", 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.3769095949999999, 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030761474, 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:41.834 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4224 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.353344+0000", 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.353344+0000", 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:41.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.353348+0000", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0570000000000003e-06 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.357720+0000", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043727660000000002 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.357763+0000", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2691999999999997e-05 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:41.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.357810+0000", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7138999999999997e-05 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.357991+0000", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018110000000000001 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.358474+0000", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048251000000000001 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.358905+0000", 2024-04-22T19:57:41.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043077799999999999 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.379235+0000", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020330585000000002 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.383842+0000", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046070529999999998 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.384001+0000", 2024-04-22T19:57:41.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015849899999999999 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.384105+0000", 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104295 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:41.839 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:41.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-22T19:57:41.967 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:41.968 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:41.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-22T19:57:42.101 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.101 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:42.101 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:42.101 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:42.101 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:42.117 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-22T19:57:42.242 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.242 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:42.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2245 3.22 3:47503505:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.606192647, 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029095696000000001, 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.243 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633125+0000", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.633129+0000", 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639076+0000", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059473929999999996 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639116+0000", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9592000000000003e-05 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639142+0000", 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6060000000000001e-05 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639287+0000", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014544800000000001 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639538+0000", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025096299999999999 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.639767+0000", 2024-04-22T19:57:42.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228743 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.655951+0000", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016184061999999999 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.661901+0000", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059500990000000004 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662066+0000", 2024-04-22T19:57:42.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016544800000000001 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:10.662220+0000", 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153778 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2420 3.22 3:47454e28:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 89.543053239000002, 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035920164999999997, 2024-04-22T19:57:42.248 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2420 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696264+0000", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.696278+0000", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.365e-05 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712350+0000", 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016072096000000001 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712459+0000", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010904900000000001 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712549+0000", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0612000000000006e-05 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.712779+0000", 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022943700000000001 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713078+0000", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029946200000000001 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.713450+0000", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037183799999999999 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.726243+0000", 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012792968 2024-04-22T19:57:42.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.731961+0000", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057180299999999998 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732070+0000", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109234 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.732184+0000", 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113789 2024-04-22T19:57:42.253 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2434 3.2a 3:56493ff8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 89.380851738999993, 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027532311, 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.254 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2434 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858465+0000", 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.858468+0000", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.401e-06 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862330+0000", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003862196 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862348+0000", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.791e-05 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862359+0000", 2024-04-22T19:57:42.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1450999999999999e-05 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862432+0000", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2656000000000004e-05 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862619+0000", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018716100000000001 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.862818+0000", 2024-04-22T19:57:42.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019896200000000001 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.880128+0000", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017310009000000001 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885854+0000", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057261270000000001 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885942+0000", 2024-04-22T19:57:42.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7733999999999997e-05 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:12.885998+0000", 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5704000000000001e-05 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2683 3.1c 3:3bca9428:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.511576466000001, 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.049333588999999997, 2024-04-22T19:57:42.259 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2683 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727741+0000", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.727745+0000", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1529999999999999e-06 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732322+0000", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045772060000000003 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732372+0000", 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9531999999999999e-05 2024-04-22T19:57:42.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732400+0000", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8316000000000001e-05 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.732580+0000", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018029299999999999 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733075+0000", 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049501999999999999 2024-04-22T19:57:42.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.733470+0000", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039511499999999997 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.773304+0000", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039833748000000002 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776862+0000", 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035582999999999999 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.776984+0000", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121298 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777074+0000", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0607999999999997e-05 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2687 3.1d 3:ba07e6a7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:42.264 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.461642798, 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035098625000000001, 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2687 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777674+0000", 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.777676+0000", 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.736e-06 2024-04-22T19:57:42.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783250+0000", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055743390000000002 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783271+0000", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0647000000000001e-05 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783282+0000", 2024-04-22T19:57:42.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1182000000000001e-05 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783377+0000", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4708000000000002e-05 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783551+0000", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017413300000000001 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.783745+0000", 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019422600000000001 2024-04-22T19:57:42.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.804041+0000", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020295860999999998 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812521+0000", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084798270000000005 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812647+0000", 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012626900000000001 2024-04-22T19:57:42.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.812773+0000", 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125697 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2706 3.1d 3:b8f6f4c0:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.263998536000003, 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029098450000000001, 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.270 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975319+0000", 2024-04-22T19:57:42.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.975359+0000", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0686999999999999e-05 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980116+0000", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047570870000000001 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980157+0000", 2024-04-22T19:57:42.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0535999999999999e-05 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980183+0000", 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.62e-05 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980374+0000", 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190793 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.980774+0000", 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039960499999999998 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.981198+0000", 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000424881 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.990916+0000", 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097180540000000003 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004166+0000", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013249756999999999 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004304+0000", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013822899999999999 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.004417+0000", 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112621 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2771 3.30 3:0f1e32a3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.639949510999998, 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031657464000000003, 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2771 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599368+0000", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.599372+0000", 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1160000000000001e-06 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603436+0000", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040637249999999998 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603475+0000", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9651999999999999e-05 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603494+0000", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8513e-05 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603634+0000", 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013999699999999999 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.603887+0000", 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025339900000000002 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.604117+0000", 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022996599999999999 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.615169+0000", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011052339 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630826+0000", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015656832999999998 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630950+0000", 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012386100000000001 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.631025+0000", 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5062999999999996e-05 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2788 3.3c 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.471946899000002, 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.036011505999999999, 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.281 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2788 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767370+0000", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.767375+0000", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.42e-06 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772707+0000", 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053320930000000004 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772752+0000", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4872e-05 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772780+0000", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7929999999999999e-05 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.772909+0000", 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012947100000000001 2024-04-22T19:57:42.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773163+0000", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025434200000000001 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773388+0000", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022477200000000001 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801021+0000", 2024-04-22T19:57:42.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027632756000000001 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803177+0000", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00215613 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803270+0000", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2742000000000001e-05 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.803382+0000", 2024-04-22T19:57:42.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111978 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2790 3.2 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.454125021999999, 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035826012999999997, 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.287 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2790 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785192+0000", 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.785196+0000", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5149999999999998e-06 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789469+0000", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042733399999999996 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789515+0000", 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6273999999999998e-05 2024-04-22T19:57:42.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789540+0000", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4644999999999999e-05 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789684+0000", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014357199999999999 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789934+0000", 2024-04-22T19:57:42.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025006900000000001 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790138+0000", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020399400000000001 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814292+0000", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024154821999999999 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820852+0000", 2024-04-22T19:57:42.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065591879999999997 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820931+0000", 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9796000000000006e-05 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.821018+0000", 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6798000000000005e-05 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2820 3.30 3:0f8fcbba:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.055765180000002, 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029827422999999999, 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2820 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183552+0000", 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.183556+0000", 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6200000000000001e-06 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187590+0000", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040348500000000004 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187629+0000", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8303000000000002e-05 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187647+0000", 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8236e-05 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.187829+0000", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018152000000000001 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188224+0000", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039574199999999998 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.188390+0000", 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016557200000000001 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.195210+0000", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068199369999999999 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213255+0000", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018045106000000002 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213327+0000", 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2203e-05 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.213379+0000", 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2333999999999997e-05 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3277 3.16 3:6a27634a:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.706449135, 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034380834999999998, 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.298 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3277 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532868+0000", 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.532872+0000", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1230000000000002e-06 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536901+0000", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004028836 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536940+0000", 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8492999999999999e-05 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.536961+0000", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996999999999999e-05 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537101+0000", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014023799999999999 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.537112+0000", 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0993e-05 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543074+0000", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059622640000000001 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543288+0000", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021412699999999999 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.543497+0000", 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020925699999999999 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.559753+0000", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016255281 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567096+0000", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0073434069999999997 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567191+0000", 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4450000000000005e-05 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.567249+0000", 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8369000000000003e-05 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3278 3.16 3:6b7b3a73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.696985823999999, 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034344214999999997, 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.304 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3278 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542331+0000", 2024-04-22T19:57:42.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.542341+0000", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8339999999999994e-06 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549253+0000", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069115189999999996 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549276+0000", 2024-04-22T19:57:42.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3694e-05 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.549287+0000", 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0407e-05 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550496+0000", 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012090149999999999 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.550835+0000", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033953199999999997 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.551236+0000", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040053199999999999 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.562553+0000", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011317081999999999 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576510+0000", 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013957093 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576604+0000", 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3729999999999999e-05 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.576676+0000", 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1777000000000001e-05 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3357 3.1d 3:bba822d3:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.401397241000002, 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035607101000000002, 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3357 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.310 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837920+0000", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.837924+0000", 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-22T19:57:42.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846158+0000", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082345400000000003 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846215+0000", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6678999999999997e-05 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846244+0000", 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8914000000000001e-05 2024-04-22T19:57:42.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846452+0000", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000208703 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.846917+0000", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046460799999999998 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.847336+0000", 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041877700000000001 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.865281+0000", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017945699999999998 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873242+0000", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079604710000000002 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873407+0000", 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016511100000000001 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:12.873527+0000", 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119981 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3802 3.22 3:479db8f4:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.507659+0000", 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.7316584339999999, 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030652907, 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.315 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3802 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.507659+0000", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.507659+0000", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.507662+0000", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4029999999999999e-06 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.512612+0000", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049498040000000004 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.512658+0000", 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6449000000000002e-05 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.512683+0000", 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4549000000000002e-05 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.512825+0000", 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014214100000000001 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.513066+0000", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024095799999999999 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.513294+0000", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000228104 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.524988+0000", 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011693945000000001 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.537989+0000", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013001057999999999 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.538176+0000", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186465 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.538312+0000", 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136031 2024-04-22T19:57:42.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3815 3.16 3:6b7dbc9f:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.648011+0000", 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5913065460000002, 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035493177000000001, 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.321 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3815 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.648011+0000", 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.648011+0000", 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.648015+0000", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7400000000000004e-06 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655102+0000", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070865119999999997 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655140+0000", 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8179000000000002e-05 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655159+0000", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8865999999999999e-05 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655285+0000", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012595099999999999 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655543+0000", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025809699999999999 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.655774+0000", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231012 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.666237+0000", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010462679000000001 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.683246+0000", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017009522999999999 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.683385+0000", 2024-04-22T19:57:42.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139197 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.683504+0000", 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118421 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3918 3.3c 3:3ca96a61:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.798823+0000", 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.4404937760000003, 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032922535000000003, 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.326 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3918 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.798823+0000", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.798823+0000", 2024-04-22T19:57:42.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.798832+0000", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3790000000000006e-06 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.803748+0000", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004916129 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.803783+0000", 2024-04-22T19:57:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5388000000000001e-05 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.803807+0000", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3628000000000001e-05 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.803971+0000", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016365499999999999 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.804220+0000", 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024987400000000003 2024-04-22T19:57:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.804453+0000", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023254499999999999 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.813965+0000", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0095123759999999995 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.831578+0000", 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017612582000000002 2024-04-22T19:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.831659+0000", 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0578e-05 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.831746+0000", 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7400999999999999e-05 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3996 3.38 3:1f9eb772:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.587660+0000", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6516572979999999, 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035506562999999998, 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3996 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.587660+0000", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.587660+0000", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.587664+0000", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4059999999999998e-06 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595201+0000", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075366080000000002 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595249+0000", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8399000000000002e-05 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595273+0000", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3926000000000001e-05 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595452+0000", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017835999999999999 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.595891+0000", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043944999999999998 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.596329+0000", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000438391 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.607760+0000", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011430615 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.622809+0000", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015048643 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.623021+0000", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021181499999999999 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.623166+0000", 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014595 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4025 3.c 3:33d35bb1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_276:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.896654+0000", 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3426631269999998, 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032147740000000001, 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4025 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.896654+0000", 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.896654+0000", 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.896670+0000", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5988999999999999e-05 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.900923+0000", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042524950000000002 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.900949+0000", 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6182000000000001e-05 2024-04-22T19:57:42.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.900966+0000", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7552999999999999e-05 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.901187+0000", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022083199999999999 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.901456+0000", 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026880699999999998 2024-04-22T19:57:42.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.901705+0000", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024936899999999999 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.915959+0000", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01425416 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.928673+0000", 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012713185 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.928747+0000", 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4017999999999995e-05 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.928802+0000", 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5149999999999999e-05 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.342 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4229 3.c 3:33aefb27:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_470:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.406309+0000", 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.833007829, 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033968738999999998, 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4229 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.406309+0000", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.406309+0000", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.406327+0000", 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7917000000000001e-05 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.411115+0000", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047881779999999997 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.411145+0000", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9748e-05 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.411168+0000", 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3008000000000001e-05 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.411390+0000", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022192699999999999 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.411759+0000", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036864999999999999 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.412142+0000", 2024-04-22T19:57:42.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038318299999999999 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.437539+0000", 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025397390999999998 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.440134+0000", 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002594388 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.440219+0000", 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5532999999999996e-05 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.440278+0000", 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8816000000000001e-05 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4236 3.2 3:43e15632:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_477:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.473168+0000", 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.7661496460000001, 2024-04-22T19:57:42.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026849336000000001, 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4236 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.473168+0000", 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.473168+0000", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.473171+0000", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9400000000000004e-06 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.477844+0000", 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004672463 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.477870+0000", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6083000000000001e-05 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.477883+0000", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2677000000000001e-05 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.477974+0000", 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0890999999999994e-05 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.478158+0000", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000184172 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.478327+0000", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016969399999999999 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.486552+0000", 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082243179999999996 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.499256+0000", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012704264999999999 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.499724+0000", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000467942 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.500017+0000", 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029289099999999998 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.353 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.354 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.354 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:42.355 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-22T19:57:42.483 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.483 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:42.483 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:42.483 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:42.497 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-22T19:57:42.618 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:42.619 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:42.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 205.395072312, 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030220963999999999, 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.751 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354968+0000", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354971+0000", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4359999999999998e-06 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.354983+0000", 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2432999999999999e-05 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355018+0000", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4693000000000001e-05 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355041+0000", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2711e-05 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355214+0000", 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017321099999999999 2024-04-22T19:57:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.355231+0000", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7405e-05 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360735+0000", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055033549999999997 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.360755+0000", 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0321000000000001e-05 2024-04-22T19:57:42.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376492+0000", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015737309000000001 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.376776+0000", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028365399999999999 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.377067+0000", 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029051100000000002 2024-04-22T19:57:42.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.383172+0000", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061053130000000002 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.384983+0000", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001811221 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385105+0000", 2024-04-22T19:57:42.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012200499999999999 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:54:17.385189+0000", 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3386000000000004e-05 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1192 3.2c 3:36ee8971:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1__shadow_.NcvQO0JhUl-YGAeYrNgo1epguZZvoTX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 105.472328773, 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027393364, 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.758 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1192 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277711+0000", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.277713+0000", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2630000000000002e-06 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285849+0000", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081358850000000007 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285886+0000", 2024-04-22T19:57:42.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6452000000000003e-05 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.285902+0000", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6667000000000002e-05 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286022+0000", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119311 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286255+0000", 2024-04-22T19:57:42.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023329199999999999 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.286491+0000", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023630299999999999 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.303835+0000", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017343368000000001 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304803+0000", 2024-04-22T19:57:42.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096790899999999998 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.304974+0000", 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017136000000000001 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.305104+0000", 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013055400000000001 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:1195 3.2c 3:358884b9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.1_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 105.441112084, 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028411532, 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1195 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308928+0000", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.308947+0000", 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9266000000000002e-05 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313472+0000", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045251520000000002 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313507+0000", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4919999999999998e-05 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313523+0000", 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5783000000000001e-05 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.313679+0000", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015597699999999999 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.314100+0000", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042108899999999998 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.315302+0000", 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202334 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.335094+0000", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019791705999999999 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337153+0000", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020588249999999998 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337267+0000", 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114011 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:55:57.337339+0000", 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2469e-05 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2302 3.36 3:6e18a217:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.523459981000002, 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026104648000000001, 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.769 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2302 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226580+0000", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.226583+0000", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199999999999999e-06 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230622+0000", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040391029999999996 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230662+0000", 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9682999999999999e-05 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230680+0000", 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7923000000000001e-05 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230772+0000", 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2180000000000002e-05 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.230924+0000", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015210700000000001 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.231048+0000", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124144 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.235366+0000", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043177210000000001 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252548+0000", 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017182102000000001 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252622+0000", 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3934000000000001e-05 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252685+0000", 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2330999999999997e-05 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2304 3.a 3:5311ffdc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.9__shadow_.vckqow-HU7c6SKJrhi6lo3yTU4vszqs_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.504252068, 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029286063000000001, 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2304 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245788+0000", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.245792+0000", 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9439999999999998e-06 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252278+0000", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064858880000000004 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252321+0000", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3248999999999999e-05 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252341+0000", 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9616999999999999e-05 2024-04-22T19:57:42.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252457+0000", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116006 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252640+0000", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018296999999999999 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.252788+0000", 2024-04-22T19:57:42.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148918 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.262116+0000", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093276699999999997 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.274885+0000", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012768597 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275001+0000", 2024-04-22T19:57:42.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116795 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:11.275074+0000", 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2409000000000004e-05 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2693 3.26 3:6495a293:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.905815846000003, 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026637694, 2024-04-22T19:57:42.780 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2693 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844224+0000", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.844227+0000", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848561+0000", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043346050000000001 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848596+0000", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4972999999999999e-05 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848612+0000", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5214e-05 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848729+0000", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117199 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.848954+0000", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022575300000000001 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.849151+0000", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019659000000000001 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.857903+0000", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087516109999999994 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870648+0000", 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01274526 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870767+0000", 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118621 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:47.870862+0000", 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5204000000000005e-05 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2737 3.2c 3:343081c8:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.39972101, 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026213469999999999, 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.786 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2737 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350319+0000", 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.350321+0000", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5469999999999999e-06 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355769+0000", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054480279999999997 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355816+0000", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6133e-05 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.355841+0000", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5851999999999999e-05 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356019+0000", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017762400000000001 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356447+0000", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428379 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.356880+0000", 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043258800000000003 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.375982+0000", 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019102289000000001 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376327+0000", 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034508100000000001 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376446+0000", 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896399999999999 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.376532+0000", 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5984999999999998e-05 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2745 3.35 3:ac24a035:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.791 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.314281209000001, 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030233854000000001, 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2745 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435759+0000", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.435764+0000", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9930000000000003e-06 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440353+0000", 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004589508 2024-04-22T19:57:42.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440399+0000", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5908999999999997e-05 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440418+0000", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9196000000000001e-05 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440592+0000", 2024-04-22T19:57:42.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174174 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.440842+0000", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024949800000000002 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.441166+0000", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032367799999999999 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.457125+0000", 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015959224000000001 2024-04-22T19:57:42.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465682+0000", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085570130000000005 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465856+0000", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017440700000000001 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.465993+0000", 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013625399999999999 2024-04-22T19:57:42.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2789 3.a 3:50f6701b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.973900753000002, 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042353867000000003, 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2789 2024-04-22T19:57:42.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776139+0000", 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.776144+0000", 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1399999999999999e-06 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780913+0000", 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00476867 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780964+0000", 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0822000000000002e-05 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.780989+0000", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5023000000000001e-05 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781143+0000", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154189 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.781570+0000", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042744899999999999 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.782034+0000", 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046334000000000002 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.814420+0000", 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032386456000000001 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818256+0000", 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038355139999999999 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818382+0000", 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126024 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.818493+0000", 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011124 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2790 3.2 e93/89 3:43e623a9:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_129:head v 93'6, mlcod=76'4)", 2024-04-22T19:57:42.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.959724903999998, 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030242916000000002, 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790315+0000", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.790317+0000", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.906e-06 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793431+0000", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031143500000000001 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793483+0000", 2024-04-22T19:57:42.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2185000000000003e-05 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793508+0000", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4990999999999998e-05 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793696+0000", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018735 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.793754+0000", 2024-04-22T19:57:42.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8208999999999998e-05 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820504+0000", 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026749934999999999 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.820558+0000", 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3990000000000003e-05 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2791 3.33 3:cd7dec73:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.955544471000003, 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030148463, 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2791 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794495+0000", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.794499+0000", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3139999999999999e-06 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801003+0000", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006504035 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801048+0000", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4903e-05 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801074+0000", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6308999999999998e-05 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801214+0000", 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139818 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801424+0000", 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020993100000000001 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.801641+0000", 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217374 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.823491+0000", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021849397 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824368+0000", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00087792399999999998 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824522+0000", 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153213 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.824644+0000", 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012224499999999999 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2835 3.26 3:661fec7c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.263195222999997, 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028791798, 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.812 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2835 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486845+0000", 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.486847+0000", 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7350000000000001e-06 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491854+0000", 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050064419999999998 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491892+0000", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8262000000000001e-05 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.491910+0000", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492064+0000", 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153604 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492319+0000", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025515100000000001 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.492581+0000", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026247199999999998 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.514737+0000", 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022155883000000001 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515406+0000", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066905700000000003 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515565+0000", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158877 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:49.515636+0000", 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1432000000000003e-05 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3840 3.2c 3:34a0a6b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.928328+0000", 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8217114780000001, 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028498428999999999, 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3840 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.818 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.928328+0000", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.928328+0000", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.928331+0000", 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:42.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.932547+0000", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042163299999999999 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.932578+0000", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0531999999999998e-05 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.932597+0000", 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9157e-05 2024-04-22T19:57:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.932745+0000", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014819 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.933092+0000", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034666599999999998 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.933505+0000", 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041309000000000002 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.942439+0000", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089339569999999993 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.956669+0000", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014230110000000001 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.956759+0000", 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9477999999999999e-05 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.956827+0000", 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8255000000000003e-05 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3845 3.26 3:67cec55c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.990734+0000", 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.7593057099999996, 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029003186, 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3845 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.990734+0000", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.990734+0000", 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.990739+0000", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5850000000000001e-06 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.994658+0000", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039187969999999999 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.994701+0000", 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3618999999999997e-05 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.994721+0000", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9983000000000002e-05 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.994878+0000", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015639000000000001 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.995221+0000", 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034385999999999998 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.995532+0000", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000310761 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.006410+0000", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010878153 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.019422+0000", 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013011597999999999 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.019599+0000", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017707899999999999 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.019737+0000", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013836100000000001 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3904 3.20 3:0444863d:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.654540+0000", 2024-04-22T19:57:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.0955002260000004, 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030033293999999999, 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3904 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.654540+0000", 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.654540+0000", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.654544+0000", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4630000000000003e-06 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661097+0000", 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006552904 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661138+0000", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0485999999999998e-05 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661156+0000", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8320000000000001e-05 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661285+0000", 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012878999999999999 2024-04-22T19:57:42.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661553+0000", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026792400000000001 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.661784+0000", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231549 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.684084+0000", 2024-04-22T19:57:42.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022300062999999998 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.684299+0000", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021474100000000001 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.684454+0000", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015548 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.684573+0000", 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011857399999999999 2024-04-22T19:57:42.833 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3907 3.36 3:6fa8c90c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.685675+0000", 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.0643648839999997, 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026129849, 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.834 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3907 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.685675+0000", 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.685675+0000", 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.685678+0000", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0299999999999998e-06 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.690384+0000", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047061339999999998 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.690429+0000", 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4452000000000001e-05 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.690452+0000", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3416000000000001e-05 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.690595+0000", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014315000000000001 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.690940+0000", 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034522200000000001 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.691190+0000", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024936499999999998 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.703735+0000", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012545201000000001 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.711544+0000", 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0078092389999999999 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.711699+0000", 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015449100000000001 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.711805+0000", 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106149 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3952 3.10 3:08a764eb:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:42.839 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.146744+0000", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6032956689999995, 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026371960999999999, 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3952 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.146744+0000", 2024-04-22T19:57:42.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.146744+0000", 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.146748+0000", 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.58e-06 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.151404+0000", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046558160000000001 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.151441+0000", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7358999999999999e-05 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.151458+0000", 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6877000000000001e-05 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.151636+0000", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000178197 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.152030+0000", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039353400000000002 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.152339+0000", 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030915000000000001 2024-04-22T19:57:42.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.162146+0000", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098076900000000009 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.172927+0000", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010781064999999999 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.173017+0000", 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9030000000000006e-05 2024-04-22T19:57:42.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.173116+0000", 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9662999999999998e-05 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:4229 3.c e110/89 3:33aefb27:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_470:head v 110'25, mlcod=109'23)", 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.412364+0000", 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.3376762150000001, 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027340875000000001, 2024-04-22T19:57:42.845 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.412364+0000", 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.412364+0000", 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.412366+0000", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0710000000000002e-06 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.415010+0000", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026446339999999999 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.415038+0000", 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7413e-05 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.415053+0000", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5109000000000001e-05 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.415166+0000", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113071 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.415213+0000", 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6755000000000002e-05 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.439591+0000", 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024378484999999998 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.439705+0000", 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113337 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.849 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4231 3.36 3:6f6b7dd1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.425039+0000", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.3250011239999999, 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033995299, 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4231 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.425039+0000", 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.425039+0000", 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.425042+0000", 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0460000000000001e-06 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.430546+0000", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055043690000000003 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.430579+0000", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2691000000000003e-05 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.430596+0000", 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7207999999999999e-05 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.430715+0000", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011849900000000001 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.431001+0000", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028633400000000001 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.431287+0000", 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028617200000000001 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.456786+0000", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025498588999999999 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.458747+0000", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019615660000000001 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.458899+0000", 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015215199999999999 2024-04-22T19:57:42.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.459034+0000", 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134673 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4253 3.a 3:53cd82f7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_494:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.653475+0000", 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.096565375, 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026869757000000001, 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4253 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.653475+0000", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.653475+0000", 2024-04-22T19:57:42.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.653478+0000", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.472e-06 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658074+0000", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045957869999999996 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658106+0000", 2024-04-22T19:57:42.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2571999999999999e-05 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658120+0000", 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3199e-05 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658227+0000", 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107181 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658444+0000", 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000217603 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.658620+0000", 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000176009 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.678587+0000", 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019966803000000002 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.680009+0000", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014221679999999999 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.680218+0000", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000209149 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.680344+0000", 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125814 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:42.860 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:42.861 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:42.862 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-22T19:57:42.989 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:42.990 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:42.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-22T19:57:42.990 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:43.004 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-22T19:57:43.119 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:43.120 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-22T19:57:43.120 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-22T19:57:43.120 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-22T19:57:43.120 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:43.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2774 3.15 3:a97960b7:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.628998258000003, 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030176524, 2024-04-22T19:57:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2774 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630233+0000", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.630259+0000", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5656e-05 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635174+0000", 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049155509999999998 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635211+0000", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6952999999999997e-05 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635228+0000", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6932999999999999e-05 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635389+0000", 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016050999999999999 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.635787+0000", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039829999999999998 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.636198+0000", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041096200000000001 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.652706+0000", 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016507701 2024-04-22T19:57:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.659838+0000", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071322570000000004 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660185+0000", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034738500000000002 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.660410+0000", 2024-04-22T19:57:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022431600000000001 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:2787 3.e 3:70fc597e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.502167651999997, 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032585642999999997, 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2787 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757064+0000", 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.757066+0000", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5830000000000001e-06 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.761950+0000", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048836169999999998 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762002+0000", 2024-04-22T19:57:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2512999999999997e-05 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762027+0000", 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4286000000000001e-05 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762178+0000", 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151698 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762435+0000", 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000256999 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.762652+0000", 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021687200000000001 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.774062+0000", 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011409734 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789420+0000", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015358502 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789525+0000", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010440799999999999 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.789649+0000", 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012443099999999999 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4473.0:2788 3.3c e93/89 3:3fb6eeb5:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.10__shadow_.IcWY4XLBRK7xBH_cPKIZIUvNHKMJP-g_127:head v 93'5, mlcod=93'3)", 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.485656978000002, 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029180121, 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773574+0000", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.773576+0000", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1289999999999999e-06 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779626+0000", 2024-04-22T19:57:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060496769999999998 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779684+0000", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7516000000000003e-05 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779703+0000", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9247000000000001e-05 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779862+0000", 2024-04-22T19:57:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962300000000001 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.779930+0000", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7273000000000005e-05 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802668+0000", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022737773999999999 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:56:48.802754+0000", 2024-04-22T19:57:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6881999999999999e-05 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3305 3.3b 3:df7c6c3e:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.393644510000001, 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02996099, 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3305 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865587+0000", 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.865589+0000", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5809999999999999e-06 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869510+0000", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039209550000000003 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869544+0000", 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3229999999999999e-05 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869558+0000", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4929000000000001e-05 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869668+0000", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109147 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.869891+0000", 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022348499999999999 2024-04-22T19:57:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.870091+0000", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019977699999999999 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.879932+0000", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098416419999999994 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895461+0000", 2024-04-22T19:57:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015528827 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895511+0000", 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9558999999999998e-05 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:11.895548+0000", 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6857999999999998e-05 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3374 3.f 3:f24b7435:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.203075806000001, 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.033085672000000003, 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3374 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056155+0000", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.056160+0000", 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5399999999999997e-06 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063543+0000", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.007383265 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063586+0000", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2363000000000001e-05 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063604+0000", 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8219999999999998e-05 2024-04-22T19:57:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.063742+0000", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138071 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064038+0000", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000296283 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.064258+0000", 2024-04-22T19:57:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022030699999999999 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.083221+0000", 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018962946000000001 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089044+0000", 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058230189999999996 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089144+0000", 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9046e-05 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.089241+0000", 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7612e-05 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3380 3.e 3:70445021:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_309:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.139463739, 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026443379999999999, 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119768+0000", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.119801+0000", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3569000000000003e-05 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127712+0000", 2024-04-22T19:57:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079112230000000002 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127756+0000", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3205999999999999e-05 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127775+0000", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9643000000000001e-05 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.127957+0000", 2024-04-22T19:57:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018173399999999999 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128368+0000", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041124899999999998 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.128788+0000", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042035800000000002 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.144721+0000", 2024-04-22T19:57:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015932720000000001 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.145980+0000", 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012590310000000001 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146082+0000", 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101326 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.146211+0000", 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129321 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3394 3.d 3:b0ab1424:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_323:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.985895255999999, 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030154717000000001, 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3394 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273336+0000", 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.273340+0000", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2729999999999996e-06 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279108+0000", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0057675139999999996 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279162+0000", 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3906000000000002e-05 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279183+0000", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1403000000000002e-05 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279330+0000", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014687500000000001 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279588+0000", 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258063 2024-04-22T19:57:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.279888+0000", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030026 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.289608+0000", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097194659999999995 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303262+0000", 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013653983 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303405+0000", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014306200000000001 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.303491+0000", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5912e-05 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3399 3.3f 3:ff03954c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.11__shadow_.6HdA-OxGx9rxAabn46wf_tWr_Q2DjDy_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.928187362999999, 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031545288999999997, 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3399 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331044+0000", 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.331047+0000", 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0529999999999998e-06 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335945+0000", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048978110000000002 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.335986+0000", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.083e-05 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336004+0000", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8629000000000001e-05 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336185+0000", 2024-04-22T19:57:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180898 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336448+0000", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026270699999999999 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.336683+0000", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023544700000000001 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.348895+0000", 2024-04-22T19:57:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012212015 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362409+0000", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013513588 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362506+0000", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7613000000000002e-05 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:13.362589+0000", 2024-04-22T19:57:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2698e-05 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3812 3.3b 3:dc89476b:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.617459+0000", 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6417720080000002, 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027371045, 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3812 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.617459+0000", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.617459+0000", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.617463+0000", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.49e-06 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.622290+0000", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048268199999999999 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.622329+0000", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9088999999999998e-05 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.622351+0000", 2024-04-22T19:57:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2704000000000001e-05 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.622519+0000", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016715600000000001 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.622803+0000", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028446299999999999 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.623098+0000", 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029509399999999998 2024-04-22T19:57:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.632441+0000", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093433700000000001 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.644646+0000", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012204613 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.644748+0000", 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102278 2024-04-22T19:57:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.644830+0000", 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1967999999999999e-05 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3816 3.37 3:ef395903:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:34.657470+0000", 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.6017615169999999, 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026763002000000001, 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3816 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.657470+0000", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.657470+0000", 2024-04-22T19:57:43.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.657475+0000", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0000000000000004e-06 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.661692+0000", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042170910000000001 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.661739+0000", 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7005999999999997e-05 2024-04-22T19:57:43.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.661764+0000", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5309000000000001e-05 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.661944+0000", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017959200000000001 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.662191+0000", 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000247445 2024-04-22T19:57:43.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.662406+0000", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021436200000000001 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.681367+0000", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018961886000000001 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.683933+0000", 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025658149999999999 2024-04-22T19:57:43.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.684113+0000", 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017984300000000001 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:34.684233+0000", 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119653 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3848 3.15 3:ab387c51:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:43.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.021291+0000", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2379401039999998, 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027822172999999999, 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3848 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.021291+0000", 2024-04-22T19:57:43.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.021291+0000", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.021294+0000", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8430000000000001e-06 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.028549+0000", 2024-04-22T19:57:43.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072551040000000001 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.028584+0000", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4950000000000002e-05 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.028601+0000", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6871000000000002e-05 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.028733+0000", 2024-04-22T19:57:43.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132201 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.028984+0000", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025080499999999999 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.029236+0000", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025256399999999999 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.040555+0000", 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011318826000000001 2024-04-22T19:57:43.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.048890+0000", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083351339999999993 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.049003+0000", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011280799999999999 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.049113+0000", 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110067 2024-04-22T19:57:43.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3853 3.2d 3:b54725bc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.066981+0000", 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1922499850000001, 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027262241999999999, 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3853 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.066981+0000", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.066981+0000", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.066984+0000", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3429999999999998e-06 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.071751+0000", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047673780000000001 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.071778+0000", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6732000000000001e-05 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.071790+0000", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2588e-05 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.071895+0000", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104857 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.072090+0000", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019442400000000001 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-22T19:57:43.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.072253+0000", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016389 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.082068+0000", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098141530000000008 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.094078+0000", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012010827999999999 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.094169+0000", 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0717999999999994e-05 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.094244+0000", 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4331000000000004e-05 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3908 3.d 3:b188a30c:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.697251+0000", 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5619805419999997, 2024-04-22T19:57:43.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042447851000000002, 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3908 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.697251+0000", 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.697251+0000", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.697256+0000", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8400000000000002e-06 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.705936+0000", 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086808010000000001 2024-04-22T19:57:43.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.705975+0000", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8414000000000002e-05 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.705993+0000", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479e-05 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.706139+0000", 2024-04-22T19:57:43.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014576699999999999 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.706151+0000", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.167e-05 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.718362+0000", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012211368 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.718698+0000", 2024-04-22T19:57:43.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033632099999999999 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.719024+0000", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032604699999999999 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.730687+0000", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01166265 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.739427+0000", 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0087398519999999993 2024-04-22T19:57:43.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.739588+0000", 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016117900000000001 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.739699+0000", 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110463 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3927 3.11 3:8a9627ed:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.333 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:35.890037+0000", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.3691943950000001, 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.038060503000000002, 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3927 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.890037+0000", 2024-04-22T19:57:43.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.890037+0000", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.890041+0000", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5800000000000002e-06 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.896641+0000", 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066000199999999998 2024-04-22T19:57:43.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.896682+0000", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0701999999999998e-05 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.896701+0000", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8732999999999998e-05 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.896839+0000", 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138591 2024-04-22T19:57:43.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.897102+0000", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026273399999999998 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.897324+0000", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022197499999999999 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.911387+0000", 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014063136 2024-04-22T19:57:43.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.927904+0000", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016516510000000002 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.928018+0000", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113776 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:35.928097+0000", 2024-04-22T19:57:43.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9746000000000005e-05 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3944 3.3f 3:fed8cade:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.069601+0000", 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.1896299419999998, 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027281619999999999, 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3944 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.069601+0000", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.069601+0000", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.069604+0000", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6639999999999998e-06 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.074595+0000", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049907620000000001 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.074642+0000", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6974999999999997e-05 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.074666+0000", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4182999999999999e-05 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.074803+0000", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137212 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.075106+0000", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030249900000000002 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-22T19:57:43.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.075313+0000", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207753 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.095587+0000", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020273465000000001 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.096551+0000", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00096447099999999995 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.096723+0000", 2024-04-22T19:57:43.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017165299999999999 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.096883+0000", 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015998299999999999 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3947 3.7 3:e3daaf18:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.097684+0000", 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.1615475540000002, 2024-04-22T19:57:43.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027330803000000001, 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3947 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.097684+0000", 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.097684+0000", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.097686+0000", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7889999999999999e-06 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.105661+0000", 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079748240000000001 2024-04-22T19:57:43.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.105709+0000", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8025999999999997e-05 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.105736+0000", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6316e-05 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.105898+0000", 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016210899999999999 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.106145+0000", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024694700000000002 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.106363+0000", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021834299999999999 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.117792+0000", 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011428588999999999 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.124689+0000", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068975249999999998 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.124865+0000", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017543300000000001 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.125015+0000", 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014990199999999999 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3979 3.e 3:734684d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.419949+0000", 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.8392822869999996, 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034728476000000001, 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3979 2024-04-22T19:57:43.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.419949+0000", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.419949+0000", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.419952+0000", 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4599999999999999e-06 2024-04-22T19:57:43.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.428269+0000", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083165259999999994 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.428303+0000", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4159000000000003e-05 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.428321+0000", 2024-04-22T19:57:43.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7527e-05 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.428489+0000", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016799600000000001 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.428911+0000", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042241400000000003 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.429335+0000", 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042372800000000001 2024-04-22T19:57:43.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.446210+0000", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016875513000000002 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.454465+0000", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082542510000000006 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.454563+0000", 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8660999999999996e-05 2024-04-22T19:57:43.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.454677+0000", 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011424100000000001 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3980 3.e 3:735be4d1:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.429109+0000", 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.8301217960000002, 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031063196000000001, 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.355 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3980 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.429109+0000", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.429109+0000", 2024-04-22T19:57:43.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.429112+0000", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9299999999999999e-06 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.436389+0000", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072762089999999996 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.436436+0000", 2024-04-22T19:57:43.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7076000000000001e-05 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.436458+0000", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1991999999999999e-05 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.437432+0000", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00097460299999999999 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.437757+0000", 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032475599999999999 2024-04-22T19:57:43.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.438026+0000", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026918100000000001 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.451637+0000", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013610381 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.459855+0000", 2024-04-22T19:57:43.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082179579999999992 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.460043+0000", 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018812899999999999 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.460173+0000", 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012998099999999999 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.360 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:3997 3.37 3:ef685ef2:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:36.597431+0000", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6617998409999997, 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029976188000000001, 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3997 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.597431+0000", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.597431+0000", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.597438+0000", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5830000000000003e-06 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.603611+0000", 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006172856 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.603653+0000", 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2188999999999999e-05 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.603672+0000", 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9392e-05 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.603810+0000", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013725099999999999 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.604060+0000", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024997499999999999 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.604275+0000", 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000214995 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.624577+0000", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020301875 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.627098+0000", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025213589999999999 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.627284+0000", 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186436 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:36.627408+0000", 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012327700000000001 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4473.0:4232 3.e 3:7001d7fc:::eb035469-c6ab-4cf0-ad71-a1ae33c3109a.4473.12__shadow_.mvqxBui0X5uBh8lxBTP1jSkqfRb6dL3_473:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-22T19:57:39.434444+0000", 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.8247876729999999, 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02720883, 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-22T19:57:43.366 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4473", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.111:0/511442554", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4232 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.434444+0000", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.434444+0000", 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.434447+0000", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1599999999999998e-06 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.438711+0000", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042639460000000002 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.438755+0000", 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4110999999999998e-05 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.438779+0000", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3981999999999998e-05 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.438982+0000", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020357200000000001 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.439273+0000", 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029076599999999997 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.439563+0000", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028984200000000001 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.457903+0000", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018340281999999999 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.461441+0000", 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035380920000000001 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.461536+0000", 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5031999999999994e-05 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-22T19:57:39.461652+0000", 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116045 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-22T19:57:43.371 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-22T19:57:43.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-22T19:57:43.928 INFO:tasks.thrashosds.thrasher:inning osd 2024-04-22T19:57:43.929 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-04-22T19:57:43.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-04-22T19:57:44.227 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-22T19:57:44.224+0000 7fe06150a640 -1 mon.a@0(leader).osd e111 definitely_dead 0 2024-04-22T19:57:44.717 INFO:teuthology.orchestra.run.smithi111.stderr:noscrub is unset 2024-04-22T19:57:44.717 INFO:teuthology.orchestra.run.smithi111.stderr:marked in osd.3. 2024-04-22T19:57:44.770 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-04-22T19:57:44.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-22T19:57:44.771 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-22T19:57:44.933 INFO:teuthology.orchestra.run.smithi111.stdout:mon.a: {} 2024-04-22T19:57:44.934 INFO:teuthology.orchestra.run.smithi111.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:57:44.947 INFO:teuthology.orchestra.run.smithi111.stdout:mon.b: {} 2024-04-22T19:57:44.947 INFO:teuthology.orchestra.run.smithi111.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:57:44.956 INFO:teuthology.orchestra.run.smithi111.stdout:mon.c: {} 2024-04-22T19:57:44.956 INFO:teuthology.orchestra.run.smithi111.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-22T19:57:44.972 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-22T19:57:45.720 INFO:teuthology.orchestra.run.smithi111.stderr:nodeep-scrub is unset 2024-04-22T19:57:45.743 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.0 to 1 (10000) 2024-04-22T19:57:45.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-22T19:57:46.722 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-22T19:57:46.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-22T19:57:47.747 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.1 to 1 (10000) 2024-04-22T19:57:47.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-22T19:57:48.770 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-22T19:57:48.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-22T19:57:49.799 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.2 to 1 (10000) 2024-04-22T19:57:49.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-22T19:57:50.801 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-22T19:57:50.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-22T19:57:51.821 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.3 to 1 (10000) 2024-04-22T19:57:51.854 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-22T19:57:52.323 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-22T19:57:52.355 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-22T19:57:53.316 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.4 to 1 (10000) 2024-04-22T19:57:53.349 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-22T19:57:54.335 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-22T19:57:54.358 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-22T19:57:55.337 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.5 to 1 (10000) 2024-04-22T19:57:55.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-22T19:57:56.356 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-22T19:57:56.381 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-22T19:57:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.6 to 1 (10000) 2024-04-22T19:57:57.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-22T19:57:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-22T19:57:58.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-22T19:57:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:reweighted osd.7 to 1 (10000) 2024-04-22T19:57:59.402 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-22T19:58:00.404 INFO:teuthology.orchestra.run.smithi111.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-22T19:58:00.426 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-22T19:58:00.426 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-22T19:58:00.426 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-22T19:58:00.426 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-22T19:58:00.426 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-22T19:58:00.427 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:58:00.707 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:00.707 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":128,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:58:00.387133+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:57:44.698445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-22T19:54:01.541706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-22T19:54:07.985692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-22T19:54:09.656252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-22T19:54:11.591758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-22T19:54:13.498929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-22T19:54:15.382119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-22T19:54:17.508620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:58:00.724 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-22T19:58:00.724 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:58:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:01.011 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":128,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:58:00.387133+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:57:44.698445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-22T19:54:01.541706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-22T19:54:07.985692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-22T19:54:09.656252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-22T19:54:11.591758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-22T19:54:13.498929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-22T19:54:15.382119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-22T19:54:17.508620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:58:01.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-22T19:58:01.031 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-22T19:58:01.031 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-22T19:58:01.031 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-22T19:58:01.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-22T19:58:01.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-22T19:58:01.033 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-22T19:58:01.033 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-22T19:58:01.276 INFO:teuthology.orchestra.run.smithi111.stdout:55834574903 2024-04-22T19:58:01.276 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T19:58:01.298 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:01.299 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:01.299 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T19:58:01.300 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T19:58:01.301 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:01.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T19:58:01.303 INFO:teuthology.orchestra.run.smithi111.stdout:55834574903 2024-04-22T19:58:01.303 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T19:58:01.305 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:01.305 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T19:58:01.306 INFO:teuthology.orchestra.run.smithi111.stdout:55834574901 2024-04-22T19:58:01.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T19:58:01.329 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:01.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T19:58:01.763 INFO:teuthology.orchestra.run.smithi111.stdout:55834574900 2024-04-22T19:58:01.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574900 for osd.6 2024-04-22T19:58:01.807 INFO:teuthology.orchestra.run.smithi111.stdout:55834574900 2024-04-22T19:58:01.820 INFO:teuthology.orchestra.run.smithi111.stdout:55834574901 2024-04-22T19:58:01.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574900 for osd.3 2024-04-22T19:58:01.836 INFO:teuthology.orchestra.run.smithi111.stdout:55834574900 2024-04-22T19:58:01.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574901 for osd.0 2024-04-22T19:58:01.849 INFO:teuthology.orchestra.run.smithi111.stdout:55834574899 2024-04-22T19:58:01.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574900 for osd.1 2024-04-22T19:58:01.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574899 for osd.2 2024-04-22T19:58:01.878 INFO:teuthology.orchestra.run.smithi111.stdout:55834574901 2024-04-22T19:58:01.880 INFO:teuthology.orchestra.run.smithi111.stdout:55834574900 2024-04-22T19:58:01.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574900 for osd.7 2024-04-22T19:58:01.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574901 for osd.5 2024-04-22T19:58:01.909 INFO:teuthology.orchestra.run.smithi111.stdout:55834574900 2024-04-22T19:58:01.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574900 for osd.4 2024-04-22T19:58:02.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T19:58:02.826 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T19:58:02.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T19:58:02.857 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T19:58:02.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T19:58:02.900 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T19:58:02.903 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T19:58:02.927 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T19:58:03.286 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:03.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.6 2024-04-22T19:58:03.314 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.329 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:03.352 INFO:teuthology.orchestra.run.smithi111.stdout:55834574901 2024-04-22T19:58:03.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.3 2024-04-22T19:58:03.354 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.368 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:03.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.2 2024-04-22T19:58:03.372 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.1 2024-04-22T19:58:03.388 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.400 INFO:teuthology.orchestra.run.smithi111.stdout:55834574903 2024-04-22T19:58:03.418 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:03.420 INFO:teuthology.orchestra.run.smithi111.stdout:55834574903 2024-04-22T19:58:03.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574903 for osd.0 2024-04-22T19:58:03.426 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.7 2024-04-22T19:58:03.439 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574903 for osd.5 2024-04-22T19:58:03.440 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.459 INFO:teuthology.orchestra.run.smithi111.stdout:55834574902 2024-04-22T19:58:03.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.4 2024-04-22T19:58:03.476 DEBUG:teuthology.parallel:result is None 2024-04-22T19:58:03.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-22T19:58:03.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:03.854 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:03.862 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-22T19:58:03.422743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823914,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3066,"num_read_kb":2749,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3901,"ondisk_log_size":3901,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12601280,"kb_used_data":12318548,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":742373440,"statfs":{"total":773094113280,"available":760190402560,"internally_reserved":0,"allocated":12614193152,"data_stored":12608822089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002924"},"pg_stats":[{"pgid":"3.3f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487868+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:00.487868+0000","last_peered":"2024-04-22T19:58:00.487868+0000","last_clean":"2024-04-22T19:58:00.487868+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:00.487868+0000","last_undegraded":"2024-04-22T19:58:00.487868+0000","last_fullsized":"2024-04-22T19:58:00.487868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'18","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404530+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:00.404530+0000","last_peered":"2024-04-22T19:58:00.404530+0000","last_clean":"2024-04-22T19:58:00.404530+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:00.404530+0000","last_undegraded":"2024-04-22T19:58:00.404530+0000","last_fullsized":"2024-04-22T19:58:00.404530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405121+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:00.405121+0000","last_peered":"2024-04-22T19:58:00.405121+0000","last_clean":"2024-04-22T19:58:00.405121+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:00.405121+0000","last_undegraded":"2024-04-22T19:58:00.405121+0000","last_fullsized":"2024-04-22T19:58:00.405121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'23","reported_seq":309,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491786+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:00.491786+0000","last_peered":"2024-04-22T19:58:00.491786+0000","last_clean":"2024-04-22T19:58:00.491786+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:00.491786+0000","last_undegraded":"2024-04-22T19:58:00.491786+0000","last_fullsized":"2024-04-22T19:58:00.491786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403422+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403422+0000","last_peered":"2024-04-22T19:58:00.403422+0000","last_clean":"2024-04-22T19:58:00.403422+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403422+0000","last_undegraded":"2024-04-22T19:58:00.403422+0000","last_fullsized":"2024-04-22T19:58:00.403422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'28","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489291+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:00.489291+0000","last_peered":"2024-04-22T19:58:00.489291+0000","last_clean":"2024-04-22T19:58:00.489291+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:00.489291+0000","last_undegraded":"2024-04-22T19:58:00.489291+0000","last_fullsized":"2024-04-22T19:58:00.489291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490825+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490825+0000","last_peered":"2024-04-22T19:58:00.490825+0000","last_clean":"2024-04-22T19:58:00.490825+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490825+0000","last_undegraded":"2024-04-22T19:58:00.490825+0000","last_fullsized":"2024-04-22T19:58:00.490825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'11","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489417+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:00.489417+0000","last_peered":"2024-04-22T19:58:00.489417+0000","last_clean":"2024-04-22T19:58:00.489417+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:00.489417+0000","last_undegraded":"2024-04-22T19:58:00.489417+0000","last_fullsized":"2024-04-22T19:58:00.489417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'23","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486624+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:00.486624+0000","last_peered":"2024-04-22T19:58:00.486624+0000","last_clean":"2024-04-22T19:58:00.486624+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:00.486624+0000","last_undegraded":"2024-04-22T19:58:00.486624+0000","last_fullsized":"2024-04-22T19:58:00.486624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485363+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:00.485363+0000","last_peered":"2024-04-22T19:58:00.485363+0000","last_clean":"2024-04-22T19:58:00.485363+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:00.485363+0000","last_undegraded":"2024-04-22T19:58:00.485363+0000","last_fullsized":"2024-04-22T19:58:00.485363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'16","reported_seq":128,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487089+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:00.487089+0000","last_peered":"2024-04-22T19:58:00.487089+0000","last_clean":"2024-04-22T19:58:00.487089+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:00.487089+0000","last_undegraded":"2024-04-22T19:58:00.487089+0000","last_fullsized":"2024-04-22T19:58:00.487089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493301+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:00.493301+0000","last_peered":"2024-04-22T19:58:00.493301+0000","last_clean":"2024-04-22T19:58:00.493301+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:00.493301+0000","last_undegraded":"2024-04-22T19:58:00.493301+0000","last_fullsized":"2024-04-22T19:58:00.493301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493680+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:00.493680+0000","last_peered":"2024-04-22T19:58:00.493680+0000","last_clean":"2024-04-22T19:58:00.493680+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:00.493680+0000","last_undegraded":"2024-04-22T19:58:00.493680+0000","last_fullsized":"2024-04-22T19:58:00.493680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'21","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402285+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:00.402285+0000","last_peered":"2024-04-22T19:58:00.402285+0000","last_clean":"2024-04-22T19:58:00.402285+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:00.402285+0000","last_undegraded":"2024-04-22T19:58:00.402285+0000","last_fullsized":"2024-04-22T19:58:00.402285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'32","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403823+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:00.403823+0000","last_peered":"2024-04-22T19:58:00.403823+0000","last_clean":"2024-04-22T19:58:00.403823+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:00.403823+0000","last_undegraded":"2024-04-22T19:58:00.403823+0000","last_fullsized":"2024-04-22T19:58:00.403823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'27","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489495+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:00.489495+0000","last_peered":"2024-04-22T19:58:00.489495+0000","last_clean":"2024-04-22T19:58:00.489495+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:00.489495+0000","last_undegraded":"2024-04-22T19:58:00.489495+0000","last_fullsized":"2024-04-22T19:58:00.489495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405197+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:00.405197+0000","last_peered":"2024-04-22T19:58:00.405197+0000","last_clean":"2024-04-22T19:58:00.405197+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:00.405197+0000","last_undegraded":"2024-04-22T19:58:00.405197+0000","last_fullsized":"2024-04-22T19:58:00.405197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'27","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403836+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:00.403836+0000","last_peered":"2024-04-22T19:58:00.403836+0000","last_clean":"2024-04-22T19:58:00.403836+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:00.403836+0000","last_undegraded":"2024-04-22T19:58:00.403836+0000","last_fullsized":"2024-04-22T19:58:00.403836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":47,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487480+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:00.487480+0000","last_peered":"2024-04-22T19:58:00.487480+0000","last_clean":"2024-04-22T19:58:00.487480+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:00.487480+0000","last_undegraded":"2024-04-22T19:58:00.487480+0000","last_fullsized":"2024-04-22T19:58:00.487480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403429+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403429+0000","last_peered":"2024-04-22T19:58:00.403429+0000","last_clean":"2024-04-22T19:58:00.403429+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403429+0000","last_undegraded":"2024-04-22T19:58:00.403429+0000","last_fullsized":"2024-04-22T19:58:00.403429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405797+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405797+0000","last_peered":"2024-04-22T19:58:00.405797+0000","last_clean":"2024-04-22T19:58:00.405797+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405797+0000","last_undegraded":"2024-04-22T19:58:00.405797+0000","last_fullsized":"2024-04-22T19:58:00.405797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:03.662478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486690+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:00.486690+0000","last_peered":"2024-04-22T19:58:00.486690+0000","last_clean":"2024-04-22T19:58:00.486690+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:00.486690+0000","last_undegraded":"2024-04-22T19:58:00.486690+0000","last_fullsized":"2024-04-22T19:58:00.486690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'134","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487245+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:00.487245+0000","last_peered":"2024-04-22T19:58:00.487245+0000","last_clean":"2024-04-22T19:58:00.487245+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:00.487245+0000","last_undegraded":"2024-04-22T19:58:00.487245+0000","last_fullsized":"2024-04-22T19:58:00.487245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'30","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490735+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:00.490735+0000","last_peered":"2024-04-22T19:58:00.490735+0000","last_clean":"2024-04-22T19:58:00.490735+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:00.490735+0000","last_undegraded":"2024-04-22T19:58:00.490735+0000","last_fullsized":"2024-04-22T19:58:00.490735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'18","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487740+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:00.487740+0000","last_peered":"2024-04-22T19:58:00.487740+0000","last_clean":"2024-04-22T19:58:00.487740+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:00.487740+0000","last_undegraded":"2024-04-22T19:58:00.487740+0000","last_fullsized":"2024-04-22T19:58:00.487740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'140","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487274+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:00.487274+0000","last_peered":"2024-04-22T19:58:00.487274+0000","last_clean":"2024-04-22T19:58:00.487274+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:00.487274+0000","last_undegraded":"2024-04-22T19:58:00.487274+0000","last_fullsized":"2024-04-22T19:58:00.487274+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488107+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:00.488107+0000","last_peered":"2024-04-22T19:58:00.488107+0000","last_clean":"2024-04-22T19:58:00.488107+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:00.488107+0000","last_undegraded":"2024-04-22T19:58:00.488107+0000","last_fullsized":"2024-04-22T19:58:00.488107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487464+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:00.487464+0000","last_peered":"2024-04-22T19:58:00.487464+0000","last_clean":"2024-04-22T19:58:00.487464+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:00.487464+0000","last_undegraded":"2024-04-22T19:58:00.487464+0000","last_fullsized":"2024-04-22T19:58:00.487464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399938+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.399938+0000","last_peered":"2024-04-22T19:58:00.399938+0000","last_clean":"2024-04-22T19:58:00.399938+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.399938+0000","last_undegraded":"2024-04-22T19:58:00.399938+0000","last_fullsized":"2024-04-22T19:58:00.399938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'30","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487876+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:00.487876+0000","last_peered":"2024-04-22T19:58:00.487876+0000","last_clean":"2024-04-22T19:58:00.487876+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:00.487876+0000","last_undegraded":"2024-04-22T19:58:00.487876+0000","last_fullsized":"2024-04-22T19:58:00.487876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'17","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486948+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:00.486948+0000","last_peered":"2024-04-22T19:58:00.486948+0000","last_clean":"2024-04-22T19:58:00.486948+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:00.486948+0000","last_undegraded":"2024-04-22T19:58:00.486948+0000","last_fullsized":"2024-04-22T19:58:00.486948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'25","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489043+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:00.489043+0000","last_peered":"2024-04-22T19:58:00.489043+0000","last_clean":"2024-04-22T19:58:00.489043+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:00.489043+0000","last_undegraded":"2024-04-22T19:58:00.489043+0000","last_fullsized":"2024-04-22T19:58:00.489043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'24","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486021+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:00.486021+0000","last_peered":"2024-04-22T19:58:00.486021+0000","last_clean":"2024-04-22T19:58:00.486021+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:00.486021+0000","last_undegraded":"2024-04-22T19:58:00.486021+0000","last_fullsized":"2024-04-22T19:58:00.486021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'134","reported_seq":388,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402809+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:00.402809+0000","last_peered":"2024-04-22T19:58:00.402809+0000","last_clean":"2024-04-22T19:58:00.402809+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:00.402809+0000","last_undegraded":"2024-04-22T19:58:00.402809+0000","last_fullsized":"2024-04-22T19:58:00.402809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405362+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405362+0000","last_peered":"2024-04-22T19:58:00.405362+0000","last_clean":"2024-04-22T19:58:00.405362+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405362+0000","last_undegraded":"2024-04-22T19:58:00.405362+0000","last_fullsized":"2024-04-22T19:58:00.405362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404257+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404257+0000","last_peered":"2024-04-22T19:58:00.404257+0000","last_clean":"2024-04-22T19:58:00.404257+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404257+0000","last_undegraded":"2024-04-22T19:58:00.404257+0000","last_fullsized":"2024-04-22T19:58:00.404257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'25","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492146+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:00.492146+0000","last_peered":"2024-04-22T19:58:00.492146+0000","last_clean":"2024-04-22T19:58:00.492146+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:00.492146+0000","last_undegraded":"2024-04-22T19:58:00.492146+0000","last_fullsized":"2024-04-22T19:58:00.492146+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'30","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403345+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:00.403345+0000","last_peered":"2024-04-22T19:58:00.403345+0000","last_clean":"2024-04-22T19:58:00.403345+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:00.403345+0000","last_undegraded":"2024-04-22T19:58:00.403345+0000","last_fullsized":"2024-04-22T19:58:00.403345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403953+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.403953+0000","last_peered":"2024-04-22T19:58:00.403953+0000","last_clean":"2024-04-22T19:58:00.403953+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.403953+0000","last_undegraded":"2024-04-22T19:58:00.403953+0000","last_fullsized":"2024-04-22T19:58:00.403953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:23.427873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486634+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:00.486634+0000","last_peered":"2024-04-22T19:58:00.486634+0000","last_clean":"2024-04-22T19:58:00.486634+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:00.486634+0000","last_undegraded":"2024-04-22T19:58:00.486634+0000","last_fullsized":"2024-04-22T19:58:00.486634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'19","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404161+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:00.404161+0000","last_peered":"2024-04-22T19:58:00.404161+0000","last_clean":"2024-04-22T19:58:00.404161+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:00.404161+0000","last_undegraded":"2024-04-22T19:58:00.404161+0000","last_fullsized":"2024-04-22T19:58:00.404161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405099+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405099+0000","last_peered":"2024-04-22T19:58:00.405099+0000","last_clean":"2024-04-22T19:58:00.405099+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405099+0000","last_undegraded":"2024-04-22T19:58:00.405099+0000","last_fullsized":"2024-04-22T19:58:00.405099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492958+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:00.492958+0000","last_peered":"2024-04-22T19:58:00.492958+0000","last_clean":"2024-04-22T19:58:00.492958+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:00.492958+0000","last_undegraded":"2024-04-22T19:58:00.492958+0000","last_fullsized":"2024-04-22T19:58:00.492958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402426+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402426+0000","last_peered":"2024-04-22T19:58:00.402426+0000","last_clean":"2024-04-22T19:58:00.402426+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402426+0000","last_undegraded":"2024-04-22T19:58:00.402426+0000","last_fullsized":"2024-04-22T19:58:00.402426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'23","reported_seq":286,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486495+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:00.486495+0000","last_peered":"2024-04-22T19:58:00.486495+0000","last_clean":"2024-04-22T19:58:00.486495+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:00.486495+0000","last_undegraded":"2024-04-22T19:58:00.486495+0000","last_fullsized":"2024-04-22T19:58:00.486495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'134","reported_seq":401,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485892+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:00.485892+0000","last_peered":"2024-04-22T19:58:00.485892+0000","last_clean":"2024-04-22T19:58:00.485892+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:00.485892+0000","last_undegraded":"2024-04-22T19:58:00.485892+0000","last_fullsized":"2024-04-22T19:58:00.485892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400977+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.400977+0000","last_peered":"2024-04-22T19:58:00.400977+0000","last_clean":"2024-04-22T19:58:00.400977+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.400977+0000","last_undegraded":"2024-04-22T19:58:00.400977+0000","last_fullsized":"2024-04-22T19:58:00.400977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'34","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401789+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:00.401789+0000","last_peered":"2024-04-22T19:58:00.401789+0000","last_clean":"2024-04-22T19:58:00.401789+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:00.401789+0000","last_undegraded":"2024-04-22T19:58:00.401789+0000","last_fullsized":"2024-04-22T19:58:00.401789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":396,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'134","reported_seq":433,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493094+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:00.493094+0000","last_peered":"2024-04-22T19:58:00.493094+0000","last_clean":"2024-04-22T19:58:00.493094+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:00.493094+0000","last_undegraded":"2024-04-22T19:58:00.493094+0000","last_fullsized":"2024-04-22T19:58:00.493094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"109'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485602+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:00.485602+0000","last_peered":"2024-04-22T19:58:00.485602+0000","last_clean":"2024-04-22T19:58:00.485602+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:00.485602+0000","last_undegraded":"2024-04-22T19:58:00.485602+0000","last_fullsized":"2024-04-22T19:58:00.485602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'26","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491674+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:00.491674+0000","last_peered":"2024-04-22T19:58:00.491674+0000","last_clean":"2024-04-22T19:58:00.491674+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:00.491674+0000","last_undegraded":"2024-04-22T19:58:00.491674+0000","last_fullsized":"2024-04-22T19:58:00.491674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399679+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399679+0000","last_peered":"2024-04-22T19:58:00.399679+0000","last_clean":"2024-04-22T19:58:00.399679+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399679+0000","last_undegraded":"2024-04-22T19:58:00.399679+0000","last_fullsized":"2024-04-22T19:58:00.399679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491504+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491504+0000","last_peered":"2024-04-22T19:58:00.491504+0000","last_clean":"2024-04-22T19:58:00.491504+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491504+0000","last_undegraded":"2024-04-22T19:58:00.491504+0000","last_fullsized":"2024-04-22T19:58:00.491504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":80,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486632+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:00.486632+0000","last_peered":"2024-04-22T19:58:00.486632+0000","last_clean":"2024-04-22T19:58:00.486632+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:00.486632+0000","last_undegraded":"2024-04-22T19:58:00.486632+0000","last_fullsized":"2024-04-22T19:58:00.486632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'37","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492246+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:00.492246+0000","last_peered":"2024-04-22T19:58:00.492246+0000","last_clean":"2024-04-22T19:58:00.492246+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:00.492246+0000","last_undegraded":"2024-04-22T19:58:00.492246+0000","last_fullsized":"2024-04-22T19:58:00.492246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405389+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405389+0000","last_peered":"2024-04-22T19:58:00.405389+0000","last_clean":"2024-04-22T19:58:00.405389+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405389+0000","last_undegraded":"2024-04-22T19:58:00.405389+0000","last_fullsized":"2024-04-22T19:58:00.405389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405703+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405703+0000","last_peered":"2024-04-22T19:58:00.405703+0000","last_clean":"2024-04-22T19:58:00.405703+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405703+0000","last_undegraded":"2024-04-22T19:58:00.405703+0000","last_fullsized":"2024-04-22T19:58:00.405703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485924+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485924+0000","last_peered":"2024-04-22T19:58:00.485924+0000","last_clean":"2024-04-22T19:58:00.485924+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485924+0000","last_undegraded":"2024-04-22T19:58:00.485924+0000","last_fullsized":"2024-04-22T19:58:00.485924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'20","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403486+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:00.403486+0000","last_peered":"2024-04-22T19:58:00.403486+0000","last_clean":"2024-04-22T19:58:00.403486+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:00.403486+0000","last_undegraded":"2024-04-22T19:58:00.403486+0000","last_fullsized":"2024-04-22T19:58:00.403486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'137","reported_seq":454,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402187+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:00.402187+0000","last_peered":"2024-04-22T19:58:00.402187+0000","last_clean":"2024-04-22T19:58:00.402187+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:00.402187+0000","last_undegraded":"2024-04-22T19:58:00.402187+0000","last_fullsized":"2024-04-22T19:58:00.402187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":163,"num_write":30,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399623+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399623+0000","last_peered":"2024-04-22T19:58:00.399623+0000","last_clean":"2024-04-22T19:58:00.399623+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399623+0000","last_undegraded":"2024-04-22T19:58:00.399623+0000","last_fullsized":"2024-04-22T19:58:00.399623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405126+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405126+0000","last_peered":"2024-04-22T19:58:00.405126+0000","last_clean":"2024-04-22T19:58:00.405126+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405126+0000","last_undegraded":"2024-04-22T19:58:00.405126+0000","last_fullsized":"2024-04-22T19:58:00.405126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":239,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485098+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485098+0000","last_peered":"2024-04-22T19:58:00.485098+0000","last_clean":"2024-04-22T19:58:00.485098+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485098+0000","last_undegraded":"2024-04-22T19:58:00.485098+0000","last_fullsized":"2024-04-22T19:58:00.485098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'22","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402549+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:00.402549+0000","last_peered":"2024-04-22T19:58:00.402549+0000","last_clean":"2024-04-22T19:58:00.402549+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:00.402549+0000","last_undegraded":"2024-04-22T19:58:00.402549+0000","last_fullsized":"2024-04-22T19:58:00.402549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":306,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486116+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:00.486116+0000","last_peered":"2024-04-22T19:58:00.486116+0000","last_clean":"2024-04-22T19:58:00.486116+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:00.486116+0000","last_undegraded":"2024-04-22T19:58:00.486116+0000","last_fullsized":"2024-04-22T19:58:00.486116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":274,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488232+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:00.488232+0000","last_peered":"2024-04-22T19:58:00.488232+0000","last_clean":"2024-04-22T19:58:00.488232+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:00.488232+0000","last_undegraded":"2024-04-22T19:58:00.488232+0000","last_fullsized":"2024-04-22T19:58:00.488232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403797+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403797+0000","last_peered":"2024-04-22T19:58:00.403797+0000","last_clean":"2024-04-22T19:58:00.403797+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403797+0000","last_undegraded":"2024-04-22T19:58:00.403797+0000","last_fullsized":"2024-04-22T19:58:00.403797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402931+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.402931+0000","last_peered":"2024-04-22T19:58:00.402931+0000","last_clean":"2024-04-22T19:58:00.402931+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.402931+0000","last_undegraded":"2024-04-22T19:58:00.402931+0000","last_fullsized":"2024-04-22T19:58:00.402931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491149+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491149+0000","last_peered":"2024-04-22T19:58:00.491149+0000","last_clean":"2024-04-22T19:58:00.491149+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491149+0000","last_undegraded":"2024-04-22T19:58:00.491149+0000","last_fullsized":"2024-04-22T19:58:00.491149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403427+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:00.403427+0000","last_peered":"2024-04-22T19:58:00.403427+0000","last_clean":"2024-04-22T19:58:00.403427+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:00.403427+0000","last_undegraded":"2024-04-22T19:58:00.403427+0000","last_fullsized":"2024-04-22T19:58:00.403427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404832+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404832+0000","last_peered":"2024-04-22T19:58:00.404832+0000","last_clean":"2024-04-22T19:58:00.404832+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404832+0000","last_undegraded":"2024-04-22T19:58:00.404832+0000","last_fullsized":"2024-04-22T19:58:00.404832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400634+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400634+0000","last_peered":"2024-04-22T19:58:00.400634+0000","last_clean":"2024-04-22T19:58:00.400634+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400634+0000","last_undegraded":"2024-04-22T19:58:00.400634+0000","last_fullsized":"2024-04-22T19:58:00.400634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'18","reported_seq":298,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492228+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:00.492228+0000","last_peered":"2024-04-22T19:58:00.492228+0000","last_clean":"2024-04-22T19:58:00.492228+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:00.492228+0000","last_undegraded":"2024-04-22T19:58:00.492228+0000","last_fullsized":"2024-04-22T19:58:00.492228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403589+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:00.403589+0000","last_peered":"2024-04-22T19:58:00.403589+0000","last_clean":"2024-04-22T19:58:00.403589+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:00.403589+0000","last_undegraded":"2024-04-22T19:58:00.403589+0000","last_fullsized":"2024-04-22T19:58:00.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403696+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403696+0000","last_peered":"2024-04-22T19:58:00.403696+0000","last_clean":"2024-04-22T19:58:00.403696+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403696+0000","last_undegraded":"2024-04-22T19:58:00.403696+0000","last_fullsized":"2024-04-22T19:58:00.403696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'35","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399220+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:00.399220+0000","last_peered":"2024-04-22T19:58:00.399220+0000","last_clean":"2024-04-22T19:58:00.399220+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.399220+0000","last_undegraded":"2024-04-22T19:58:00.399220+0000","last_fullsized":"2024-04-22T19:58:00.399220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:38.161593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404915+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404915+0000","last_peered":"2024-04-22T19:58:00.404915+0000","last_clean":"2024-04-22T19:58:00.404915+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404915+0000","last_undegraded":"2024-04-22T19:58:00.404915+0000","last_fullsized":"2024-04-22T19:58:00.404915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404153+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404153+0000","last_peered":"2024-04-22T19:58:00.404153+0000","last_clean":"2024-04-22T19:58:00.404153+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404153+0000","last_undegraded":"2024-04-22T19:58:00.404153+0000","last_fullsized":"2024-04-22T19:58:00.404153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403175+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:00.403175+0000","last_peered":"2024-04-22T19:58:00.403175+0000","last_clean":"2024-04-22T19:58:00.403175+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:00.403175+0000","last_undegraded":"2024-04-22T19:58:00.403175+0000","last_fullsized":"2024-04-22T19:58:00.403175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489726+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489726+0000","last_peered":"2024-04-22T19:58:00.489726+0000","last_clean":"2024-04-22T19:58:00.489726+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489726+0000","last_undegraded":"2024-04-22T19:58:00.489726+0000","last_fullsized":"2024-04-22T19:58:00.489726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400210+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400210+0000","last_peered":"2024-04-22T19:58:00.400210+0000","last_clean":"2024-04-22T19:58:00.400210+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400210+0000","last_undegraded":"2024-04-22T19:58:00.400210+0000","last_fullsized":"2024-04-22T19:58:00.400210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'134","reported_seq":387,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488401+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:00.488401+0000","last_peered":"2024-04-22T19:58:00.488401+0000","last_clean":"2024-04-22T19:58:00.488401+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:00.488401+0000","last_undegraded":"2024-04-22T19:58:00.488401+0000","last_fullsized":"2024-04-22T19:58:00.488401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'16","reported_seq":72,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487578+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:00.487578+0000","last_peered":"2024-04-22T19:58:00.487578+0000","last_clean":"2024-04-22T19:58:00.487578+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:00.487578+0000","last_undegraded":"2024-04-22T19:58:00.487578+0000","last_fullsized":"2024-04-22T19:58:00.487578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404614+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404614+0000","last_peered":"2024-04-22T19:58:00.404614+0000","last_clean":"2024-04-22T19:58:00.404614+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404614+0000","last_undegraded":"2024-04-22T19:58:00.404614+0000","last_fullsized":"2024-04-22T19:58:00.404614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"121'140","reported_seq":463,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487326+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:00.487326+0000","last_peered":"2024-04-22T19:58:00.487326+0000","last_clean":"2024-04-22T19:58:00.487326+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:00.487326+0000","last_undegraded":"2024-04-22T19:58:00.487326+0000","last_fullsized":"2024-04-22T19:58:00.487326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404604+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404604+0000","last_peered":"2024-04-22T19:58:00.404604+0000","last_clean":"2024-04-22T19:58:00.404604+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404604+0000","last_undegraded":"2024-04-22T19:58:00.404604+0000","last_fullsized":"2024-04-22T19:58:00.404604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:39.990552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405842+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:00.405842+0000","last_peered":"2024-04-22T19:58:00.405842+0000","last_clean":"2024-04-22T19:58:00.405842+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:00.405842+0000","last_undegraded":"2024-04-22T19:58:00.405842+0000","last_fullsized":"2024-04-22T19:58:00.405842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'45","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488495+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:00.488495+0000","last_peered":"2024-04-22T19:58:00.488495+0000","last_clean":"2024-04-22T19:58:00.488495+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:00.488495+0000","last_undegraded":"2024-04-22T19:58:00.488495+0000","last_fullsized":"2024-04-22T19:58:00.488495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404977+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.404977+0000","last_peered":"2024-04-22T19:58:00.404977+0000","last_clean":"2024-04-22T19:58:00.404977+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.404977+0000","last_undegraded":"2024-04-22T19:58:00.404977+0000","last_fullsized":"2024-04-22T19:58:00.404977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402134+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:00.402134+0000","last_peered":"2024-04-22T19:58:00.402134+0000","last_clean":"2024-04-22T19:58:00.402134+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:00.402134+0000","last_undegraded":"2024-04-22T19:58:00.402134+0000","last_fullsized":"2024-04-22T19:58:00.402134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401039+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401039+0000","last_peered":"2024-04-22T19:58:00.401039+0000","last_clean":"2024-04-22T19:58:00.401039+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401039+0000","last_undegraded":"2024-04-22T19:58:00.401039+0000","last_fullsized":"2024-04-22T19:58:00.401039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485520+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:00.485520+0000","last_peered":"2024-04-22T19:58:00.485520+0000","last_clean":"2024-04-22T19:58:00.485520+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:00.485520+0000","last_undegraded":"2024-04-22T19:58:00.485520+0000","last_fullsized":"2024-04-22T19:58:00.485520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400380+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400380+0000","last_peered":"2024-04-22T19:58:00.400380+0000","last_clean":"2024-04-22T19:58:00.400380+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400380+0000","last_undegraded":"2024-04-22T19:58:00.400380+0000","last_fullsized":"2024-04-22T19:58:00.400380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'29","reported_seq":335,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488786+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:00.488786+0000","last_peered":"2024-04-22T19:58:00.488786+0000","last_clean":"2024-04-22T19:58:00.488786+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:00.488786+0000","last_undegraded":"2024-04-22T19:58:00.488786+0000","last_fullsized":"2024-04-22T19:58:00.488786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398955+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.398955+0000","last_peered":"2024-04-22T19:58:00.398955+0000","last_clean":"2024-04-22T19:58:00.398955+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.398955+0000","last_undegraded":"2024-04-22T19:58:00.398955+0000","last_fullsized":"2024-04-22T19:58:00.398955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404670+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404670+0000","last_peered":"2024-04-22T19:58:00.404670+0000","last_clean":"2024-04-22T19:58:00.404670+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404670+0000","last_undegraded":"2024-04-22T19:58:00.404670+0000","last_fullsized":"2024-04-22T19:58:00.404670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492364+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:00.492364+0000","last_peered":"2024-04-22T19:58:00.492364+0000","last_clean":"2024-04-22T19:58:00.492364+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:00.492364+0000","last_undegraded":"2024-04-22T19:58:00.492364+0000","last_fullsized":"2024-04-22T19:58:00.492364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486681+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:00.486681+0000","last_peered":"2024-04-22T19:58:00.486681+0000","last_clean":"2024-04-22T19:58:00.486681+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:00.486681+0000","last_undegraded":"2024-04-22T19:58:00.486681+0000","last_fullsized":"2024-04-22T19:58:00.486681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'17","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405364+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:00.405364+0000","last_peered":"2024-04-22T19:58:00.405364+0000","last_clean":"2024-04-22T19:58:00.405364+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:00.405364+0000","last_undegraded":"2024-04-22T19:58:00.405364+0000","last_fullsized":"2024-04-22T19:58:00.405364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'17","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486240+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:00.486240+0000","last_peered":"2024-04-22T19:58:00.486240+0000","last_clean":"2024-04-22T19:58:00.486240+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:00.486240+0000","last_undegraded":"2024-04-22T19:58:00.486240+0000","last_fullsized":"2024-04-22T19:58:00.486240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403251+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403251+0000","last_peered":"2024-04-22T19:58:00.403251+0000","last_clean":"2024-04-22T19:58:00.403251+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403251+0000","last_undegraded":"2024-04-22T19:58:00.403251+0000","last_fullsized":"2024-04-22T19:58:00.403251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485805+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:00.485805+0000","last_peered":"2024-04-22T19:58:00.485805+0000","last_clean":"2024-04-22T19:58:00.485805+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:00.485805+0000","last_undegraded":"2024-04-22T19:58:00.485805+0000","last_fullsized":"2024-04-22T19:58:00.485805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405531+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:00.405531+0000","last_peered":"2024-04-22T19:58:00.405531+0000","last_clean":"2024-04-22T19:58:00.405531+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:00.405531+0000","last_undegraded":"2024-04-22T19:58:00.405531+0000","last_fullsized":"2024-04-22T19:58:00.405531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400696+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:00.400696+0000","last_peered":"2024-04-22T19:58:00.400696+0000","last_clean":"2024-04-22T19:58:00.400696+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:00.400696+0000","last_undegraded":"2024-04-22T19:58:00.400696+0000","last_fullsized":"2024-04-22T19:58:00.400696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405635+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:00.405635+0000","last_peered":"2024-04-22T19:58:00.405635+0000","last_clean":"2024-04-22T19:58:00.405635+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:00.405635+0000","last_undegraded":"2024-04-22T19:58:00.405635+0000","last_fullsized":"2024-04-22T19:58:00.405635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'22","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401881+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:00.401881+0000","last_peered":"2024-04-22T19:58:00.401881+0000","last_clean":"2024-04-22T19:58:00.401881+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:00.401881+0000","last_undegraded":"2024-04-22T19:58:00.401881+0000","last_fullsized":"2024-04-22T19:58:00.401881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:59.453198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'23","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486786+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:00.486786+0000","last_peered":"2024-04-22T19:58:00.486786+0000","last_clean":"2024-04-22T19:58:00.486786+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:00.486786+0000","last_undegraded":"2024-04-22T19:58:00.486786+0000","last_fullsized":"2024-04-22T19:58:00.486786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401214+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401214+0000","last_peered":"2024-04-22T19:58:00.401214+0000","last_clean":"2024-04-22T19:58:00.401214+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401214+0000","last_undegraded":"2024-04-22T19:58:00.401214+0000","last_fullsized":"2024-04-22T19:58:00.401214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'20","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402622+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:00.402622+0000","last_peered":"2024-04-22T19:58:00.402622+0000","last_clean":"2024-04-22T19:58:00.402622+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:00.402622+0000","last_undegraded":"2024-04-22T19:58:00.402622+0000","last_fullsized":"2024-04-22T19:58:00.402622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487530+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:00.487530+0000","last_peered":"2024-04-22T19:58:00.487530+0000","last_clean":"2024-04-22T19:58:00.487530+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:00.487530+0000","last_undegraded":"2024-04-22T19:58:00.487530+0000","last_fullsized":"2024-04-22T19:58:00.487530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399918+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.399918+0000","last_peered":"2024-04-22T19:58:00.399918+0000","last_clean":"2024-04-22T19:58:00.399918+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.399918+0000","last_undegraded":"2024-04-22T19:58:00.399918+0000","last_fullsized":"2024-04-22T19:58:00.399918+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:49:58.016491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403254+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:00.403254+0000","last_peered":"2024-04-22T19:58:00.403254+0000","last_clean":"2024-04-22T19:58:00.403254+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:00.403254+0000","last_undegraded":"2024-04-22T19:58:00.403254+0000","last_fullsized":"2024-04-22T19:58:00.403254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401713+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401713+0000","last_peered":"2024-04-22T19:58:00.401713+0000","last_clean":"2024-04-22T19:58:00.401713+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401713+0000","last_undegraded":"2024-04-22T19:58:00.401713+0000","last_fullsized":"2024-04-22T19:58:00.401713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'134","reported_seq":415,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493420+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:00.493420+0000","last_peered":"2024-04-22T19:58:00.493420+0000","last_clean":"2024-04-22T19:58:00.493420+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:00.493420+0000","last_undegraded":"2024-04-22T19:58:00.493420+0000","last_fullsized":"2024-04-22T19:58:00.493420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488771+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:00.488771+0000","last_peered":"2024-04-22T19:58:00.488771+0000","last_clean":"2024-04-22T19:58:00.488771+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:00.488771+0000","last_undegraded":"2024-04-22T19:58:00.488771+0000","last_fullsized":"2024-04-22T19:58:00.488771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398468+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398468+0000","last_peered":"2024-04-22T19:58:00.398468+0000","last_clean":"2024-04-22T19:58:00.398468+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398468+0000","last_undegraded":"2024-04-22T19:58:00.398468+0000","last_fullsized":"2024-04-22T19:58:00.398468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492192+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:00.492192+0000","last_peered":"2024-04-22T19:58:00.492192+0000","last_clean":"2024-04-22T19:58:00.492192+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:00.492192+0000","last_undegraded":"2024-04-22T19:58:00.492192+0000","last_fullsized":"2024-04-22T19:58:00.492192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398675+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:00.398675+0000","last_peered":"2024-04-22T19:58:00.398675+0000","last_clean":"2024-04-22T19:58:00.398675+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:00.398675+0000","last_undegraded":"2024-04-22T19:58:00.398675+0000","last_fullsized":"2024-04-22T19:58:00.398675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'13","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487401+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:00.487401+0000","last_peered":"2024-04-22T19:58:00.487401+0000","last_clean":"2024-04-22T19:58:00.487401+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:00.487401+0000","last_undegraded":"2024-04-22T19:58:00.487401+0000","last_fullsized":"2024-04-22T19:58:00.487401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'23","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405337+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:00.405337+0000","last_peered":"2024-04-22T19:58:00.405337+0000","last_clean":"2024-04-22T19:58:00.405337+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:00.405337+0000","last_undegraded":"2024-04-22T19:58:00.405337+0000","last_fullsized":"2024-04-22T19:58:00.405337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400493+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400493+0000","last_peered":"2024-04-22T19:58:00.400493+0000","last_clean":"2024-04-22T19:58:00.400493+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400493+0000","last_undegraded":"2024-04-22T19:58:00.400493+0000","last_fullsized":"2024-04-22T19:58:00.400493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401679+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:00.401679+0000","last_peered":"2024-04-22T19:58:00.401679+0000","last_clean":"2024-04-22T19:58:00.401679+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:00.401679+0000","last_undegraded":"2024-04-22T19:58:00.401679+0000","last_fullsized":"2024-04-22T19:58:00.401679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403081+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403081+0000","last_peered":"2024-04-22T19:58:00.403081+0000","last_clean":"2024-04-22T19:58:00.403081+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403081+0000","last_undegraded":"2024-04-22T19:58:00.403081+0000","last_fullsized":"2024-04-22T19:58:00.403081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405057+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405057+0000","last_peered":"2024-04-22T19:58:00.405057+0000","last_clean":"2024-04-22T19:58:00.405057+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405057+0000","last_undegraded":"2024-04-22T19:58:00.405057+0000","last_fullsized":"2024-04-22T19:58:00.405057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490506+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:00.490506+0000","last_peered":"2024-04-22T19:58:00.490506+0000","last_clean":"2024-04-22T19:58:00.490506+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:00.490506+0000","last_undegraded":"2024-04-22T19:58:00.490506+0000","last_fullsized":"2024-04-22T19:58:00.490506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404333+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404333+0000","last_peered":"2024-04-22T19:58:00.404333+0000","last_clean":"2024-04-22T19:58:00.404333+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404333+0000","last_undegraded":"2024-04-22T19:58:00.404333+0000","last_fullsized":"2024-04-22T19:58:00.404333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484910+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:00.484910+0000","last_peered":"2024-04-22T19:58:00.484910+0000","last_clean":"2024-04-22T19:58:00.484910+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:00.484910+0000","last_undegraded":"2024-04-22T19:58:00.484910+0000","last_fullsized":"2024-04-22T19:58:00.484910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'23","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490973+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:00.490973+0000","last_peered":"2024-04-22T19:58:00.490973+0000","last_clean":"2024-04-22T19:58:00.490973+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:00.490973+0000","last_undegraded":"2024-04-22T19:58:00.490973+0000","last_fullsized":"2024-04-22T19:58:00.490973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403420+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403420+0000","last_peered":"2024-04-22T19:58:00.403420+0000","last_clean":"2024-04-22T19:58:00.403420+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403420+0000","last_undegraded":"2024-04-22T19:58:00.403420+0000","last_fullsized":"2024-04-22T19:58:00.403420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'16","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403555+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:00.403555+0000","last_peered":"2024-04-22T19:58:00.403555+0000","last_clean":"2024-04-22T19:58:00.403555+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:00.403555+0000","last_undegraded":"2024-04-22T19:58:00.403555+0000","last_fullsized":"2024-04-22T19:58:00.403555+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:54.651586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'31","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487609+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:00.487609+0000","last_peered":"2024-04-22T19:58:00.487609+0000","last_clean":"2024-04-22T19:58:00.487609+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:00.487609+0000","last_undegraded":"2024-04-22T19:58:00.487609+0000","last_fullsized":"2024-04-22T19:58:00.487609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'19","reported_seq":301,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402407+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:00.402407+0000","last_peered":"2024-04-22T19:58:00.402407+0000","last_clean":"2024-04-22T19:58:00.402407+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:00.402407+0000","last_undegraded":"2024-04-22T19:58:00.402407+0000","last_fullsized":"2024-04-22T19:58:00.402407+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:07.458707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493418+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:00.493418+0000","last_peered":"2024-04-22T19:58:00.493418+0000","last_clean":"2024-04-22T19:58:00.493418+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:00.493418+0000","last_undegraded":"2024-04-22T19:58:00.493418+0000","last_fullsized":"2024-04-22T19:58:00.493418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'18","reported_seq":76,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487784+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:00.487784+0000","last_peered":"2024-04-22T19:58:00.487784+0000","last_clean":"2024-04-22T19:58:00.487784+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:00.487784+0000","last_undegraded":"2024-04-22T19:58:00.487784+0000","last_fullsized":"2024-04-22T19:58:00.487784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405228+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405228+0000","last_peered":"2024-04-22T19:58:00.405228+0000","last_clean":"2024-04-22T19:58:00.405228+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405228+0000","last_undegraded":"2024-04-22T19:58:00.405228+0000","last_fullsized":"2024-04-22T19:58:00.405228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:23.329522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'27","reported_seq":325,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489055+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:00.489055+0000","last_peered":"2024-04-22T19:58:00.489055+0000","last_clean":"2024-04-22T19:58:00.489055+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:00.489055+0000","last_undegraded":"2024-04-22T19:58:00.489055+0000","last_fullsized":"2024-04-22T19:58:00.489055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'34","reported_seq":108,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485798+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:00.485798+0000","last_peered":"2024-04-22T19:58:00.485798+0000","last_clean":"2024-04-22T19:58:00.485798+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:00.485798+0000","last_undegraded":"2024-04-22T19:58:00.485798+0000","last_fullsized":"2024-04-22T19:58:00.485798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'36","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489673+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:00.489673+0000","last_peered":"2024-04-22T19:58:00.489673+0000","last_clean":"2024-04-22T19:58:00.489673+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:00.489673+0000","last_undegraded":"2024-04-22T19:58:00.489673+0000","last_fullsized":"2024-04-22T19:58:00.489673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'31","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403819+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:00.403819+0000","last_peered":"2024-04-22T19:58:00.403819+0000","last_clean":"2024-04-22T19:58:00.403819+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:00.403819+0000","last_undegraded":"2024-04-22T19:58:00.403819+0000","last_fullsized":"2024-04-22T19:58:00.403819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'29","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490942+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:00.490942+0000","last_peered":"2024-04-22T19:58:00.490942+0000","last_clean":"2024-04-22T19:58:00.490942+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:00.490942+0000","last_undegraded":"2024-04-22T19:58:00.490942+0000","last_fullsized":"2024-04-22T19:58:00.490942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403218+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403218+0000","last_peered":"2024-04-22T19:58:00.403218+0000","last_clean":"2024-04-22T19:58:00.403218+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403218+0000","last_undegraded":"2024-04-22T19:58:00.403218+0000","last_fullsized":"2024-04-22T19:58:00.403218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'22","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489472+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:00.489472+0000","last_peered":"2024-04-22T19:58:00.489472+0000","last_clean":"2024-04-22T19:58:00.489472+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:00.489472+0000","last_undegraded":"2024-04-22T19:58:00.489472+0000","last_fullsized":"2024-04-22T19:58:00.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486323+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:00.486323+0000","last_peered":"2024-04-22T19:58:00.486323+0000","last_clean":"2024-04-22T19:58:00.486323+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:00.486323+0000","last_undegraded":"2024-04-22T19:58:00.486323+0000","last_fullsized":"2024-04-22T19:58:00.486323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'28","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486127+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:00.486127+0000","last_peered":"2024-04-22T19:58:00.486127+0000","last_clean":"2024-04-22T19:58:00.486127+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:00.486127+0000","last_undegraded":"2024-04-22T19:58:00.486127+0000","last_fullsized":"2024-04-22T19:58:00.486127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"110'27","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488968+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:00.488968+0000","last_peered":"2024-04-22T19:58:00.488968+0000","last_clean":"2024-04-22T19:58:00.488968+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:00.488968+0000","last_undegraded":"2024-04-22T19:58:00.488968+0000","last_fullsized":"2024-04-22T19:58:00.488968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405158+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405158+0000","last_peered":"2024-04-22T19:58:00.405158+0000","last_clean":"2024-04-22T19:58:00.405158+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405158+0000","last_undegraded":"2024-04-22T19:58:00.405158+0000","last_fullsized":"2024-04-22T19:58:00.405158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401480+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:00.401480+0000","last_peered":"2024-04-22T19:58:00.401480+0000","last_clean":"2024-04-22T19:58:00.401480+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:00.401480+0000","last_undegraded":"2024-04-22T19:58:00.401480+0000","last_fullsized":"2024-04-22T19:58:00.401480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1084,"ondisk_log_size":1084,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386922,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":604,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":311,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1985180,"kb_used_data":1949840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92386660,"statfs":{"total":96636764160,"available":94603939840,"internally_reserved":0,"allocated":1996636160,"data_stored":1995943008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1243136,"kb_used_data":1211956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93128704,"statfs":{"total":96636764160,"available":95363792896,"internally_reserved":0,"allocated":1241042944,"data_stored":1240384017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775964,"kb_used_data":1740624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92595876,"statfs":{"total":96636764160,"available":94818177024,"internally_reserved":0,"allocated":1782398976,"data_stored":1781684417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1961980,"kb_used_data":1926636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92409860,"statfs":{"total":96636764160,"available":94627696640,"internally_reserved":0,"allocated":1972875264,"data_stored":1972231414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1892448,"kb_used_data":1852944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92479392,"statfs":{"total":96636764160,"available":94698897408,"internally_reserved":0,"allocated":1897414656,"data_stored":1896735122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948204,"kb_used_data":912864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93423636,"statfs":{"total":96636764160,"available":95665803264,"internally_reserved":0,"allocated":934772736,"data_stored":934133913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1034544,"kb_used_data":999204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93337296,"statfs":{"total":96636764160,"available":95577391104,"internally_reserved":0,"allocated":1023184896,"data_stored":1022505896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1759824,"kb_used_data":1724480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92612016,"statfs":{"total":96636764160,"available":94834704384,"internally_reserved":0,"allocated":1765867520,"data_stored":1765204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1763704832,"data_stored":1763704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1021313024,"data_stored":1021313024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933232640,"data_stored":933232640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1895825408,"data_stored":1895825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1971322880,"data_stored":1971322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1780482048,"data_stored":1780482048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239416832,"data_stored":1239416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1994391552,"data_stored":1994391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":293527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:03.872 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:04.220 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:04.229 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:04.249 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-22T19:58:03.422743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823914,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3066,"num_read_kb":2749,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3901,"ondisk_log_size":3901,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12601280,"kb_used_data":12318548,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":742373440,"statfs":{"total":773094113280,"available":760190402560,"internally_reserved":0,"allocated":12614193152,"data_stored":12608822089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002924"},"pg_stats":[{"pgid":"3.3f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487868+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:00.487868+0000","last_peered":"2024-04-22T19:58:00.487868+0000","last_clean":"2024-04-22T19:58:00.487868+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:00.487868+0000","last_undegraded":"2024-04-22T19:58:00.487868+0000","last_fullsized":"2024-04-22T19:58:00.487868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'18","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404530+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:00.404530+0000","last_peered":"2024-04-22T19:58:00.404530+0000","last_clean":"2024-04-22T19:58:00.404530+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:00.404530+0000","last_undegraded":"2024-04-22T19:58:00.404530+0000","last_fullsized":"2024-04-22T19:58:00.404530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405121+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:00.405121+0000","last_peered":"2024-04-22T19:58:00.405121+0000","last_clean":"2024-04-22T19:58:00.405121+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:00.405121+0000","last_undegraded":"2024-04-22T19:58:00.405121+0000","last_fullsized":"2024-04-22T19:58:00.405121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'23","reported_seq":309,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491786+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:00.491786+0000","last_peered":"2024-04-22T19:58:00.491786+0000","last_clean":"2024-04-22T19:58:00.491786+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:00.491786+0000","last_undegraded":"2024-04-22T19:58:00.491786+0000","last_fullsized":"2024-04-22T19:58:00.491786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403422+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403422+0000","last_peered":"2024-04-22T19:58:00.403422+0000","last_clean":"2024-04-22T19:58:00.403422+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403422+0000","last_undegraded":"2024-04-22T19:58:00.403422+0000","last_fullsized":"2024-04-22T19:58:00.403422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'28","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489291+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:00.489291+0000","last_peered":"2024-04-22T19:58:00.489291+0000","last_clean":"2024-04-22T19:58:00.489291+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:00.489291+0000","last_undegraded":"2024-04-22T19:58:00.489291+0000","last_fullsized":"2024-04-22T19:58:00.489291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490825+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490825+0000","last_peered":"2024-04-22T19:58:00.490825+0000","last_clean":"2024-04-22T19:58:00.490825+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490825+0000","last_undegraded":"2024-04-22T19:58:00.490825+0000","last_fullsized":"2024-04-22T19:58:00.490825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'11","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489417+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:00.489417+0000","last_peered":"2024-04-22T19:58:00.489417+0000","last_clean":"2024-04-22T19:58:00.489417+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:00.489417+0000","last_undegraded":"2024-04-22T19:58:00.489417+0000","last_fullsized":"2024-04-22T19:58:00.489417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'23","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486624+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:00.486624+0000","last_peered":"2024-04-22T19:58:00.486624+0000","last_clean":"2024-04-22T19:58:00.486624+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:00.486624+0000","last_undegraded":"2024-04-22T19:58:00.486624+0000","last_fullsized":"2024-04-22T19:58:00.486624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485363+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:00.485363+0000","last_peered":"2024-04-22T19:58:00.485363+0000","last_clean":"2024-04-22T19:58:00.485363+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:00.485363+0000","last_undegraded":"2024-04-22T19:58:00.485363+0000","last_fullsized":"2024-04-22T19:58:00.485363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'16","reported_seq":128,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487089+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:00.487089+0000","last_peered":"2024-04-22T19:58:00.487089+0000","last_clean":"2024-04-22T19:58:00.487089+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:00.487089+0000","last_undegraded":"2024-04-22T19:58:00.487089+0000","last_fullsized":"2024-04-22T19:58:00.487089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493301+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:00.493301+0000","last_peered":"2024-04-22T19:58:00.493301+0000","last_clean":"2024-04-22T19:58:00.493301+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:00.493301+0000","last_undegraded":"2024-04-22T19:58:00.493301+0000","last_fullsized":"2024-04-22T19:58:00.493301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493680+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:00.493680+0000","last_peered":"2024-04-22T19:58:00.493680+0000","last_clean":"2024-04-22T19:58:00.493680+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:00.493680+0000","last_undegraded":"2024-04-22T19:58:00.493680+0000","last_fullsized":"2024-04-22T19:58:00.493680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'21","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402285+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:00.402285+0000","last_peered":"2024-04-22T19:58:00.402285+0000","last_clean":"2024-04-22T19:58:00.402285+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:00.402285+0000","last_undegraded":"2024-04-22T19:58:00.402285+0000","last_fullsized":"2024-04-22T19:58:00.402285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'32","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403823+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:00.403823+0000","last_peered":"2024-04-22T19:58:00.403823+0000","last_clean":"2024-04-22T19:58:00.403823+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:00.403823+0000","last_undegraded":"2024-04-22T19:58:00.403823+0000","last_fullsized":"2024-04-22T19:58:00.403823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'27","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489495+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:00.489495+0000","last_peered":"2024-04-22T19:58:00.489495+0000","last_clean":"2024-04-22T19:58:00.489495+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:00.489495+0000","last_undegraded":"2024-04-22T19:58:00.489495+0000","last_fullsized":"2024-04-22T19:58:00.489495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405197+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:00.405197+0000","last_peered":"2024-04-22T19:58:00.405197+0000","last_clean":"2024-04-22T19:58:00.405197+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:00.405197+0000","last_undegraded":"2024-04-22T19:58:00.405197+0000","last_fullsized":"2024-04-22T19:58:00.405197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'27","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403836+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:00.403836+0000","last_peered":"2024-04-22T19:58:00.403836+0000","last_clean":"2024-04-22T19:58:00.403836+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:00.403836+0000","last_undegraded":"2024-04-22T19:58:00.403836+0000","last_fullsized":"2024-04-22T19:58:00.403836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":47,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487480+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:00.487480+0000","last_peered":"2024-04-22T19:58:00.487480+0000","last_clean":"2024-04-22T19:58:00.487480+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:00.487480+0000","last_undegraded":"2024-04-22T19:58:00.487480+0000","last_fullsized":"2024-04-22T19:58:00.487480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403429+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403429+0000","last_peered":"2024-04-22T19:58:00.403429+0000","last_clean":"2024-04-22T19:58:00.403429+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403429+0000","last_undegraded":"2024-04-22T19:58:00.403429+0000","last_fullsized":"2024-04-22T19:58:00.403429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405797+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405797+0000","last_peered":"2024-04-22T19:58:00.405797+0000","last_clean":"2024-04-22T19:58:00.405797+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405797+0000","last_undegraded":"2024-04-22T19:58:00.405797+0000","last_fullsized":"2024-04-22T19:58:00.405797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:03.662478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486690+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:00.486690+0000","last_peered":"2024-04-22T19:58:00.486690+0000","last_clean":"2024-04-22T19:58:00.486690+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:00.486690+0000","last_undegraded":"2024-04-22T19:58:00.486690+0000","last_fullsized":"2024-04-22T19:58:00.486690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'134","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487245+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:00.487245+0000","last_peered":"2024-04-22T19:58:00.487245+0000","last_clean":"2024-04-22T19:58:00.487245+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:00.487245+0000","last_undegraded":"2024-04-22T19:58:00.487245+0000","last_fullsized":"2024-04-22T19:58:00.487245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'30","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490735+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:00.490735+0000","last_peered":"2024-04-22T19:58:00.490735+0000","last_clean":"2024-04-22T19:58:00.490735+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:00.490735+0000","last_undegraded":"2024-04-22T19:58:00.490735+0000","last_fullsized":"2024-04-22T19:58:00.490735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'18","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487740+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:00.487740+0000","last_peered":"2024-04-22T19:58:00.487740+0000","last_clean":"2024-04-22T19:58:00.487740+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:00.487740+0000","last_undegraded":"2024-04-22T19:58:00.487740+0000","last_fullsized":"2024-04-22T19:58:00.487740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'140","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487274+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:00.487274+0000","last_peered":"2024-04-22T19:58:00.487274+0000","last_clean":"2024-04-22T19:58:00.487274+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:00.487274+0000","last_undegraded":"2024-04-22T19:58:00.487274+0000","last_fullsized":"2024-04-22T19:58:00.487274+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488107+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:00.488107+0000","last_peered":"2024-04-22T19:58:00.488107+0000","last_clean":"2024-04-22T19:58:00.488107+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:00.488107+0000","last_undegraded":"2024-04-22T19:58:00.488107+0000","last_fullsized":"2024-04-22T19:58:00.488107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487464+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:00.487464+0000","last_peered":"2024-04-22T19:58:00.487464+0000","last_clean":"2024-04-22T19:58:00.487464+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:00.487464+0000","last_undegraded":"2024-04-22T19:58:00.487464+0000","last_fullsized":"2024-04-22T19:58:00.487464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399938+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.399938+0000","last_peered":"2024-04-22T19:58:00.399938+0000","last_clean":"2024-04-22T19:58:00.399938+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.399938+0000","last_undegraded":"2024-04-22T19:58:00.399938+0000","last_fullsized":"2024-04-22T19:58:00.399938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'30","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487876+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:00.487876+0000","last_peered":"2024-04-22T19:58:00.487876+0000","last_clean":"2024-04-22T19:58:00.487876+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:00.487876+0000","last_undegraded":"2024-04-22T19:58:00.487876+0000","last_fullsized":"2024-04-22T19:58:00.487876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'17","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486948+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:00.486948+0000","last_peered":"2024-04-22T19:58:00.486948+0000","last_clean":"2024-04-22T19:58:00.486948+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:00.486948+0000","last_undegraded":"2024-04-22T19:58:00.486948+0000","last_fullsized":"2024-04-22T19:58:00.486948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'25","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489043+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:00.489043+0000","last_peered":"2024-04-22T19:58:00.489043+0000","last_clean":"2024-04-22T19:58:00.489043+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:00.489043+0000","last_undegraded":"2024-04-22T19:58:00.489043+0000","last_fullsized":"2024-04-22T19:58:00.489043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'24","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486021+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:00.486021+0000","last_peered":"2024-04-22T19:58:00.486021+0000","last_clean":"2024-04-22T19:58:00.486021+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:00.486021+0000","last_undegraded":"2024-04-22T19:58:00.486021+0000","last_fullsized":"2024-04-22T19:58:00.486021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'134","reported_seq":388,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402809+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:00.402809+0000","last_peered":"2024-04-22T19:58:00.402809+0000","last_clean":"2024-04-22T19:58:00.402809+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:00.402809+0000","last_undegraded":"2024-04-22T19:58:00.402809+0000","last_fullsized":"2024-04-22T19:58:00.402809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405362+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405362+0000","last_peered":"2024-04-22T19:58:00.405362+0000","last_clean":"2024-04-22T19:58:00.405362+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405362+0000","last_undegraded":"2024-04-22T19:58:00.405362+0000","last_fullsized":"2024-04-22T19:58:00.405362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404257+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404257+0000","last_peered":"2024-04-22T19:58:00.404257+0000","last_clean":"2024-04-22T19:58:00.404257+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404257+0000","last_undegraded":"2024-04-22T19:58:00.404257+0000","last_fullsized":"2024-04-22T19:58:00.404257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'25","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492146+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:00.492146+0000","last_peered":"2024-04-22T19:58:00.492146+0000","last_clean":"2024-04-22T19:58:00.492146+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:00.492146+0000","last_undegraded":"2024-04-22T19:58:00.492146+0000","last_fullsized":"2024-04-22T19:58:00.492146+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'30","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403345+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:00.403345+0000","last_peered":"2024-04-22T19:58:00.403345+0000","last_clean":"2024-04-22T19:58:00.403345+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:00.403345+0000","last_undegraded":"2024-04-22T19:58:00.403345+0000","last_fullsized":"2024-04-22T19:58:00.403345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403953+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.403953+0000","last_peered":"2024-04-22T19:58:00.403953+0000","last_clean":"2024-04-22T19:58:00.403953+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.403953+0000","last_undegraded":"2024-04-22T19:58:00.403953+0000","last_fullsized":"2024-04-22T19:58:00.403953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:23.427873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486634+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:00.486634+0000","last_peered":"2024-04-22T19:58:00.486634+0000","last_clean":"2024-04-22T19:58:00.486634+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:00.486634+0000","last_undegraded":"2024-04-22T19:58:00.486634+0000","last_fullsized":"2024-04-22T19:58:00.486634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'19","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404161+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:00.404161+0000","last_peered":"2024-04-22T19:58:00.404161+0000","last_clean":"2024-04-22T19:58:00.404161+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:00.404161+0000","last_undegraded":"2024-04-22T19:58:00.404161+0000","last_fullsized":"2024-04-22T19:58:00.404161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405099+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405099+0000","last_peered":"2024-04-22T19:58:00.405099+0000","last_clean":"2024-04-22T19:58:00.405099+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405099+0000","last_undegraded":"2024-04-22T19:58:00.405099+0000","last_fullsized":"2024-04-22T19:58:00.405099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492958+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:00.492958+0000","last_peered":"2024-04-22T19:58:00.492958+0000","last_clean":"2024-04-22T19:58:00.492958+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:00.492958+0000","last_undegraded":"2024-04-22T19:58:00.492958+0000","last_fullsized":"2024-04-22T19:58:00.492958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402426+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402426+0000","last_peered":"2024-04-22T19:58:00.402426+0000","last_clean":"2024-04-22T19:58:00.402426+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402426+0000","last_undegraded":"2024-04-22T19:58:00.402426+0000","last_fullsized":"2024-04-22T19:58:00.402426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'23","reported_seq":286,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486495+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:00.486495+0000","last_peered":"2024-04-22T19:58:00.486495+0000","last_clean":"2024-04-22T19:58:00.486495+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:00.486495+0000","last_undegraded":"2024-04-22T19:58:00.486495+0000","last_fullsized":"2024-04-22T19:58:00.486495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'134","reported_seq":401,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485892+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:00.485892+0000","last_peered":"2024-04-22T19:58:00.485892+0000","last_clean":"2024-04-22T19:58:00.485892+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:00.485892+0000","last_undegraded":"2024-04-22T19:58:00.485892+0000","last_fullsized":"2024-04-22T19:58:00.485892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400977+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.400977+0000","last_peered":"2024-04-22T19:58:00.400977+0000","last_clean":"2024-04-22T19:58:00.400977+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.400977+0000","last_undegraded":"2024-04-22T19:58:00.400977+0000","last_fullsized":"2024-04-22T19:58:00.400977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'34","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401789+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:00.401789+0000","last_peered":"2024-04-22T19:58:00.401789+0000","last_clean":"2024-04-22T19:58:00.401789+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:00.401789+0000","last_undegraded":"2024-04-22T19:58:00.401789+0000","last_fullsized":"2024-04-22T19:58:00.401789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":396,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'134","reported_seq":433,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493094+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:00.493094+0000","last_peered":"2024-04-22T19:58:00.493094+0000","last_clean":"2024-04-22T19:58:00.493094+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:00.493094+0000","last_undegraded":"2024-04-22T19:58:00.493094+0000","last_fullsized":"2024-04-22T19:58:00.493094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"109'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485602+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:00.485602+0000","last_peered":"2024-04-22T19:58:00.485602+0000","last_clean":"2024-04-22T19:58:00.485602+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:00.485602+0000","last_undegraded":"2024-04-22T19:58:00.485602+0000","last_fullsized":"2024-04-22T19:58:00.485602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'26","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491674+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:00.491674+0000","last_peered":"2024-04-22T19:58:00.491674+0000","last_clean":"2024-04-22T19:58:00.491674+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:00.491674+0000","last_undegraded":"2024-04-22T19:58:00.491674+0000","last_fullsized":"2024-04-22T19:58:00.491674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399679+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399679+0000","last_peered":"2024-04-22T19:58:00.399679+0000","last_clean":"2024-04-22T19:58:00.399679+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399679+0000","last_undegraded":"2024-04-22T19:58:00.399679+0000","last_fullsized":"2024-04-22T19:58:00.399679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491504+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491504+0000","last_peered":"2024-04-22T19:58:00.491504+0000","last_clean":"2024-04-22T19:58:00.491504+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491504+0000","last_undegraded":"2024-04-22T19:58:00.491504+0000","last_fullsized":"2024-04-22T19:58:00.491504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":80,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486632+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:00.486632+0000","last_peered":"2024-04-22T19:58:00.486632+0000","last_clean":"2024-04-22T19:58:00.486632+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:00.486632+0000","last_undegraded":"2024-04-22T19:58:00.486632+0000","last_fullsized":"2024-04-22T19:58:00.486632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'37","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492246+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:00.492246+0000","last_peered":"2024-04-22T19:58:00.492246+0000","last_clean":"2024-04-22T19:58:00.492246+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:00.492246+0000","last_undegraded":"2024-04-22T19:58:00.492246+0000","last_fullsized":"2024-04-22T19:58:00.492246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405389+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405389+0000","last_peered":"2024-04-22T19:58:00.405389+0000","last_clean":"2024-04-22T19:58:00.405389+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405389+0000","last_undegraded":"2024-04-22T19:58:00.405389+0000","last_fullsized":"2024-04-22T19:58:00.405389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405703+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405703+0000","last_peered":"2024-04-22T19:58:00.405703+0000","last_clean":"2024-04-22T19:58:00.405703+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405703+0000","last_undegraded":"2024-04-22T19:58:00.405703+0000","last_fullsized":"2024-04-22T19:58:00.405703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485924+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485924+0000","last_peered":"2024-04-22T19:58:00.485924+0000","last_clean":"2024-04-22T19:58:00.485924+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485924+0000","last_undegraded":"2024-04-22T19:58:00.485924+0000","last_fullsized":"2024-04-22T19:58:00.485924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'20","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403486+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:00.403486+0000","last_peered":"2024-04-22T19:58:00.403486+0000","last_clean":"2024-04-22T19:58:00.403486+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:00.403486+0000","last_undegraded":"2024-04-22T19:58:00.403486+0000","last_fullsized":"2024-04-22T19:58:00.403486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'137","reported_seq":454,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402187+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:00.402187+0000","last_peered":"2024-04-22T19:58:00.402187+0000","last_clean":"2024-04-22T19:58:00.402187+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:00.402187+0000","last_undegraded":"2024-04-22T19:58:00.402187+0000","last_fullsized":"2024-04-22T19:58:00.402187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":163,"num_write":30,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399623+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399623+0000","last_peered":"2024-04-22T19:58:00.399623+0000","last_clean":"2024-04-22T19:58:00.399623+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399623+0000","last_undegraded":"2024-04-22T19:58:00.399623+0000","last_fullsized":"2024-04-22T19:58:00.399623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405126+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405126+0000","last_peered":"2024-04-22T19:58:00.405126+0000","last_clean":"2024-04-22T19:58:00.405126+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405126+0000","last_undegraded":"2024-04-22T19:58:00.405126+0000","last_fullsized":"2024-04-22T19:58:00.405126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":239,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485098+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485098+0000","last_peered":"2024-04-22T19:58:00.485098+0000","last_clean":"2024-04-22T19:58:00.485098+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485098+0000","last_undegraded":"2024-04-22T19:58:00.485098+0000","last_fullsized":"2024-04-22T19:58:00.485098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'22","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402549+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:00.402549+0000","last_peered":"2024-04-22T19:58:00.402549+0000","last_clean":"2024-04-22T19:58:00.402549+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:00.402549+0000","last_undegraded":"2024-04-22T19:58:00.402549+0000","last_fullsized":"2024-04-22T19:58:00.402549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":306,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486116+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:00.486116+0000","last_peered":"2024-04-22T19:58:00.486116+0000","last_clean":"2024-04-22T19:58:00.486116+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:00.486116+0000","last_undegraded":"2024-04-22T19:58:00.486116+0000","last_fullsized":"2024-04-22T19:58:00.486116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":274,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488232+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:00.488232+0000","last_peered":"2024-04-22T19:58:00.488232+0000","last_clean":"2024-04-22T19:58:00.488232+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:00.488232+0000","last_undegraded":"2024-04-22T19:58:00.488232+0000","last_fullsized":"2024-04-22T19:58:00.488232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403797+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403797+0000","last_peered":"2024-04-22T19:58:00.403797+0000","last_clean":"2024-04-22T19:58:00.403797+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403797+0000","last_undegraded":"2024-04-22T19:58:00.403797+0000","last_fullsized":"2024-04-22T19:58:00.403797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402931+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.402931+0000","last_peered":"2024-04-22T19:58:00.402931+0000","last_clean":"2024-04-22T19:58:00.402931+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.402931+0000","last_undegraded":"2024-04-22T19:58:00.402931+0000","last_fullsized":"2024-04-22T19:58:00.402931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491149+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491149+0000","last_peered":"2024-04-22T19:58:00.491149+0000","last_clean":"2024-04-22T19:58:00.491149+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491149+0000","last_undegraded":"2024-04-22T19:58:00.491149+0000","last_fullsized":"2024-04-22T19:58:00.491149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403427+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:00.403427+0000","last_peered":"2024-04-22T19:58:00.403427+0000","last_clean":"2024-04-22T19:58:00.403427+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:00.403427+0000","last_undegraded":"2024-04-22T19:58:00.403427+0000","last_fullsized":"2024-04-22T19:58:00.403427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404832+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404832+0000","last_peered":"2024-04-22T19:58:00.404832+0000","last_clean":"2024-04-22T19:58:00.404832+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404832+0000","last_undegraded":"2024-04-22T19:58:00.404832+0000","last_fullsized":"2024-04-22T19:58:00.404832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400634+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400634+0000","last_peered":"2024-04-22T19:58:00.400634+0000","last_clean":"2024-04-22T19:58:00.400634+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400634+0000","last_undegraded":"2024-04-22T19:58:00.400634+0000","last_fullsized":"2024-04-22T19:58:00.400634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'18","reported_seq":298,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492228+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:00.492228+0000","last_peered":"2024-04-22T19:58:00.492228+0000","last_clean":"2024-04-22T19:58:00.492228+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:00.492228+0000","last_undegraded":"2024-04-22T19:58:00.492228+0000","last_fullsized":"2024-04-22T19:58:00.492228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403589+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:00.403589+0000","last_peered":"2024-04-22T19:58:00.403589+0000","last_clean":"2024-04-22T19:58:00.403589+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:00.403589+0000","last_undegraded":"2024-04-22T19:58:00.403589+0000","last_fullsized":"2024-04-22T19:58:00.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403696+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403696+0000","last_peered":"2024-04-22T19:58:00.403696+0000","last_clean":"2024-04-22T19:58:00.403696+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403696+0000","last_undegraded":"2024-04-22T19:58:00.403696+0000","last_fullsized":"2024-04-22T19:58:00.403696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'35","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399220+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:00.399220+0000","last_peered":"2024-04-22T19:58:00.399220+0000","last_clean":"2024-04-22T19:58:00.399220+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.399220+0000","last_undegraded":"2024-04-22T19:58:00.399220+0000","last_fullsized":"2024-04-22T19:58:00.399220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:38.161593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404915+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404915+0000","last_peered":"2024-04-22T19:58:00.404915+0000","last_clean":"2024-04-22T19:58:00.404915+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404915+0000","last_undegraded":"2024-04-22T19:58:00.404915+0000","last_fullsized":"2024-04-22T19:58:00.404915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404153+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404153+0000","last_peered":"2024-04-22T19:58:00.404153+0000","last_clean":"2024-04-22T19:58:00.404153+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404153+0000","last_undegraded":"2024-04-22T19:58:00.404153+0000","last_fullsized":"2024-04-22T19:58:00.404153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403175+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:00.403175+0000","last_peered":"2024-04-22T19:58:00.403175+0000","last_clean":"2024-04-22T19:58:00.403175+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:00.403175+0000","last_undegraded":"2024-04-22T19:58:00.403175+0000","last_fullsized":"2024-04-22T19:58:00.403175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489726+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489726+0000","last_peered":"2024-04-22T19:58:00.489726+0000","last_clean":"2024-04-22T19:58:00.489726+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489726+0000","last_undegraded":"2024-04-22T19:58:00.489726+0000","last_fullsized":"2024-04-22T19:58:00.489726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400210+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400210+0000","last_peered":"2024-04-22T19:58:00.400210+0000","last_clean":"2024-04-22T19:58:00.400210+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400210+0000","last_undegraded":"2024-04-22T19:58:00.400210+0000","last_fullsized":"2024-04-22T19:58:00.400210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'134","reported_seq":387,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488401+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:00.488401+0000","last_peered":"2024-04-22T19:58:00.488401+0000","last_clean":"2024-04-22T19:58:00.488401+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:00.488401+0000","last_undegraded":"2024-04-22T19:58:00.488401+0000","last_fullsized":"2024-04-22T19:58:00.488401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'16","reported_seq":72,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487578+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:00.487578+0000","last_peered":"2024-04-22T19:58:00.487578+0000","last_clean":"2024-04-22T19:58:00.487578+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:00.487578+0000","last_undegraded":"2024-04-22T19:58:00.487578+0000","last_fullsized":"2024-04-22T19:58:00.487578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404614+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404614+0000","last_peered":"2024-04-22T19:58:00.404614+0000","last_clean":"2024-04-22T19:58:00.404614+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404614+0000","last_undegraded":"2024-04-22T19:58:00.404614+0000","last_fullsized":"2024-04-22T19:58:00.404614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"121'140","reported_seq":463,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487326+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:00.487326+0000","last_peered":"2024-04-22T19:58:00.487326+0000","last_clean":"2024-04-22T19:58:00.487326+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:00.487326+0000","last_undegraded":"2024-04-22T19:58:00.487326+0000","last_fullsized":"2024-04-22T19:58:00.487326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404604+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404604+0000","last_peered":"2024-04-22T19:58:00.404604+0000","last_clean":"2024-04-22T19:58:00.404604+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404604+0000","last_undegraded":"2024-04-22T19:58:00.404604+0000","last_fullsized":"2024-04-22T19:58:00.404604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:39.990552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405842+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:00.405842+0000","last_peered":"2024-04-22T19:58:00.405842+0000","last_clean":"2024-04-22T19:58:00.405842+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:00.405842+0000","last_undegraded":"2024-04-22T19:58:00.405842+0000","last_fullsized":"2024-04-22T19:58:00.405842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'45","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488495+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:00.488495+0000","last_peered":"2024-04-22T19:58:00.488495+0000","last_clean":"2024-04-22T19:58:00.488495+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:00.488495+0000","last_undegraded":"2024-04-22T19:58:00.488495+0000","last_fullsized":"2024-04-22T19:58:00.488495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404977+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.404977+0000","last_peered":"2024-04-22T19:58:00.404977+0000","last_clean":"2024-04-22T19:58:00.404977+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.404977+0000","last_undegraded":"2024-04-22T19:58:00.404977+0000","last_fullsized":"2024-04-22T19:58:00.404977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402134+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:00.402134+0000","last_peered":"2024-04-22T19:58:00.402134+0000","last_clean":"2024-04-22T19:58:00.402134+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:00.402134+0000","last_undegraded":"2024-04-22T19:58:00.402134+0000","last_fullsized":"2024-04-22T19:58:00.402134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401039+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401039+0000","last_peered":"2024-04-22T19:58:00.401039+0000","last_clean":"2024-04-22T19:58:00.401039+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401039+0000","last_undegraded":"2024-04-22T19:58:00.401039+0000","last_fullsized":"2024-04-22T19:58:00.401039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485520+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:00.485520+0000","last_peered":"2024-04-22T19:58:00.485520+0000","last_clean":"2024-04-22T19:58:00.485520+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:00.485520+0000","last_undegraded":"2024-04-22T19:58:00.485520+0000","last_fullsized":"2024-04-22T19:58:00.485520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400380+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400380+0000","last_peered":"2024-04-22T19:58:00.400380+0000","last_clean":"2024-04-22T19:58:00.400380+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400380+0000","last_undegraded":"2024-04-22T19:58:00.400380+0000","last_fullsized":"2024-04-22T19:58:00.400380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'29","reported_seq":335,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488786+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:00.488786+0000","last_peered":"2024-04-22T19:58:00.488786+0000","last_clean":"2024-04-22T19:58:00.488786+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:00.488786+0000","last_undegraded":"2024-04-22T19:58:00.488786+0000","last_fullsized":"2024-04-22T19:58:00.488786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398955+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.398955+0000","last_peered":"2024-04-22T19:58:00.398955+0000","last_clean":"2024-04-22T19:58:00.398955+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.398955+0000","last_undegraded":"2024-04-22T19:58:00.398955+0000","last_fullsized":"2024-04-22T19:58:00.398955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404670+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404670+0000","last_peered":"2024-04-22T19:58:00.404670+0000","last_clean":"2024-04-22T19:58:00.404670+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404670+0000","last_undegraded":"2024-04-22T19:58:00.404670+0000","last_fullsized":"2024-04-22T19:58:00.404670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492364+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:00.492364+0000","last_peered":"2024-04-22T19:58:00.492364+0000","last_clean":"2024-04-22T19:58:00.492364+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:00.492364+0000","last_undegraded":"2024-04-22T19:58:00.492364+0000","last_fullsized":"2024-04-22T19:58:00.492364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486681+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:00.486681+0000","last_peered":"2024-04-22T19:58:00.486681+0000","last_clean":"2024-04-22T19:58:00.486681+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:00.486681+0000","last_undegraded":"2024-04-22T19:58:00.486681+0000","last_fullsized":"2024-04-22T19:58:00.486681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'17","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405364+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:00.405364+0000","last_peered":"2024-04-22T19:58:00.405364+0000","last_clean":"2024-04-22T19:58:00.405364+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:00.405364+0000","last_undegraded":"2024-04-22T19:58:00.405364+0000","last_fullsized":"2024-04-22T19:58:00.405364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'17","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486240+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:00.486240+0000","last_peered":"2024-04-22T19:58:00.486240+0000","last_clean":"2024-04-22T19:58:00.486240+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:00.486240+0000","last_undegraded":"2024-04-22T19:58:00.486240+0000","last_fullsized":"2024-04-22T19:58:00.486240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403251+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403251+0000","last_peered":"2024-04-22T19:58:00.403251+0000","last_clean":"2024-04-22T19:58:00.403251+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403251+0000","last_undegraded":"2024-04-22T19:58:00.403251+0000","last_fullsized":"2024-04-22T19:58:00.403251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485805+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:00.485805+0000","last_peered":"2024-04-22T19:58:00.485805+0000","last_clean":"2024-04-22T19:58:00.485805+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:00.485805+0000","last_undegraded":"2024-04-22T19:58:00.485805+0000","last_fullsized":"2024-04-22T19:58:00.485805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405531+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:00.405531+0000","last_peered":"2024-04-22T19:58:00.405531+0000","last_clean":"2024-04-22T19:58:00.405531+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:00.405531+0000","last_undegraded":"2024-04-22T19:58:00.405531+0000","last_fullsized":"2024-04-22T19:58:00.405531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400696+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:00.400696+0000","last_peered":"2024-04-22T19:58:00.400696+0000","last_clean":"2024-04-22T19:58:00.400696+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:00.400696+0000","last_undegraded":"2024-04-22T19:58:00.400696+0000","last_fullsized":"2024-04-22T19:58:00.400696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405635+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:00.405635+0000","last_peered":"2024-04-22T19:58:00.405635+0000","last_clean":"2024-04-22T19:58:00.405635+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:00.405635+0000","last_undegraded":"2024-04-22T19:58:00.405635+0000","last_fullsized":"2024-04-22T19:58:00.405635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'22","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401881+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:00.401881+0000","last_peered":"2024-04-22T19:58:00.401881+0000","last_clean":"2024-04-22T19:58:00.401881+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:00.401881+0000","last_undegraded":"2024-04-22T19:58:00.401881+0000","last_fullsized":"2024-04-22T19:58:00.401881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:59.453198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'23","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486786+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:00.486786+0000","last_peered":"2024-04-22T19:58:00.486786+0000","last_clean":"2024-04-22T19:58:00.486786+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:00.486786+0000","last_undegraded":"2024-04-22T19:58:00.486786+0000","last_fullsized":"2024-04-22T19:58:00.486786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401214+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401214+0000","last_peered":"2024-04-22T19:58:00.401214+0000","last_clean":"2024-04-22T19:58:00.401214+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401214+0000","last_undegraded":"2024-04-22T19:58:00.401214+0000","last_fullsized":"2024-04-22T19:58:00.401214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'20","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402622+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:00.402622+0000","last_peered":"2024-04-22T19:58:00.402622+0000","last_clean":"2024-04-22T19:58:00.402622+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:00.402622+0000","last_undegraded":"2024-04-22T19:58:00.402622+0000","last_fullsized":"2024-04-22T19:58:00.402622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487530+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:00.487530+0000","last_peered":"2024-04-22T19:58:00.487530+0000","last_clean":"2024-04-22T19:58:00.487530+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:00.487530+0000","last_undegraded":"2024-04-22T19:58:00.487530+0000","last_fullsized":"2024-04-22T19:58:00.487530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399918+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.399918+0000","last_peered":"2024-04-22T19:58:00.399918+0000","last_clean":"2024-04-22T19:58:00.399918+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.399918+0000","last_undegraded":"2024-04-22T19:58:00.399918+0000","last_fullsized":"2024-04-22T19:58:00.399918+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:49:58.016491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403254+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:00.403254+0000","last_peered":"2024-04-22T19:58:00.403254+0000","last_clean":"2024-04-22T19:58:00.403254+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:00.403254+0000","last_undegraded":"2024-04-22T19:58:00.403254+0000","last_fullsized":"2024-04-22T19:58:00.403254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401713+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401713+0000","last_peered":"2024-04-22T19:58:00.401713+0000","last_clean":"2024-04-22T19:58:00.401713+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401713+0000","last_undegraded":"2024-04-22T19:58:00.401713+0000","last_fullsized":"2024-04-22T19:58:00.401713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'134","reported_seq":415,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493420+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:00.493420+0000","last_peered":"2024-04-22T19:58:00.493420+0000","last_clean":"2024-04-22T19:58:00.493420+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:00.493420+0000","last_undegraded":"2024-04-22T19:58:00.493420+0000","last_fullsized":"2024-04-22T19:58:00.493420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488771+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:00.488771+0000","last_peered":"2024-04-22T19:58:00.488771+0000","last_clean":"2024-04-22T19:58:00.488771+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:00.488771+0000","last_undegraded":"2024-04-22T19:58:00.488771+0000","last_fullsized":"2024-04-22T19:58:00.488771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398468+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398468+0000","last_peered":"2024-04-22T19:58:00.398468+0000","last_clean":"2024-04-22T19:58:00.398468+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398468+0000","last_undegraded":"2024-04-22T19:58:00.398468+0000","last_fullsized":"2024-04-22T19:58:00.398468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492192+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:00.492192+0000","last_peered":"2024-04-22T19:58:00.492192+0000","last_clean":"2024-04-22T19:58:00.492192+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:00.492192+0000","last_undegraded":"2024-04-22T19:58:00.492192+0000","last_fullsized":"2024-04-22T19:58:00.492192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398675+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:00.398675+0000","last_peered":"2024-04-22T19:58:00.398675+0000","last_clean":"2024-04-22T19:58:00.398675+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:00.398675+0000","last_undegraded":"2024-04-22T19:58:00.398675+0000","last_fullsized":"2024-04-22T19:58:00.398675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'13","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487401+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:00.487401+0000","last_peered":"2024-04-22T19:58:00.487401+0000","last_clean":"2024-04-22T19:58:00.487401+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:00.487401+0000","last_undegraded":"2024-04-22T19:58:00.487401+0000","last_fullsized":"2024-04-22T19:58:00.487401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'23","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405337+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:00.405337+0000","last_peered":"2024-04-22T19:58:00.405337+0000","last_clean":"2024-04-22T19:58:00.405337+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:00.405337+0000","last_undegraded":"2024-04-22T19:58:00.405337+0000","last_fullsized":"2024-04-22T19:58:00.405337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400493+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400493+0000","last_peered":"2024-04-22T19:58:00.400493+0000","last_clean":"2024-04-22T19:58:00.400493+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400493+0000","last_undegraded":"2024-04-22T19:58:00.400493+0000","last_fullsized":"2024-04-22T19:58:00.400493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401679+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:00.401679+0000","last_peered":"2024-04-22T19:58:00.401679+0000","last_clean":"2024-04-22T19:58:00.401679+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:00.401679+0000","last_undegraded":"2024-04-22T19:58:00.401679+0000","last_fullsized":"2024-04-22T19:58:00.401679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403081+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403081+0000","last_peered":"2024-04-22T19:58:00.403081+0000","last_clean":"2024-04-22T19:58:00.403081+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403081+0000","last_undegraded":"2024-04-22T19:58:00.403081+0000","last_fullsized":"2024-04-22T19:58:00.403081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405057+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405057+0000","last_peered":"2024-04-22T19:58:00.405057+0000","last_clean":"2024-04-22T19:58:00.405057+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405057+0000","last_undegraded":"2024-04-22T19:58:00.405057+0000","last_fullsized":"2024-04-22T19:58:00.405057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490506+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:00.490506+0000","last_peered":"2024-04-22T19:58:00.490506+0000","last_clean":"2024-04-22T19:58:00.490506+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:00.490506+0000","last_undegraded":"2024-04-22T19:58:00.490506+0000","last_fullsized":"2024-04-22T19:58:00.490506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404333+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404333+0000","last_peered":"2024-04-22T19:58:00.404333+0000","last_clean":"2024-04-22T19:58:00.404333+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404333+0000","last_undegraded":"2024-04-22T19:58:00.404333+0000","last_fullsized":"2024-04-22T19:58:00.404333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484910+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:00.484910+0000","last_peered":"2024-04-22T19:58:00.484910+0000","last_clean":"2024-04-22T19:58:00.484910+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:00.484910+0000","last_undegraded":"2024-04-22T19:58:00.484910+0000","last_fullsized":"2024-04-22T19:58:00.484910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'23","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490973+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:00.490973+0000","last_peered":"2024-04-22T19:58:00.490973+0000","last_clean":"2024-04-22T19:58:00.490973+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:00.490973+0000","last_undegraded":"2024-04-22T19:58:00.490973+0000","last_fullsized":"2024-04-22T19:58:00.490973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403420+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403420+0000","last_peered":"2024-04-22T19:58:00.403420+0000","last_clean":"2024-04-22T19:58:00.403420+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403420+0000","last_undegraded":"2024-04-22T19:58:00.403420+0000","last_fullsized":"2024-04-22T19:58:00.403420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'16","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403555+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:00.403555+0000","last_peered":"2024-04-22T19:58:00.403555+0000","last_clean":"2024-04-22T19:58:00.403555+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:00.403555+0000","last_undegraded":"2024-04-22T19:58:00.403555+0000","last_fullsized":"2024-04-22T19:58:00.403555+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:54.651586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'31","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487609+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:00.487609+0000","last_peered":"2024-04-22T19:58:00.487609+0000","last_clean":"2024-04-22T19:58:00.487609+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:00.487609+0000","last_undegraded":"2024-04-22T19:58:00.487609+0000","last_fullsized":"2024-04-22T19:58:00.487609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'19","reported_seq":301,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402407+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:00.402407+0000","last_peered":"2024-04-22T19:58:00.402407+0000","last_clean":"2024-04-22T19:58:00.402407+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:00.402407+0000","last_undegraded":"2024-04-22T19:58:00.402407+0000","last_fullsized":"2024-04-22T19:58:00.402407+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:07.458707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493418+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:00.493418+0000","last_peered":"2024-04-22T19:58:00.493418+0000","last_clean":"2024-04-22T19:58:00.493418+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:00.493418+0000","last_undegraded":"2024-04-22T19:58:00.493418+0000","last_fullsized":"2024-04-22T19:58:00.493418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'18","reported_seq":76,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487784+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:00.487784+0000","last_peered":"2024-04-22T19:58:00.487784+0000","last_clean":"2024-04-22T19:58:00.487784+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:00.487784+0000","last_undegraded":"2024-04-22T19:58:00.487784+0000","last_fullsized":"2024-04-22T19:58:00.487784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405228+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405228+0000","last_peered":"2024-04-22T19:58:00.405228+0000","last_clean":"2024-04-22T19:58:00.405228+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405228+0000","last_undegraded":"2024-04-22T19:58:00.405228+0000","last_fullsized":"2024-04-22T19:58:00.405228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:23.329522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'27","reported_seq":325,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489055+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:00.489055+0000","last_peered":"2024-04-22T19:58:00.489055+0000","last_clean":"2024-04-22T19:58:00.489055+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:00.489055+0000","last_undegraded":"2024-04-22T19:58:00.489055+0000","last_fullsized":"2024-04-22T19:58:00.489055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'34","reported_seq":108,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485798+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:00.485798+0000","last_peered":"2024-04-22T19:58:00.485798+0000","last_clean":"2024-04-22T19:58:00.485798+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:00.485798+0000","last_undegraded":"2024-04-22T19:58:00.485798+0000","last_fullsized":"2024-04-22T19:58:00.485798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'36","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489673+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:00.489673+0000","last_peered":"2024-04-22T19:58:00.489673+0000","last_clean":"2024-04-22T19:58:00.489673+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:00.489673+0000","last_undegraded":"2024-04-22T19:58:00.489673+0000","last_fullsized":"2024-04-22T19:58:00.489673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'31","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403819+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:00.403819+0000","last_peered":"2024-04-22T19:58:00.403819+0000","last_clean":"2024-04-22T19:58:00.403819+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:00.403819+0000","last_undegraded":"2024-04-22T19:58:00.403819+0000","last_fullsized":"2024-04-22T19:58:00.403819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'29","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490942+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:00.490942+0000","last_peered":"2024-04-22T19:58:00.490942+0000","last_clean":"2024-04-22T19:58:00.490942+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:00.490942+0000","last_undegraded":"2024-04-22T19:58:00.490942+0000","last_fullsized":"2024-04-22T19:58:00.490942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403218+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403218+0000","last_peered":"2024-04-22T19:58:00.403218+0000","last_clean":"2024-04-22T19:58:00.403218+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403218+0000","last_undegraded":"2024-04-22T19:58:00.403218+0000","last_fullsized":"2024-04-22T19:58:00.403218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'22","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489472+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:00.489472+0000","last_peered":"2024-04-22T19:58:00.489472+0000","last_clean":"2024-04-22T19:58:00.489472+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:00.489472+0000","last_undegraded":"2024-04-22T19:58:00.489472+0000","last_fullsized":"2024-04-22T19:58:00.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486323+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:00.486323+0000","last_peered":"2024-04-22T19:58:00.486323+0000","last_clean":"2024-04-22T19:58:00.486323+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:00.486323+0000","last_undegraded":"2024-04-22T19:58:00.486323+0000","last_fullsized":"2024-04-22T19:58:00.486323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'28","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486127+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:00.486127+0000","last_peered":"2024-04-22T19:58:00.486127+0000","last_clean":"2024-04-22T19:58:00.486127+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:00.486127+0000","last_undegraded":"2024-04-22T19:58:00.486127+0000","last_fullsized":"2024-04-22T19:58:00.486127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"110'27","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488968+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:00.488968+0000","last_peered":"2024-04-22T19:58:00.488968+0000","last_clean":"2024-04-22T19:58:00.488968+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:00.488968+0000","last_undegraded":"2024-04-22T19:58:00.488968+0000","last_fullsized":"2024-04-22T19:58:00.488968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405158+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405158+0000","last_peered":"2024-04-22T19:58:00.405158+0000","last_clean":"2024-04-22T19:58:00.405158+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405158+0000","last_undegraded":"2024-04-22T19:58:00.405158+0000","last_fullsized":"2024-04-22T19:58:00.405158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401480+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:00.401480+0000","last_peered":"2024-04-22T19:58:00.401480+0000","last_clean":"2024-04-22T19:58:00.401480+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:00.401480+0000","last_undegraded":"2024-04-22T19:58:00.401480+0000","last_fullsized":"2024-04-22T19:58:00.401480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1084,"ondisk_log_size":1084,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386922,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":604,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":311,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1985180,"kb_used_data":1949840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92386660,"statfs":{"total":96636764160,"available":94603939840,"internally_reserved":0,"allocated":1996636160,"data_stored":1995943008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1243136,"kb_used_data":1211956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93128704,"statfs":{"total":96636764160,"available":95363792896,"internally_reserved":0,"allocated":1241042944,"data_stored":1240384017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775964,"kb_used_data":1740624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92595876,"statfs":{"total":96636764160,"available":94818177024,"internally_reserved":0,"allocated":1782398976,"data_stored":1781684417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1961980,"kb_used_data":1926636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92409860,"statfs":{"total":96636764160,"available":94627696640,"internally_reserved":0,"allocated":1972875264,"data_stored":1972231414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1892448,"kb_used_data":1852944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92479392,"statfs":{"total":96636764160,"available":94698897408,"internally_reserved":0,"allocated":1897414656,"data_stored":1896735122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948204,"kb_used_data":912864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93423636,"statfs":{"total":96636764160,"available":95665803264,"internally_reserved":0,"allocated":934772736,"data_stored":934133913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1034544,"kb_used_data":999204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93337296,"statfs":{"total":96636764160,"available":95577391104,"internally_reserved":0,"allocated":1023184896,"data_stored":1022505896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1759824,"kb_used_data":1724480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92612016,"statfs":{"total":96636764160,"available":94834704384,"internally_reserved":0,"allocated":1765867520,"data_stored":1765204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1763704832,"data_stored":1763704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1021313024,"data_stored":1021313024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933232640,"data_stored":933232640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1895825408,"data_stored":1895825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1971322880,"data_stored":1971322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1780482048,"data_stored":1780482048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239416832,"data_stored":1239416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1994391552,"data_stored":1994391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":293527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:04.258 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-22T19:58:04.258 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-22T19:58:04.599 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-22T19:58:04.608 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-22T19:58:04.608 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T19:58:04.609 INFO:tasks.rgw.client.0.smithi111.stdout:2024-04-22T19:58:04.604+0000 7f5eb418a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31689) UID: 0 2024-04-22T19:58:04.609 INFO:tasks.rgw.client.0.smithi111.stdout:2024-04-22T19:58:04.604+0000 7f5eb79d2a40 -1 shutting down 2024-04-22T19:58:10.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-22T19:58:10.709 INFO:tasks.rgw.client.0:Stopped 2024-04-22T19:58:10.710 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-22T19:58:10.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/vault-root-token 2024-04-22T19:58:10.771 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-22T19:58:10.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-22T19:58:10.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-22T19:58:10.826 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-22T19:58:12.119 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-22T19:58:12.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T19:58:12.129 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:12.464 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:12.470 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:12.481 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-22T19:58:11.426586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823914,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3066,"num_read_kb":2749,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3911,"ondisk_log_size":3911,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12601288,"kb_used_data":12318584,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":742373432,"statfs":{"total":773094113280,"available":760190394368,"internally_reserved":0,"allocated":12614230016,"data_stored":12608845372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.027544"},"pg_stats":[{"pgid":"3.3f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487868+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:00.487868+0000","last_peered":"2024-04-22T19:58:00.487868+0000","last_clean":"2024-04-22T19:58:00.487868+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:00.487868+0000","last_undegraded":"2024-04-22T19:58:00.487868+0000","last_fullsized":"2024-04-22T19:58:00.487868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'18","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404530+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:00.404530+0000","last_peered":"2024-04-22T19:58:00.404530+0000","last_clean":"2024-04-22T19:58:00.404530+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:00.404530+0000","last_undegraded":"2024-04-22T19:58:00.404530+0000","last_fullsized":"2024-04-22T19:58:00.404530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405121+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:00.405121+0000","last_peered":"2024-04-22T19:58:00.405121+0000","last_clean":"2024-04-22T19:58:00.405121+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:00.405121+0000","last_undegraded":"2024-04-22T19:58:00.405121+0000","last_fullsized":"2024-04-22T19:58:00.405121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'23","reported_seq":310,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491906+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:00.491906+0000","last_peered":"2024-04-22T19:58:00.491906+0000","last_clean":"2024-04-22T19:58:00.491906+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:00.491906+0000","last_undegraded":"2024-04-22T19:58:00.491906+0000","last_fullsized":"2024-04-22T19:58:00.491906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403422+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403422+0000","last_peered":"2024-04-22T19:58:00.403422+0000","last_clean":"2024-04-22T19:58:00.403422+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403422+0000","last_undegraded":"2024-04-22T19:58:00.403422+0000","last_fullsized":"2024-04-22T19:58:00.403422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'28","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489291+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:00.489291+0000","last_peered":"2024-04-22T19:58:00.489291+0000","last_clean":"2024-04-22T19:58:00.489291+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:00.489291+0000","last_undegraded":"2024-04-22T19:58:00.489291+0000","last_fullsized":"2024-04-22T19:58:00.489291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490875+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490875+0000","last_peered":"2024-04-22T19:58:00.490875+0000","last_clean":"2024-04-22T19:58:00.490875+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490875+0000","last_undegraded":"2024-04-22T19:58:00.490875+0000","last_fullsized":"2024-04-22T19:58:00.490875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'11","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489417+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:00.489417+0000","last_peered":"2024-04-22T19:58:00.489417+0000","last_clean":"2024-04-22T19:58:00.489417+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:00.489417+0000","last_undegraded":"2024-04-22T19:58:00.489417+0000","last_fullsized":"2024-04-22T19:58:00.489417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'23","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486624+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:00.486624+0000","last_peered":"2024-04-22T19:58:00.486624+0000","last_clean":"2024-04-22T19:58:00.486624+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:00.486624+0000","last_undegraded":"2024-04-22T19:58:00.486624+0000","last_fullsized":"2024-04-22T19:58:00.486624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485363+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:00.485363+0000","last_peered":"2024-04-22T19:58:00.485363+0000","last_clean":"2024-04-22T19:58:00.485363+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:00.485363+0000","last_undegraded":"2024-04-22T19:58:00.485363+0000","last_fullsized":"2024-04-22T19:58:00.485363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'16","reported_seq":128,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487089+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:00.487089+0000","last_peered":"2024-04-22T19:58:00.487089+0000","last_clean":"2024-04-22T19:58:00.487089+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:00.487089+0000","last_undegraded":"2024-04-22T19:58:00.487089+0000","last_fullsized":"2024-04-22T19:58:00.487089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493301+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:00.493301+0000","last_peered":"2024-04-22T19:58:00.493301+0000","last_clean":"2024-04-22T19:58:00.493301+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:00.493301+0000","last_undegraded":"2024-04-22T19:58:00.493301+0000","last_fullsized":"2024-04-22T19:58:00.493301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493680+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:00.493680+0000","last_peered":"2024-04-22T19:58:00.493680+0000","last_clean":"2024-04-22T19:58:00.493680+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:00.493680+0000","last_undegraded":"2024-04-22T19:58:00.493680+0000","last_fullsized":"2024-04-22T19:58:00.493680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'21","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402285+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:00.402285+0000","last_peered":"2024-04-22T19:58:00.402285+0000","last_clean":"2024-04-22T19:58:00.402285+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:00.402285+0000","last_undegraded":"2024-04-22T19:58:00.402285+0000","last_fullsized":"2024-04-22T19:58:00.402285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'32","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403823+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:00.403823+0000","last_peered":"2024-04-22T19:58:00.403823+0000","last_clean":"2024-04-22T19:58:00.403823+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:00.403823+0000","last_undegraded":"2024-04-22T19:58:00.403823+0000","last_fullsized":"2024-04-22T19:58:00.403823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'27","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489495+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:00.489495+0000","last_peered":"2024-04-22T19:58:00.489495+0000","last_clean":"2024-04-22T19:58:00.489495+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:00.489495+0000","last_undegraded":"2024-04-22T19:58:00.489495+0000","last_fullsized":"2024-04-22T19:58:00.489495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405197+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:00.405197+0000","last_peered":"2024-04-22T19:58:00.405197+0000","last_clean":"2024-04-22T19:58:00.405197+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:00.405197+0000","last_undegraded":"2024-04-22T19:58:00.405197+0000","last_fullsized":"2024-04-22T19:58:00.405197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'27","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403836+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:00.403836+0000","last_peered":"2024-04-22T19:58:00.403836+0000","last_clean":"2024-04-22T19:58:00.403836+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:00.403836+0000","last_undegraded":"2024-04-22T19:58:00.403836+0000","last_fullsized":"2024-04-22T19:58:00.403836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":47,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487480+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:00.487480+0000","last_peered":"2024-04-22T19:58:00.487480+0000","last_clean":"2024-04-22T19:58:00.487480+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:00.487480+0000","last_undegraded":"2024-04-22T19:58:00.487480+0000","last_fullsized":"2024-04-22T19:58:00.487480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403429+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403429+0000","last_peered":"2024-04-22T19:58:00.403429+0000","last_clean":"2024-04-22T19:58:00.403429+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403429+0000","last_undegraded":"2024-04-22T19:58:00.403429+0000","last_fullsized":"2024-04-22T19:58:00.403429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405797+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405797+0000","last_peered":"2024-04-22T19:58:00.405797+0000","last_clean":"2024-04-22T19:58:00.405797+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405797+0000","last_undegraded":"2024-04-22T19:58:00.405797+0000","last_fullsized":"2024-04-22T19:58:00.405797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:03.662478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486690+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:00.486690+0000","last_peered":"2024-04-22T19:58:00.486690+0000","last_clean":"2024-04-22T19:58:00.486690+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:00.486690+0000","last_undegraded":"2024-04-22T19:58:00.486690+0000","last_fullsized":"2024-04-22T19:58:00.486690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'135","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645684+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:03.645684+0000","last_peered":"2024-04-22T19:58:03.645684+0000","last_clean":"2024-04-22T19:58:03.645684+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:03.645684+0000","last_undegraded":"2024-04-22T19:58:03.645684+0000","last_fullsized":"2024-04-22T19:58:03.645684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'30","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490735+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:00.490735+0000","last_peered":"2024-04-22T19:58:00.490735+0000","last_clean":"2024-04-22T19:58:00.490735+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:00.490735+0000","last_undegraded":"2024-04-22T19:58:00.490735+0000","last_fullsized":"2024-04-22T19:58:00.490735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'18","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487740+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:00.487740+0000","last_peered":"2024-04-22T19:58:00.487740+0000","last_clean":"2024-04-22T19:58:00.487740+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:00.487740+0000","last_undegraded":"2024-04-22T19:58:00.487740+0000","last_fullsized":"2024-04-22T19:58:00.487740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"128'141","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645079+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:03.645079+0000","last_peered":"2024-04-22T19:58:03.645079+0000","last_clean":"2024-04-22T19:58:03.645079+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:03.645079+0000","last_undegraded":"2024-04-22T19:58:03.645079+0000","last_fullsized":"2024-04-22T19:58:03.645079+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488107+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:00.488107+0000","last_peered":"2024-04-22T19:58:00.488107+0000","last_clean":"2024-04-22T19:58:00.488107+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:00.488107+0000","last_undegraded":"2024-04-22T19:58:00.488107+0000","last_fullsized":"2024-04-22T19:58:00.488107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487464+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:00.487464+0000","last_peered":"2024-04-22T19:58:00.487464+0000","last_clean":"2024-04-22T19:58:00.487464+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:00.487464+0000","last_undegraded":"2024-04-22T19:58:00.487464+0000","last_fullsized":"2024-04-22T19:58:00.487464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399938+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.399938+0000","last_peered":"2024-04-22T19:58:00.399938+0000","last_clean":"2024-04-22T19:58:00.399938+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.399938+0000","last_undegraded":"2024-04-22T19:58:00.399938+0000","last_fullsized":"2024-04-22T19:58:00.399938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'30","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487876+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:00.487876+0000","last_peered":"2024-04-22T19:58:00.487876+0000","last_clean":"2024-04-22T19:58:00.487876+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:00.487876+0000","last_undegraded":"2024-04-22T19:58:00.487876+0000","last_fullsized":"2024-04-22T19:58:00.487876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'17","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486948+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:00.486948+0000","last_peered":"2024-04-22T19:58:00.486948+0000","last_clean":"2024-04-22T19:58:00.486948+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:00.486948+0000","last_undegraded":"2024-04-22T19:58:00.486948+0000","last_fullsized":"2024-04-22T19:58:00.486948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'25","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489043+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:00.489043+0000","last_peered":"2024-04-22T19:58:00.489043+0000","last_clean":"2024-04-22T19:58:00.489043+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:00.489043+0000","last_undegraded":"2024-04-22T19:58:00.489043+0000","last_fullsized":"2024-04-22T19:58:00.489043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'24","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486021+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:00.486021+0000","last_peered":"2024-04-22T19:58:00.486021+0000","last_clean":"2024-04-22T19:58:00.486021+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:00.486021+0000","last_undegraded":"2024-04-22T19:58:00.486021+0000","last_fullsized":"2024-04-22T19:58:00.486021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'135","reported_seq":390,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645400+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:03.645400+0000","last_peered":"2024-04-22T19:58:03.645400+0000","last_clean":"2024-04-22T19:58:03.645400+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:03.645400+0000","last_undegraded":"2024-04-22T19:58:03.645400+0000","last_fullsized":"2024-04-22T19:58:03.645400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405362+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405362+0000","last_peered":"2024-04-22T19:58:00.405362+0000","last_clean":"2024-04-22T19:58:00.405362+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405362+0000","last_undegraded":"2024-04-22T19:58:00.405362+0000","last_fullsized":"2024-04-22T19:58:00.405362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404257+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404257+0000","last_peered":"2024-04-22T19:58:00.404257+0000","last_clean":"2024-04-22T19:58:00.404257+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404257+0000","last_undegraded":"2024-04-22T19:58:00.404257+0000","last_fullsized":"2024-04-22T19:58:00.404257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'25","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492146+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:00.492146+0000","last_peered":"2024-04-22T19:58:00.492146+0000","last_clean":"2024-04-22T19:58:00.492146+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:00.492146+0000","last_undegraded":"2024-04-22T19:58:00.492146+0000","last_fullsized":"2024-04-22T19:58:00.492146+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'30","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403345+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:00.403345+0000","last_peered":"2024-04-22T19:58:00.403345+0000","last_clean":"2024-04-22T19:58:00.403345+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:00.403345+0000","last_undegraded":"2024-04-22T19:58:00.403345+0000","last_fullsized":"2024-04-22T19:58:00.403345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403953+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.403953+0000","last_peered":"2024-04-22T19:58:00.403953+0000","last_clean":"2024-04-22T19:58:00.403953+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.403953+0000","last_undegraded":"2024-04-22T19:58:00.403953+0000","last_fullsized":"2024-04-22T19:58:00.403953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:23.427873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486634+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:00.486634+0000","last_peered":"2024-04-22T19:58:00.486634+0000","last_clean":"2024-04-22T19:58:00.486634+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:00.486634+0000","last_undegraded":"2024-04-22T19:58:00.486634+0000","last_fullsized":"2024-04-22T19:58:00.486634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'19","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404161+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:00.404161+0000","last_peered":"2024-04-22T19:58:00.404161+0000","last_clean":"2024-04-22T19:58:00.404161+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:00.404161+0000","last_undegraded":"2024-04-22T19:58:00.404161+0000","last_fullsized":"2024-04-22T19:58:00.404161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405099+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405099+0000","last_peered":"2024-04-22T19:58:00.405099+0000","last_clean":"2024-04-22T19:58:00.405099+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405099+0000","last_undegraded":"2024-04-22T19:58:00.405099+0000","last_fullsized":"2024-04-22T19:58:00.405099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492958+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:00.492958+0000","last_peered":"2024-04-22T19:58:00.492958+0000","last_clean":"2024-04-22T19:58:00.492958+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:00.492958+0000","last_undegraded":"2024-04-22T19:58:00.492958+0000","last_fullsized":"2024-04-22T19:58:00.492958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402426+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402426+0000","last_peered":"2024-04-22T19:58:00.402426+0000","last_clean":"2024-04-22T19:58:00.402426+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402426+0000","last_undegraded":"2024-04-22T19:58:00.402426+0000","last_fullsized":"2024-04-22T19:58:00.402426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'23","reported_seq":286,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486495+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:00.486495+0000","last_peered":"2024-04-22T19:58:00.486495+0000","last_clean":"2024-04-22T19:58:00.486495+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:00.486495+0000","last_undegraded":"2024-04-22T19:58:00.486495+0000","last_fullsized":"2024-04-22T19:58:00.486495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'135","reported_seq":403,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400977+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.400977+0000","last_peered":"2024-04-22T19:58:00.400977+0000","last_clean":"2024-04-22T19:58:00.400977+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.400977+0000","last_undegraded":"2024-04-22T19:58:00.400977+0000","last_fullsized":"2024-04-22T19:58:00.400977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'34","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401789+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:00.401789+0000","last_peered":"2024-04-22T19:58:00.401789+0000","last_clean":"2024-04-22T19:58:00.401789+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:00.401789+0000","last_undegraded":"2024-04-22T19:58:00.401789+0000","last_fullsized":"2024-04-22T19:58:00.401789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":396,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'135","reported_seq":435,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"109'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485602+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:00.485602+0000","last_peered":"2024-04-22T19:58:00.485602+0000","last_clean":"2024-04-22T19:58:00.485602+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:00.485602+0000","last_undegraded":"2024-04-22T19:58:00.485602+0000","last_fullsized":"2024-04-22T19:58:00.485602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'26","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491674+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:00.491674+0000","last_peered":"2024-04-22T19:58:00.491674+0000","last_clean":"2024-04-22T19:58:00.491674+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:00.491674+0000","last_undegraded":"2024-04-22T19:58:00.491674+0000","last_fullsized":"2024-04-22T19:58:00.491674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399679+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399679+0000","last_peered":"2024-04-22T19:58:00.399679+0000","last_clean":"2024-04-22T19:58:00.399679+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399679+0000","last_undegraded":"2024-04-22T19:58:00.399679+0000","last_fullsized":"2024-04-22T19:58:00.399679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491504+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491504+0000","last_peered":"2024-04-22T19:58:00.491504+0000","last_clean":"2024-04-22T19:58:00.491504+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491504+0000","last_undegraded":"2024-04-22T19:58:00.491504+0000","last_fullsized":"2024-04-22T19:58:00.491504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":80,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486632+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:00.486632+0000","last_peered":"2024-04-22T19:58:00.486632+0000","last_clean":"2024-04-22T19:58:00.486632+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:00.486632+0000","last_undegraded":"2024-04-22T19:58:00.486632+0000","last_fullsized":"2024-04-22T19:58:00.486632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'37","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492246+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:00.492246+0000","last_peered":"2024-04-22T19:58:00.492246+0000","last_clean":"2024-04-22T19:58:00.492246+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:00.492246+0000","last_undegraded":"2024-04-22T19:58:00.492246+0000","last_fullsized":"2024-04-22T19:58:00.492246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405389+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405389+0000","last_peered":"2024-04-22T19:58:00.405389+0000","last_clean":"2024-04-22T19:58:00.405389+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405389+0000","last_undegraded":"2024-04-22T19:58:00.405389+0000","last_fullsized":"2024-04-22T19:58:00.405389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405703+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405703+0000","last_peered":"2024-04-22T19:58:00.405703+0000","last_clean":"2024-04-22T19:58:00.405703+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405703+0000","last_undegraded":"2024-04-22T19:58:00.405703+0000","last_fullsized":"2024-04-22T19:58:00.405703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485965+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485965+0000","last_peered":"2024-04-22T19:58:00.485965+0000","last_clean":"2024-04-22T19:58:00.485965+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485965+0000","last_undegraded":"2024-04-22T19:58:00.485965+0000","last_fullsized":"2024-04-22T19:58:00.485965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'20","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403486+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:00.403486+0000","last_peered":"2024-04-22T19:58:00.403486+0000","last_clean":"2024-04-22T19:58:00.403486+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:00.403486+0000","last_undegraded":"2024-04-22T19:58:00.403486+0000","last_fullsized":"2024-04-22T19:58:00.403486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'138","reported_seq":456,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":163,"num_write":30,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399623+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399623+0000","last_peered":"2024-04-22T19:58:00.399623+0000","last_clean":"2024-04-22T19:58:00.399623+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399623+0000","last_undegraded":"2024-04-22T19:58:00.399623+0000","last_fullsized":"2024-04-22T19:58:00.399623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405126+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405126+0000","last_peered":"2024-04-22T19:58:00.405126+0000","last_clean":"2024-04-22T19:58:00.405126+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405126+0000","last_undegraded":"2024-04-22T19:58:00.405126+0000","last_fullsized":"2024-04-22T19:58:00.405126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485136+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485136+0000","last_peered":"2024-04-22T19:58:00.485136+0000","last_clean":"2024-04-22T19:58:00.485136+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485136+0000","last_undegraded":"2024-04-22T19:58:00.485136+0000","last_fullsized":"2024-04-22T19:58:00.485136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402613+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:00.402613+0000","last_peered":"2024-04-22T19:58:00.402613+0000","last_clean":"2024-04-22T19:58:00.402613+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:00.402613+0000","last_undegraded":"2024-04-22T19:58:00.402613+0000","last_fullsized":"2024-04-22T19:58:00.402613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":306,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486116+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:00.486116+0000","last_peered":"2024-04-22T19:58:00.486116+0000","last_clean":"2024-04-22T19:58:00.486116+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:00.486116+0000","last_undegraded":"2024-04-22T19:58:00.486116+0000","last_fullsized":"2024-04-22T19:58:00.486116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'16","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403797+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403797+0000","last_peered":"2024-04-22T19:58:00.403797+0000","last_clean":"2024-04-22T19:58:00.403797+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403797+0000","last_undegraded":"2024-04-22T19:58:00.403797+0000","last_fullsized":"2024-04-22T19:58:00.403797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402931+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.402931+0000","last_peered":"2024-04-22T19:58:00.402931+0000","last_clean":"2024-04-22T19:58:00.402931+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.402931+0000","last_undegraded":"2024-04-22T19:58:00.402931+0000","last_fullsized":"2024-04-22T19:58:00.402931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491149+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491149+0000","last_peered":"2024-04-22T19:58:00.491149+0000","last_clean":"2024-04-22T19:58:00.491149+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491149+0000","last_undegraded":"2024-04-22T19:58:00.491149+0000","last_fullsized":"2024-04-22T19:58:00.491149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403427+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:00.403427+0000","last_peered":"2024-04-22T19:58:00.403427+0000","last_clean":"2024-04-22T19:58:00.403427+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:00.403427+0000","last_undegraded":"2024-04-22T19:58:00.403427+0000","last_fullsized":"2024-04-22T19:58:00.403427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404832+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404832+0000","last_peered":"2024-04-22T19:58:00.404832+0000","last_clean":"2024-04-22T19:58:00.404832+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404832+0000","last_undegraded":"2024-04-22T19:58:00.404832+0000","last_fullsized":"2024-04-22T19:58:00.404832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400634+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400634+0000","last_peered":"2024-04-22T19:58:00.400634+0000","last_clean":"2024-04-22T19:58:00.400634+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400634+0000","last_undegraded":"2024-04-22T19:58:00.400634+0000","last_fullsized":"2024-04-22T19:58:00.400634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'18","reported_seq":298,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492228+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:00.492228+0000","last_peered":"2024-04-22T19:58:00.492228+0000","last_clean":"2024-04-22T19:58:00.492228+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:00.492228+0000","last_undegraded":"2024-04-22T19:58:00.492228+0000","last_fullsized":"2024-04-22T19:58:00.492228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403589+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:00.403589+0000","last_peered":"2024-04-22T19:58:00.403589+0000","last_clean":"2024-04-22T19:58:00.403589+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:00.403589+0000","last_undegraded":"2024-04-22T19:58:00.403589+0000","last_fullsized":"2024-04-22T19:58:00.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403696+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403696+0000","last_peered":"2024-04-22T19:58:00.403696+0000","last_clean":"2024-04-22T19:58:00.403696+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403696+0000","last_undegraded":"2024-04-22T19:58:00.403696+0000","last_fullsized":"2024-04-22T19:58:00.403696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'35","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399220+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:00.399220+0000","last_peered":"2024-04-22T19:58:00.399220+0000","last_clean":"2024-04-22T19:58:00.399220+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.399220+0000","last_undegraded":"2024-04-22T19:58:00.399220+0000","last_fullsized":"2024-04-22T19:58:00.399220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:38.161593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404915+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404915+0000","last_peered":"2024-04-22T19:58:00.404915+0000","last_clean":"2024-04-22T19:58:00.404915+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404915+0000","last_undegraded":"2024-04-22T19:58:00.404915+0000","last_fullsized":"2024-04-22T19:58:00.404915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404153+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404153+0000","last_peered":"2024-04-22T19:58:00.404153+0000","last_clean":"2024-04-22T19:58:00.404153+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404153+0000","last_undegraded":"2024-04-22T19:58:00.404153+0000","last_fullsized":"2024-04-22T19:58:00.404153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403175+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:00.403175+0000","last_peered":"2024-04-22T19:58:00.403175+0000","last_clean":"2024-04-22T19:58:00.403175+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:00.403175+0000","last_undegraded":"2024-04-22T19:58:00.403175+0000","last_fullsized":"2024-04-22T19:58:00.403175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489726+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489726+0000","last_peered":"2024-04-22T19:58:00.489726+0000","last_clean":"2024-04-22T19:58:00.489726+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489726+0000","last_undegraded":"2024-04-22T19:58:00.489726+0000","last_fullsized":"2024-04-22T19:58:00.489726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400210+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400210+0000","last_peered":"2024-04-22T19:58:00.400210+0000","last_clean":"2024-04-22T19:58:00.400210+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400210+0000","last_undegraded":"2024-04-22T19:58:00.400210+0000","last_fullsized":"2024-04-22T19:58:00.400210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'135","reported_seq":389,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.646418+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:03.646418+0000","last_peered":"2024-04-22T19:58:03.646418+0000","last_clean":"2024-04-22T19:58:03.646418+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:03.646418+0000","last_undegraded":"2024-04-22T19:58:03.646418+0000","last_fullsized":"2024-04-22T19:58:03.646418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'16","reported_seq":72,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487578+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:00.487578+0000","last_peered":"2024-04-22T19:58:00.487578+0000","last_clean":"2024-04-22T19:58:00.487578+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:00.487578+0000","last_undegraded":"2024-04-22T19:58:00.487578+0000","last_fullsized":"2024-04-22T19:58:00.487578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404614+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404614+0000","last_peered":"2024-04-22T19:58:00.404614+0000","last_clean":"2024-04-22T19:58:00.404614+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404614+0000","last_undegraded":"2024-04-22T19:58:00.404614+0000","last_fullsized":"2024-04-22T19:58:00.404614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'141","reported_seq":465,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645052+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:03.645052+0000","last_peered":"2024-04-22T19:58:03.645052+0000","last_clean":"2024-04-22T19:58:03.645052+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:03.645052+0000","last_undegraded":"2024-04-22T19:58:03.645052+0000","last_fullsized":"2024-04-22T19:58:03.645052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404604+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404604+0000","last_peered":"2024-04-22T19:58:00.404604+0000","last_clean":"2024-04-22T19:58:00.404604+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404604+0000","last_undegraded":"2024-04-22T19:58:00.404604+0000","last_fullsized":"2024-04-22T19:58:00.404604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:39.990552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405842+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:00.405842+0000","last_peered":"2024-04-22T19:58:00.405842+0000","last_clean":"2024-04-22T19:58:00.405842+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:00.405842+0000","last_undegraded":"2024-04-22T19:58:00.405842+0000","last_fullsized":"2024-04-22T19:58:00.405842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'45","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488495+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:00.488495+0000","last_peered":"2024-04-22T19:58:00.488495+0000","last_clean":"2024-04-22T19:58:00.488495+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:00.488495+0000","last_undegraded":"2024-04-22T19:58:00.488495+0000","last_fullsized":"2024-04-22T19:58:00.488495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404977+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.404977+0000","last_peered":"2024-04-22T19:58:00.404977+0000","last_clean":"2024-04-22T19:58:00.404977+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.404977+0000","last_undegraded":"2024-04-22T19:58:00.404977+0000","last_fullsized":"2024-04-22T19:58:00.404977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402134+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:00.402134+0000","last_peered":"2024-04-22T19:58:00.402134+0000","last_clean":"2024-04-22T19:58:00.402134+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:00.402134+0000","last_undegraded":"2024-04-22T19:58:00.402134+0000","last_fullsized":"2024-04-22T19:58:00.402134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401039+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401039+0000","last_peered":"2024-04-22T19:58:00.401039+0000","last_clean":"2024-04-22T19:58:00.401039+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401039+0000","last_undegraded":"2024-04-22T19:58:00.401039+0000","last_fullsized":"2024-04-22T19:58:00.401039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485520+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:00.485520+0000","last_peered":"2024-04-22T19:58:00.485520+0000","last_clean":"2024-04-22T19:58:00.485520+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:00.485520+0000","last_undegraded":"2024-04-22T19:58:00.485520+0000","last_fullsized":"2024-04-22T19:58:00.485520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400380+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400380+0000","last_peered":"2024-04-22T19:58:00.400380+0000","last_clean":"2024-04-22T19:58:00.400380+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400380+0000","last_undegraded":"2024-04-22T19:58:00.400380+0000","last_fullsized":"2024-04-22T19:58:00.400380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'29","reported_seq":335,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488786+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:00.488786+0000","last_peered":"2024-04-22T19:58:00.488786+0000","last_clean":"2024-04-22T19:58:00.488786+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:00.488786+0000","last_undegraded":"2024-04-22T19:58:00.488786+0000","last_fullsized":"2024-04-22T19:58:00.488786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398955+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.398955+0000","last_peered":"2024-04-22T19:58:00.398955+0000","last_clean":"2024-04-22T19:58:00.398955+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.398955+0000","last_undegraded":"2024-04-22T19:58:00.398955+0000","last_fullsized":"2024-04-22T19:58:00.398955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404670+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404670+0000","last_peered":"2024-04-22T19:58:00.404670+0000","last_clean":"2024-04-22T19:58:00.404670+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404670+0000","last_undegraded":"2024-04-22T19:58:00.404670+0000","last_fullsized":"2024-04-22T19:58:00.404670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492364+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:00.492364+0000","last_peered":"2024-04-22T19:58:00.492364+0000","last_clean":"2024-04-22T19:58:00.492364+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:00.492364+0000","last_undegraded":"2024-04-22T19:58:00.492364+0000","last_fullsized":"2024-04-22T19:58:00.492364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486681+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:00.486681+0000","last_peered":"2024-04-22T19:58:00.486681+0000","last_clean":"2024-04-22T19:58:00.486681+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:00.486681+0000","last_undegraded":"2024-04-22T19:58:00.486681+0000","last_fullsized":"2024-04-22T19:58:00.486681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'17","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405364+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:00.405364+0000","last_peered":"2024-04-22T19:58:00.405364+0000","last_clean":"2024-04-22T19:58:00.405364+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:00.405364+0000","last_undegraded":"2024-04-22T19:58:00.405364+0000","last_fullsized":"2024-04-22T19:58:00.405364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'17","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486240+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:00.486240+0000","last_peered":"2024-04-22T19:58:00.486240+0000","last_clean":"2024-04-22T19:58:00.486240+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:00.486240+0000","last_undegraded":"2024-04-22T19:58:00.486240+0000","last_fullsized":"2024-04-22T19:58:00.486240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403251+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403251+0000","last_peered":"2024-04-22T19:58:00.403251+0000","last_clean":"2024-04-22T19:58:00.403251+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403251+0000","last_undegraded":"2024-04-22T19:58:00.403251+0000","last_fullsized":"2024-04-22T19:58:00.403251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485805+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:00.485805+0000","last_peered":"2024-04-22T19:58:00.485805+0000","last_clean":"2024-04-22T19:58:00.485805+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:00.485805+0000","last_undegraded":"2024-04-22T19:58:00.485805+0000","last_fullsized":"2024-04-22T19:58:00.485805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405531+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:00.405531+0000","last_peered":"2024-04-22T19:58:00.405531+0000","last_clean":"2024-04-22T19:58:00.405531+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:00.405531+0000","last_undegraded":"2024-04-22T19:58:00.405531+0000","last_fullsized":"2024-04-22T19:58:00.405531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400696+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:00.400696+0000","last_peered":"2024-04-22T19:58:00.400696+0000","last_clean":"2024-04-22T19:58:00.400696+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:00.400696+0000","last_undegraded":"2024-04-22T19:58:00.400696+0000","last_fullsized":"2024-04-22T19:58:00.400696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405680+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:00.405680+0000","last_peered":"2024-04-22T19:58:00.405680+0000","last_clean":"2024-04-22T19:58:00.405680+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:00.405680+0000","last_undegraded":"2024-04-22T19:58:00.405680+0000","last_fullsized":"2024-04-22T19:58:00.405680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'22","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401881+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:00.401881+0000","last_peered":"2024-04-22T19:58:00.401881+0000","last_clean":"2024-04-22T19:58:00.401881+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:00.401881+0000","last_undegraded":"2024-04-22T19:58:00.401881+0000","last_fullsized":"2024-04-22T19:58:00.401881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:59.453198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'23","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486786+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:00.486786+0000","last_peered":"2024-04-22T19:58:00.486786+0000","last_clean":"2024-04-22T19:58:00.486786+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:00.486786+0000","last_undegraded":"2024-04-22T19:58:00.486786+0000","last_fullsized":"2024-04-22T19:58:00.486786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401214+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401214+0000","last_peered":"2024-04-22T19:58:00.401214+0000","last_clean":"2024-04-22T19:58:00.401214+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401214+0000","last_undegraded":"2024-04-22T19:58:00.401214+0000","last_fullsized":"2024-04-22T19:58:00.401214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'20","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402622+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:00.402622+0000","last_peered":"2024-04-22T19:58:00.402622+0000","last_clean":"2024-04-22T19:58:00.402622+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:00.402622+0000","last_undegraded":"2024-04-22T19:58:00.402622+0000","last_fullsized":"2024-04-22T19:58:00.402622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487530+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:00.487530+0000","last_peered":"2024-04-22T19:58:00.487530+0000","last_clean":"2024-04-22T19:58:00.487530+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:00.487530+0000","last_undegraded":"2024-04-22T19:58:00.487530+0000","last_fullsized":"2024-04-22T19:58:00.487530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399918+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.399918+0000","last_peered":"2024-04-22T19:58:00.399918+0000","last_clean":"2024-04-22T19:58:00.399918+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.399918+0000","last_undegraded":"2024-04-22T19:58:00.399918+0000","last_fullsized":"2024-04-22T19:58:00.399918+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:49:58.016491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403254+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:00.403254+0000","last_peered":"2024-04-22T19:58:00.403254+0000","last_clean":"2024-04-22T19:58:00.403254+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:00.403254+0000","last_undegraded":"2024-04-22T19:58:00.403254+0000","last_fullsized":"2024-04-22T19:58:00.403254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401713+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401713+0000","last_peered":"2024-04-22T19:58:00.401713+0000","last_clean":"2024-04-22T19:58:00.401713+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401713+0000","last_undegraded":"2024-04-22T19:58:00.401713+0000","last_fullsized":"2024-04-22T19:58:00.401713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'135","reported_seq":417,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645767+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:03.645767+0000","last_peered":"2024-04-22T19:58:03.645767+0000","last_clean":"2024-04-22T19:58:03.645767+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:03.645767+0000","last_undegraded":"2024-04-22T19:58:03.645767+0000","last_fullsized":"2024-04-22T19:58:03.645767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488771+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:00.488771+0000","last_peered":"2024-04-22T19:58:00.488771+0000","last_clean":"2024-04-22T19:58:00.488771+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:00.488771+0000","last_undegraded":"2024-04-22T19:58:00.488771+0000","last_fullsized":"2024-04-22T19:58:00.488771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398468+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398468+0000","last_peered":"2024-04-22T19:58:00.398468+0000","last_clean":"2024-04-22T19:58:00.398468+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398468+0000","last_undegraded":"2024-04-22T19:58:00.398468+0000","last_fullsized":"2024-04-22T19:58:00.398468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492192+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:00.492192+0000","last_peered":"2024-04-22T19:58:00.492192+0000","last_clean":"2024-04-22T19:58:00.492192+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:00.492192+0000","last_undegraded":"2024-04-22T19:58:00.492192+0000","last_fullsized":"2024-04-22T19:58:00.492192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398675+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:00.398675+0000","last_peered":"2024-04-22T19:58:00.398675+0000","last_clean":"2024-04-22T19:58:00.398675+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:00.398675+0000","last_undegraded":"2024-04-22T19:58:00.398675+0000","last_fullsized":"2024-04-22T19:58:00.398675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'13","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487401+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:00.487401+0000","last_peered":"2024-04-22T19:58:00.487401+0000","last_clean":"2024-04-22T19:58:00.487401+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:00.487401+0000","last_undegraded":"2024-04-22T19:58:00.487401+0000","last_fullsized":"2024-04-22T19:58:00.487401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'23","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405337+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:00.405337+0000","last_peered":"2024-04-22T19:58:00.405337+0000","last_clean":"2024-04-22T19:58:00.405337+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:00.405337+0000","last_undegraded":"2024-04-22T19:58:00.405337+0000","last_fullsized":"2024-04-22T19:58:00.405337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400493+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400493+0000","last_peered":"2024-04-22T19:58:00.400493+0000","last_clean":"2024-04-22T19:58:00.400493+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400493+0000","last_undegraded":"2024-04-22T19:58:00.400493+0000","last_fullsized":"2024-04-22T19:58:00.400493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401679+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:00.401679+0000","last_peered":"2024-04-22T19:58:00.401679+0000","last_clean":"2024-04-22T19:58:00.401679+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:00.401679+0000","last_undegraded":"2024-04-22T19:58:00.401679+0000","last_fullsized":"2024-04-22T19:58:00.401679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403081+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403081+0000","last_peered":"2024-04-22T19:58:00.403081+0000","last_clean":"2024-04-22T19:58:00.403081+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403081+0000","last_undegraded":"2024-04-22T19:58:00.403081+0000","last_fullsized":"2024-04-22T19:58:00.403081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405057+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405057+0000","last_peered":"2024-04-22T19:58:00.405057+0000","last_clean":"2024-04-22T19:58:00.405057+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405057+0000","last_undegraded":"2024-04-22T19:58:00.405057+0000","last_fullsized":"2024-04-22T19:58:00.405057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490506+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:00.490506+0000","last_peered":"2024-04-22T19:58:00.490506+0000","last_clean":"2024-04-22T19:58:00.490506+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:00.490506+0000","last_undegraded":"2024-04-22T19:58:00.490506+0000","last_fullsized":"2024-04-22T19:58:00.490506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404333+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404333+0000","last_peered":"2024-04-22T19:58:00.404333+0000","last_clean":"2024-04-22T19:58:00.404333+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404333+0000","last_undegraded":"2024-04-22T19:58:00.404333+0000","last_fullsized":"2024-04-22T19:58:00.404333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484910+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:00.484910+0000","last_peered":"2024-04-22T19:58:00.484910+0000","last_clean":"2024-04-22T19:58:00.484910+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:00.484910+0000","last_undegraded":"2024-04-22T19:58:00.484910+0000","last_fullsized":"2024-04-22T19:58:00.484910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'23","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490973+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:00.490973+0000","last_peered":"2024-04-22T19:58:00.490973+0000","last_clean":"2024-04-22T19:58:00.490973+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:00.490973+0000","last_undegraded":"2024-04-22T19:58:00.490973+0000","last_fullsized":"2024-04-22T19:58:00.490973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403420+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403420+0000","last_peered":"2024-04-22T19:58:00.403420+0000","last_clean":"2024-04-22T19:58:00.403420+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403420+0000","last_undegraded":"2024-04-22T19:58:00.403420+0000","last_fullsized":"2024-04-22T19:58:00.403420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'16","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403555+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:00.403555+0000","last_peered":"2024-04-22T19:58:00.403555+0000","last_clean":"2024-04-22T19:58:00.403555+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:00.403555+0000","last_undegraded":"2024-04-22T19:58:00.403555+0000","last_fullsized":"2024-04-22T19:58:00.403555+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:54.651586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'31","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487609+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:00.487609+0000","last_peered":"2024-04-22T19:58:00.487609+0000","last_clean":"2024-04-22T19:58:00.487609+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:00.487609+0000","last_undegraded":"2024-04-22T19:58:00.487609+0000","last_fullsized":"2024-04-22T19:58:00.487609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'19","reported_seq":301,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402407+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:00.402407+0000","last_peered":"2024-04-22T19:58:00.402407+0000","last_clean":"2024-04-22T19:58:00.402407+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:00.402407+0000","last_undegraded":"2024-04-22T19:58:00.402407+0000","last_fullsized":"2024-04-22T19:58:00.402407+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:07.458707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493418+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:00.493418+0000","last_peered":"2024-04-22T19:58:00.493418+0000","last_clean":"2024-04-22T19:58:00.493418+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:00.493418+0000","last_undegraded":"2024-04-22T19:58:00.493418+0000","last_fullsized":"2024-04-22T19:58:00.493418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'18","reported_seq":76,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487784+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:00.487784+0000","last_peered":"2024-04-22T19:58:00.487784+0000","last_clean":"2024-04-22T19:58:00.487784+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:00.487784+0000","last_undegraded":"2024-04-22T19:58:00.487784+0000","last_fullsized":"2024-04-22T19:58:00.487784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405228+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405228+0000","last_peered":"2024-04-22T19:58:00.405228+0000","last_clean":"2024-04-22T19:58:00.405228+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405228+0000","last_undegraded":"2024-04-22T19:58:00.405228+0000","last_fullsized":"2024-04-22T19:58:00.405228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:23.329522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'27","reported_seq":325,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489055+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:00.489055+0000","last_peered":"2024-04-22T19:58:00.489055+0000","last_clean":"2024-04-22T19:58:00.489055+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:00.489055+0000","last_undegraded":"2024-04-22T19:58:00.489055+0000","last_fullsized":"2024-04-22T19:58:00.489055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'34","reported_seq":108,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485798+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:00.485798+0000","last_peered":"2024-04-22T19:58:00.485798+0000","last_clean":"2024-04-22T19:58:00.485798+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:00.485798+0000","last_undegraded":"2024-04-22T19:58:00.485798+0000","last_fullsized":"2024-04-22T19:58:00.485798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'36","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489673+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:00.489673+0000","last_peered":"2024-04-22T19:58:00.489673+0000","last_clean":"2024-04-22T19:58:00.489673+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:00.489673+0000","last_undegraded":"2024-04-22T19:58:00.489673+0000","last_fullsized":"2024-04-22T19:58:00.489673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'31","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403819+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:00.403819+0000","last_peered":"2024-04-22T19:58:00.403819+0000","last_clean":"2024-04-22T19:58:00.403819+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:00.403819+0000","last_undegraded":"2024-04-22T19:58:00.403819+0000","last_fullsized":"2024-04-22T19:58:00.403819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'29","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490942+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:00.490942+0000","last_peered":"2024-04-22T19:58:00.490942+0000","last_clean":"2024-04-22T19:58:00.490942+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:00.490942+0000","last_undegraded":"2024-04-22T19:58:00.490942+0000","last_fullsized":"2024-04-22T19:58:00.490942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403218+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403218+0000","last_peered":"2024-04-22T19:58:00.403218+0000","last_clean":"2024-04-22T19:58:00.403218+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403218+0000","last_undegraded":"2024-04-22T19:58:00.403218+0000","last_fullsized":"2024-04-22T19:58:00.403218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'22","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489472+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:00.489472+0000","last_peered":"2024-04-22T19:58:00.489472+0000","last_clean":"2024-04-22T19:58:00.489472+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:00.489472+0000","last_undegraded":"2024-04-22T19:58:00.489472+0000","last_fullsized":"2024-04-22T19:58:00.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486323+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:00.486323+0000","last_peered":"2024-04-22T19:58:00.486323+0000","last_clean":"2024-04-22T19:58:00.486323+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:00.486323+0000","last_undegraded":"2024-04-22T19:58:00.486323+0000","last_fullsized":"2024-04-22T19:58:00.486323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'28","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486127+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:00.486127+0000","last_peered":"2024-04-22T19:58:00.486127+0000","last_clean":"2024-04-22T19:58:00.486127+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:00.486127+0000","last_undegraded":"2024-04-22T19:58:00.486127+0000","last_fullsized":"2024-04-22T19:58:00.486127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"110'27","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488968+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:00.488968+0000","last_peered":"2024-04-22T19:58:00.488968+0000","last_clean":"2024-04-22T19:58:00.488968+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:00.488968+0000","last_undegraded":"2024-04-22T19:58:00.488968+0000","last_fullsized":"2024-04-22T19:58:00.488968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405158+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405158+0000","last_peered":"2024-04-22T19:58:00.405158+0000","last_clean":"2024-04-22T19:58:00.405158+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405158+0000","last_undegraded":"2024-04-22T19:58:00.405158+0000","last_fullsized":"2024-04-22T19:58:00.405158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401480+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:00.401480+0000","last_peered":"2024-04-22T19:58:00.401480+0000","last_clean":"2024-04-22T19:58:00.401480+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:00.401480+0000","last_undegraded":"2024-04-22T19:58:00.401480+0000","last_fullsized":"2024-04-22T19:58:00.401480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1092,"ondisk_log_size":1092,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386922,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":604,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":311,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1985188,"kb_used_data":1949852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92386652,"statfs":{"total":96636764160,"available":94603931648,"internally_reserved":0,"allocated":1996648448,"data_stored":1995950769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1243132,"kb_used_data":1211956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93128708,"statfs":{"total":96636764160,"available":95363796992,"internally_reserved":0,"allocated":1241042944,"data_stored":1240384017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775960,"kb_used_data":1740624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92595880,"statfs":{"total":96636764160,"available":94818181120,"internally_reserved":0,"allocated":1782398976,"data_stored":1781684417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1961980,"kb_used_data":1926636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92409860,"statfs":{"total":96636764160,"available":94627696640,"internally_reserved":0,"allocated":1972875264,"data_stored":1972231414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1892440,"kb_used_data":1852944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92479400,"statfs":{"total":96636764160,"available":94698905600,"internally_reserved":0,"allocated":1897414656,"data_stored":1896735122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948212,"kb_used_data":912876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93423628,"statfs":{"total":96636764160,"available":95665795072,"internally_reserved":0,"allocated":934785024,"data_stored":934141674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1034552,"kb_used_data":999216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93337288,"statfs":{"total":96636764160,"available":95577382912,"internally_reserved":0,"allocated":1023197184,"data_stored":1022513657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1759824,"kb_used_data":1724480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92612016,"statfs":{"total":96636764160,"available":94834704384,"internally_reserved":0,"allocated":1765867520,"data_stored":1765204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1763704832,"data_stored":1763704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1021313024,"data_stored":1021313024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933232640,"data_stored":933232640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1895825408,"data_stored":1895825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1971322880,"data_stored":1971322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1780482048,"data_stored":1780482048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239416832,"data_stored":1239416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1994391552,"data_stored":1994391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":293527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:12.492 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:12.869 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:12.875 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:12.894 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-22T19:58:11.426586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823914,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3066,"num_read_kb":2749,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3911,"ondisk_log_size":3911,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12601288,"kb_used_data":12318584,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":742373432,"statfs":{"total":773094113280,"available":760190394368,"internally_reserved":0,"allocated":12614230016,"data_stored":12608845372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.027544"},"pg_stats":[{"pgid":"3.3f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487868+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:00.487868+0000","last_peered":"2024-04-22T19:58:00.487868+0000","last_clean":"2024-04-22T19:58:00.487868+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:00.487868+0000","last_undegraded":"2024-04-22T19:58:00.487868+0000","last_fullsized":"2024-04-22T19:58:00.487868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'18","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404530+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:00.404530+0000","last_peered":"2024-04-22T19:58:00.404530+0000","last_clean":"2024-04-22T19:58:00.404530+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:00.404530+0000","last_undegraded":"2024-04-22T19:58:00.404530+0000","last_fullsized":"2024-04-22T19:58:00.404530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405121+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:00.405121+0000","last_peered":"2024-04-22T19:58:00.405121+0000","last_clean":"2024-04-22T19:58:00.405121+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:00.405121+0000","last_undegraded":"2024-04-22T19:58:00.405121+0000","last_fullsized":"2024-04-22T19:58:00.405121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'23","reported_seq":310,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491906+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:00.491906+0000","last_peered":"2024-04-22T19:58:00.491906+0000","last_clean":"2024-04-22T19:58:00.491906+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:00.491906+0000","last_undegraded":"2024-04-22T19:58:00.491906+0000","last_fullsized":"2024-04-22T19:58:00.491906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403422+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403422+0000","last_peered":"2024-04-22T19:58:00.403422+0000","last_clean":"2024-04-22T19:58:00.403422+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403422+0000","last_undegraded":"2024-04-22T19:58:00.403422+0000","last_fullsized":"2024-04-22T19:58:00.403422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'28","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489291+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:00.489291+0000","last_peered":"2024-04-22T19:58:00.489291+0000","last_clean":"2024-04-22T19:58:00.489291+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:00.489291+0000","last_undegraded":"2024-04-22T19:58:00.489291+0000","last_fullsized":"2024-04-22T19:58:00.489291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490875+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490875+0000","last_peered":"2024-04-22T19:58:00.490875+0000","last_clean":"2024-04-22T19:58:00.490875+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490875+0000","last_undegraded":"2024-04-22T19:58:00.490875+0000","last_fullsized":"2024-04-22T19:58:00.490875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'11","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489417+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:00.489417+0000","last_peered":"2024-04-22T19:58:00.489417+0000","last_clean":"2024-04-22T19:58:00.489417+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:00.489417+0000","last_undegraded":"2024-04-22T19:58:00.489417+0000","last_fullsized":"2024-04-22T19:58:00.489417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'23","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486624+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:00.486624+0000","last_peered":"2024-04-22T19:58:00.486624+0000","last_clean":"2024-04-22T19:58:00.486624+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:00.486624+0000","last_undegraded":"2024-04-22T19:58:00.486624+0000","last_fullsized":"2024-04-22T19:58:00.486624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485363+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:00.485363+0000","last_peered":"2024-04-22T19:58:00.485363+0000","last_clean":"2024-04-22T19:58:00.485363+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:00.485363+0000","last_undegraded":"2024-04-22T19:58:00.485363+0000","last_fullsized":"2024-04-22T19:58:00.485363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'16","reported_seq":128,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487089+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:00.487089+0000","last_peered":"2024-04-22T19:58:00.487089+0000","last_clean":"2024-04-22T19:58:00.487089+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:00.487089+0000","last_undegraded":"2024-04-22T19:58:00.487089+0000","last_fullsized":"2024-04-22T19:58:00.487089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493301+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:00.493301+0000","last_peered":"2024-04-22T19:58:00.493301+0000","last_clean":"2024-04-22T19:58:00.493301+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:00.493301+0000","last_undegraded":"2024-04-22T19:58:00.493301+0000","last_fullsized":"2024-04-22T19:58:00.493301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493680+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:00.493680+0000","last_peered":"2024-04-22T19:58:00.493680+0000","last_clean":"2024-04-22T19:58:00.493680+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:00.493680+0000","last_undegraded":"2024-04-22T19:58:00.493680+0000","last_fullsized":"2024-04-22T19:58:00.493680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'21","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402285+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:00.402285+0000","last_peered":"2024-04-22T19:58:00.402285+0000","last_clean":"2024-04-22T19:58:00.402285+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:00.402285+0000","last_undegraded":"2024-04-22T19:58:00.402285+0000","last_fullsized":"2024-04-22T19:58:00.402285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'32","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403823+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:00.403823+0000","last_peered":"2024-04-22T19:58:00.403823+0000","last_clean":"2024-04-22T19:58:00.403823+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:00.403823+0000","last_undegraded":"2024-04-22T19:58:00.403823+0000","last_fullsized":"2024-04-22T19:58:00.403823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'27","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489495+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:00.489495+0000","last_peered":"2024-04-22T19:58:00.489495+0000","last_clean":"2024-04-22T19:58:00.489495+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:00.489495+0000","last_undegraded":"2024-04-22T19:58:00.489495+0000","last_fullsized":"2024-04-22T19:58:00.489495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405197+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:00.405197+0000","last_peered":"2024-04-22T19:58:00.405197+0000","last_clean":"2024-04-22T19:58:00.405197+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:00.405197+0000","last_undegraded":"2024-04-22T19:58:00.405197+0000","last_fullsized":"2024-04-22T19:58:00.405197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'27","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403836+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:00.403836+0000","last_peered":"2024-04-22T19:58:00.403836+0000","last_clean":"2024-04-22T19:58:00.403836+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:00.403836+0000","last_undegraded":"2024-04-22T19:58:00.403836+0000","last_fullsized":"2024-04-22T19:58:00.403836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":47,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487480+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:00.487480+0000","last_peered":"2024-04-22T19:58:00.487480+0000","last_clean":"2024-04-22T19:58:00.487480+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:00.487480+0000","last_undegraded":"2024-04-22T19:58:00.487480+0000","last_fullsized":"2024-04-22T19:58:00.487480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403429+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403429+0000","last_peered":"2024-04-22T19:58:00.403429+0000","last_clean":"2024-04-22T19:58:00.403429+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403429+0000","last_undegraded":"2024-04-22T19:58:00.403429+0000","last_fullsized":"2024-04-22T19:58:00.403429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405797+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405797+0000","last_peered":"2024-04-22T19:58:00.405797+0000","last_clean":"2024-04-22T19:58:00.405797+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405797+0000","last_undegraded":"2024-04-22T19:58:00.405797+0000","last_fullsized":"2024-04-22T19:58:00.405797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:03.662478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486690+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:00.486690+0000","last_peered":"2024-04-22T19:58:00.486690+0000","last_clean":"2024-04-22T19:58:00.486690+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:00.486690+0000","last_undegraded":"2024-04-22T19:58:00.486690+0000","last_fullsized":"2024-04-22T19:58:00.486690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'135","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645684+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:03.645684+0000","last_peered":"2024-04-22T19:58:03.645684+0000","last_clean":"2024-04-22T19:58:03.645684+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:03.645684+0000","last_undegraded":"2024-04-22T19:58:03.645684+0000","last_fullsized":"2024-04-22T19:58:03.645684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'30","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490735+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:00.490735+0000","last_peered":"2024-04-22T19:58:00.490735+0000","last_clean":"2024-04-22T19:58:00.490735+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:00.490735+0000","last_undegraded":"2024-04-22T19:58:00.490735+0000","last_fullsized":"2024-04-22T19:58:00.490735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'18","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487740+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:00.487740+0000","last_peered":"2024-04-22T19:58:00.487740+0000","last_clean":"2024-04-22T19:58:00.487740+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:00.487740+0000","last_undegraded":"2024-04-22T19:58:00.487740+0000","last_fullsized":"2024-04-22T19:58:00.487740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"128'141","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645079+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:03.645079+0000","last_peered":"2024-04-22T19:58:03.645079+0000","last_clean":"2024-04-22T19:58:03.645079+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:03.645079+0000","last_undegraded":"2024-04-22T19:58:03.645079+0000","last_fullsized":"2024-04-22T19:58:03.645079+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488107+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:00.488107+0000","last_peered":"2024-04-22T19:58:00.488107+0000","last_clean":"2024-04-22T19:58:00.488107+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:00.488107+0000","last_undegraded":"2024-04-22T19:58:00.488107+0000","last_fullsized":"2024-04-22T19:58:00.488107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487464+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:00.487464+0000","last_peered":"2024-04-22T19:58:00.487464+0000","last_clean":"2024-04-22T19:58:00.487464+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:00.487464+0000","last_undegraded":"2024-04-22T19:58:00.487464+0000","last_fullsized":"2024-04-22T19:58:00.487464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399938+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.399938+0000","last_peered":"2024-04-22T19:58:00.399938+0000","last_clean":"2024-04-22T19:58:00.399938+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.399938+0000","last_undegraded":"2024-04-22T19:58:00.399938+0000","last_fullsized":"2024-04-22T19:58:00.399938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'30","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487876+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:00.487876+0000","last_peered":"2024-04-22T19:58:00.487876+0000","last_clean":"2024-04-22T19:58:00.487876+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:00.487876+0000","last_undegraded":"2024-04-22T19:58:00.487876+0000","last_fullsized":"2024-04-22T19:58:00.487876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'17","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486948+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:00.486948+0000","last_peered":"2024-04-22T19:58:00.486948+0000","last_clean":"2024-04-22T19:58:00.486948+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:00.486948+0000","last_undegraded":"2024-04-22T19:58:00.486948+0000","last_fullsized":"2024-04-22T19:58:00.486948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'25","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489043+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:00.489043+0000","last_peered":"2024-04-22T19:58:00.489043+0000","last_clean":"2024-04-22T19:58:00.489043+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:00.489043+0000","last_undegraded":"2024-04-22T19:58:00.489043+0000","last_fullsized":"2024-04-22T19:58:00.489043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'24","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486021+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:00.486021+0000","last_peered":"2024-04-22T19:58:00.486021+0000","last_clean":"2024-04-22T19:58:00.486021+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:00.486021+0000","last_undegraded":"2024-04-22T19:58:00.486021+0000","last_fullsized":"2024-04-22T19:58:00.486021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'135","reported_seq":390,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645400+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:03.645400+0000","last_peered":"2024-04-22T19:58:03.645400+0000","last_clean":"2024-04-22T19:58:03.645400+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:03.645400+0000","last_undegraded":"2024-04-22T19:58:03.645400+0000","last_fullsized":"2024-04-22T19:58:03.645400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405362+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405362+0000","last_peered":"2024-04-22T19:58:00.405362+0000","last_clean":"2024-04-22T19:58:00.405362+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405362+0000","last_undegraded":"2024-04-22T19:58:00.405362+0000","last_fullsized":"2024-04-22T19:58:00.405362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404257+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404257+0000","last_peered":"2024-04-22T19:58:00.404257+0000","last_clean":"2024-04-22T19:58:00.404257+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404257+0000","last_undegraded":"2024-04-22T19:58:00.404257+0000","last_fullsized":"2024-04-22T19:58:00.404257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'25","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492146+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:00.492146+0000","last_peered":"2024-04-22T19:58:00.492146+0000","last_clean":"2024-04-22T19:58:00.492146+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:00.492146+0000","last_undegraded":"2024-04-22T19:58:00.492146+0000","last_fullsized":"2024-04-22T19:58:00.492146+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'30","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403345+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:00.403345+0000","last_peered":"2024-04-22T19:58:00.403345+0000","last_clean":"2024-04-22T19:58:00.403345+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:00.403345+0000","last_undegraded":"2024-04-22T19:58:00.403345+0000","last_fullsized":"2024-04-22T19:58:00.403345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403953+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.403953+0000","last_peered":"2024-04-22T19:58:00.403953+0000","last_clean":"2024-04-22T19:58:00.403953+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.403953+0000","last_undegraded":"2024-04-22T19:58:00.403953+0000","last_fullsized":"2024-04-22T19:58:00.403953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:23.427873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486634+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:00.486634+0000","last_peered":"2024-04-22T19:58:00.486634+0000","last_clean":"2024-04-22T19:58:00.486634+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:00.486634+0000","last_undegraded":"2024-04-22T19:58:00.486634+0000","last_fullsized":"2024-04-22T19:58:00.486634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'19","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404161+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:00.404161+0000","last_peered":"2024-04-22T19:58:00.404161+0000","last_clean":"2024-04-22T19:58:00.404161+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:00.404161+0000","last_undegraded":"2024-04-22T19:58:00.404161+0000","last_fullsized":"2024-04-22T19:58:00.404161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405099+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405099+0000","last_peered":"2024-04-22T19:58:00.405099+0000","last_clean":"2024-04-22T19:58:00.405099+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405099+0000","last_undegraded":"2024-04-22T19:58:00.405099+0000","last_fullsized":"2024-04-22T19:58:00.405099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492958+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:00.492958+0000","last_peered":"2024-04-22T19:58:00.492958+0000","last_clean":"2024-04-22T19:58:00.492958+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:00.492958+0000","last_undegraded":"2024-04-22T19:58:00.492958+0000","last_fullsized":"2024-04-22T19:58:00.492958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402426+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402426+0000","last_peered":"2024-04-22T19:58:00.402426+0000","last_clean":"2024-04-22T19:58:00.402426+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402426+0000","last_undegraded":"2024-04-22T19:58:00.402426+0000","last_fullsized":"2024-04-22T19:58:00.402426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'23","reported_seq":286,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486495+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:00.486495+0000","last_peered":"2024-04-22T19:58:00.486495+0000","last_clean":"2024-04-22T19:58:00.486495+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:00.486495+0000","last_undegraded":"2024-04-22T19:58:00.486495+0000","last_fullsized":"2024-04-22T19:58:00.486495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'135","reported_seq":403,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400977+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.400977+0000","last_peered":"2024-04-22T19:58:00.400977+0000","last_clean":"2024-04-22T19:58:00.400977+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.400977+0000","last_undegraded":"2024-04-22T19:58:00.400977+0000","last_fullsized":"2024-04-22T19:58:00.400977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'34","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401789+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:00.401789+0000","last_peered":"2024-04-22T19:58:00.401789+0000","last_clean":"2024-04-22T19:58:00.401789+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:00.401789+0000","last_undegraded":"2024-04-22T19:58:00.401789+0000","last_fullsized":"2024-04-22T19:58:00.401789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":396,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'135","reported_seq":435,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"109'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485602+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:00.485602+0000","last_peered":"2024-04-22T19:58:00.485602+0000","last_clean":"2024-04-22T19:58:00.485602+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:00.485602+0000","last_undegraded":"2024-04-22T19:58:00.485602+0000","last_fullsized":"2024-04-22T19:58:00.485602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'26","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491674+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:00.491674+0000","last_peered":"2024-04-22T19:58:00.491674+0000","last_clean":"2024-04-22T19:58:00.491674+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:00.491674+0000","last_undegraded":"2024-04-22T19:58:00.491674+0000","last_fullsized":"2024-04-22T19:58:00.491674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399679+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399679+0000","last_peered":"2024-04-22T19:58:00.399679+0000","last_clean":"2024-04-22T19:58:00.399679+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399679+0000","last_undegraded":"2024-04-22T19:58:00.399679+0000","last_fullsized":"2024-04-22T19:58:00.399679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491504+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491504+0000","last_peered":"2024-04-22T19:58:00.491504+0000","last_clean":"2024-04-22T19:58:00.491504+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491504+0000","last_undegraded":"2024-04-22T19:58:00.491504+0000","last_fullsized":"2024-04-22T19:58:00.491504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":80,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486632+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:00.486632+0000","last_peered":"2024-04-22T19:58:00.486632+0000","last_clean":"2024-04-22T19:58:00.486632+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:00.486632+0000","last_undegraded":"2024-04-22T19:58:00.486632+0000","last_fullsized":"2024-04-22T19:58:00.486632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'37","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492246+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:00.492246+0000","last_peered":"2024-04-22T19:58:00.492246+0000","last_clean":"2024-04-22T19:58:00.492246+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:00.492246+0000","last_undegraded":"2024-04-22T19:58:00.492246+0000","last_fullsized":"2024-04-22T19:58:00.492246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405389+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405389+0000","last_peered":"2024-04-22T19:58:00.405389+0000","last_clean":"2024-04-22T19:58:00.405389+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405389+0000","last_undegraded":"2024-04-22T19:58:00.405389+0000","last_fullsized":"2024-04-22T19:58:00.405389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405703+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405703+0000","last_peered":"2024-04-22T19:58:00.405703+0000","last_clean":"2024-04-22T19:58:00.405703+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405703+0000","last_undegraded":"2024-04-22T19:58:00.405703+0000","last_fullsized":"2024-04-22T19:58:00.405703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485965+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485965+0000","last_peered":"2024-04-22T19:58:00.485965+0000","last_clean":"2024-04-22T19:58:00.485965+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485965+0000","last_undegraded":"2024-04-22T19:58:00.485965+0000","last_fullsized":"2024-04-22T19:58:00.485965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'20","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403486+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:00.403486+0000","last_peered":"2024-04-22T19:58:00.403486+0000","last_clean":"2024-04-22T19:58:00.403486+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:00.403486+0000","last_undegraded":"2024-04-22T19:58:00.403486+0000","last_fullsized":"2024-04-22T19:58:00.403486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'138","reported_seq":456,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":163,"num_write":30,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399623+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399623+0000","last_peered":"2024-04-22T19:58:00.399623+0000","last_clean":"2024-04-22T19:58:00.399623+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399623+0000","last_undegraded":"2024-04-22T19:58:00.399623+0000","last_fullsized":"2024-04-22T19:58:00.399623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405126+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405126+0000","last_peered":"2024-04-22T19:58:00.405126+0000","last_clean":"2024-04-22T19:58:00.405126+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405126+0000","last_undegraded":"2024-04-22T19:58:00.405126+0000","last_fullsized":"2024-04-22T19:58:00.405126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485136+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485136+0000","last_peered":"2024-04-22T19:58:00.485136+0000","last_clean":"2024-04-22T19:58:00.485136+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485136+0000","last_undegraded":"2024-04-22T19:58:00.485136+0000","last_fullsized":"2024-04-22T19:58:00.485136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402613+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:00.402613+0000","last_peered":"2024-04-22T19:58:00.402613+0000","last_clean":"2024-04-22T19:58:00.402613+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:00.402613+0000","last_undegraded":"2024-04-22T19:58:00.402613+0000","last_fullsized":"2024-04-22T19:58:00.402613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":306,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486116+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:00.486116+0000","last_peered":"2024-04-22T19:58:00.486116+0000","last_clean":"2024-04-22T19:58:00.486116+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:00.486116+0000","last_undegraded":"2024-04-22T19:58:00.486116+0000","last_fullsized":"2024-04-22T19:58:00.486116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'16","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403797+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403797+0000","last_peered":"2024-04-22T19:58:00.403797+0000","last_clean":"2024-04-22T19:58:00.403797+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403797+0000","last_undegraded":"2024-04-22T19:58:00.403797+0000","last_fullsized":"2024-04-22T19:58:00.403797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402931+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.402931+0000","last_peered":"2024-04-22T19:58:00.402931+0000","last_clean":"2024-04-22T19:58:00.402931+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.402931+0000","last_undegraded":"2024-04-22T19:58:00.402931+0000","last_fullsized":"2024-04-22T19:58:00.402931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491149+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491149+0000","last_peered":"2024-04-22T19:58:00.491149+0000","last_clean":"2024-04-22T19:58:00.491149+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491149+0000","last_undegraded":"2024-04-22T19:58:00.491149+0000","last_fullsized":"2024-04-22T19:58:00.491149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403427+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:00.403427+0000","last_peered":"2024-04-22T19:58:00.403427+0000","last_clean":"2024-04-22T19:58:00.403427+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:00.403427+0000","last_undegraded":"2024-04-22T19:58:00.403427+0000","last_fullsized":"2024-04-22T19:58:00.403427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404832+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404832+0000","last_peered":"2024-04-22T19:58:00.404832+0000","last_clean":"2024-04-22T19:58:00.404832+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404832+0000","last_undegraded":"2024-04-22T19:58:00.404832+0000","last_fullsized":"2024-04-22T19:58:00.404832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400634+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400634+0000","last_peered":"2024-04-22T19:58:00.400634+0000","last_clean":"2024-04-22T19:58:00.400634+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400634+0000","last_undegraded":"2024-04-22T19:58:00.400634+0000","last_fullsized":"2024-04-22T19:58:00.400634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'18","reported_seq":298,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492228+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:00.492228+0000","last_peered":"2024-04-22T19:58:00.492228+0000","last_clean":"2024-04-22T19:58:00.492228+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:00.492228+0000","last_undegraded":"2024-04-22T19:58:00.492228+0000","last_fullsized":"2024-04-22T19:58:00.492228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403589+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:00.403589+0000","last_peered":"2024-04-22T19:58:00.403589+0000","last_clean":"2024-04-22T19:58:00.403589+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:00.403589+0000","last_undegraded":"2024-04-22T19:58:00.403589+0000","last_fullsized":"2024-04-22T19:58:00.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403696+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403696+0000","last_peered":"2024-04-22T19:58:00.403696+0000","last_clean":"2024-04-22T19:58:00.403696+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403696+0000","last_undegraded":"2024-04-22T19:58:00.403696+0000","last_fullsized":"2024-04-22T19:58:00.403696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'35","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399220+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:00.399220+0000","last_peered":"2024-04-22T19:58:00.399220+0000","last_clean":"2024-04-22T19:58:00.399220+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.399220+0000","last_undegraded":"2024-04-22T19:58:00.399220+0000","last_fullsized":"2024-04-22T19:58:00.399220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:38.161593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404915+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404915+0000","last_peered":"2024-04-22T19:58:00.404915+0000","last_clean":"2024-04-22T19:58:00.404915+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404915+0000","last_undegraded":"2024-04-22T19:58:00.404915+0000","last_fullsized":"2024-04-22T19:58:00.404915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404153+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404153+0000","last_peered":"2024-04-22T19:58:00.404153+0000","last_clean":"2024-04-22T19:58:00.404153+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404153+0000","last_undegraded":"2024-04-22T19:58:00.404153+0000","last_fullsized":"2024-04-22T19:58:00.404153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403175+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:00.403175+0000","last_peered":"2024-04-22T19:58:00.403175+0000","last_clean":"2024-04-22T19:58:00.403175+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:00.403175+0000","last_undegraded":"2024-04-22T19:58:00.403175+0000","last_fullsized":"2024-04-22T19:58:00.403175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489726+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489726+0000","last_peered":"2024-04-22T19:58:00.489726+0000","last_clean":"2024-04-22T19:58:00.489726+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489726+0000","last_undegraded":"2024-04-22T19:58:00.489726+0000","last_fullsized":"2024-04-22T19:58:00.489726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400210+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400210+0000","last_peered":"2024-04-22T19:58:00.400210+0000","last_clean":"2024-04-22T19:58:00.400210+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400210+0000","last_undegraded":"2024-04-22T19:58:00.400210+0000","last_fullsized":"2024-04-22T19:58:00.400210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'135","reported_seq":389,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.646418+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:03.646418+0000","last_peered":"2024-04-22T19:58:03.646418+0000","last_clean":"2024-04-22T19:58:03.646418+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:03.646418+0000","last_undegraded":"2024-04-22T19:58:03.646418+0000","last_fullsized":"2024-04-22T19:58:03.646418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'16","reported_seq":72,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487578+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:00.487578+0000","last_peered":"2024-04-22T19:58:00.487578+0000","last_clean":"2024-04-22T19:58:00.487578+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:00.487578+0000","last_undegraded":"2024-04-22T19:58:00.487578+0000","last_fullsized":"2024-04-22T19:58:00.487578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404614+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404614+0000","last_peered":"2024-04-22T19:58:00.404614+0000","last_clean":"2024-04-22T19:58:00.404614+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404614+0000","last_undegraded":"2024-04-22T19:58:00.404614+0000","last_fullsized":"2024-04-22T19:58:00.404614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'141","reported_seq":465,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645052+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:03.645052+0000","last_peered":"2024-04-22T19:58:03.645052+0000","last_clean":"2024-04-22T19:58:03.645052+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:03.645052+0000","last_undegraded":"2024-04-22T19:58:03.645052+0000","last_fullsized":"2024-04-22T19:58:03.645052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404604+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404604+0000","last_peered":"2024-04-22T19:58:00.404604+0000","last_clean":"2024-04-22T19:58:00.404604+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404604+0000","last_undegraded":"2024-04-22T19:58:00.404604+0000","last_fullsized":"2024-04-22T19:58:00.404604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:39.990552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405842+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:00.405842+0000","last_peered":"2024-04-22T19:58:00.405842+0000","last_clean":"2024-04-22T19:58:00.405842+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:00.405842+0000","last_undegraded":"2024-04-22T19:58:00.405842+0000","last_fullsized":"2024-04-22T19:58:00.405842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'45","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488495+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:00.488495+0000","last_peered":"2024-04-22T19:58:00.488495+0000","last_clean":"2024-04-22T19:58:00.488495+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:00.488495+0000","last_undegraded":"2024-04-22T19:58:00.488495+0000","last_fullsized":"2024-04-22T19:58:00.488495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404977+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.404977+0000","last_peered":"2024-04-22T19:58:00.404977+0000","last_clean":"2024-04-22T19:58:00.404977+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.404977+0000","last_undegraded":"2024-04-22T19:58:00.404977+0000","last_fullsized":"2024-04-22T19:58:00.404977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402134+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:00.402134+0000","last_peered":"2024-04-22T19:58:00.402134+0000","last_clean":"2024-04-22T19:58:00.402134+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:00.402134+0000","last_undegraded":"2024-04-22T19:58:00.402134+0000","last_fullsized":"2024-04-22T19:58:00.402134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401039+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401039+0000","last_peered":"2024-04-22T19:58:00.401039+0000","last_clean":"2024-04-22T19:58:00.401039+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401039+0000","last_undegraded":"2024-04-22T19:58:00.401039+0000","last_fullsized":"2024-04-22T19:58:00.401039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485520+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:00.485520+0000","last_peered":"2024-04-22T19:58:00.485520+0000","last_clean":"2024-04-22T19:58:00.485520+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:00.485520+0000","last_undegraded":"2024-04-22T19:58:00.485520+0000","last_fullsized":"2024-04-22T19:58:00.485520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400380+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400380+0000","last_peered":"2024-04-22T19:58:00.400380+0000","last_clean":"2024-04-22T19:58:00.400380+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400380+0000","last_undegraded":"2024-04-22T19:58:00.400380+0000","last_fullsized":"2024-04-22T19:58:00.400380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'29","reported_seq":335,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488786+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:00.488786+0000","last_peered":"2024-04-22T19:58:00.488786+0000","last_clean":"2024-04-22T19:58:00.488786+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:00.488786+0000","last_undegraded":"2024-04-22T19:58:00.488786+0000","last_fullsized":"2024-04-22T19:58:00.488786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398955+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.398955+0000","last_peered":"2024-04-22T19:58:00.398955+0000","last_clean":"2024-04-22T19:58:00.398955+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.398955+0000","last_undegraded":"2024-04-22T19:58:00.398955+0000","last_fullsized":"2024-04-22T19:58:00.398955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404670+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404670+0000","last_peered":"2024-04-22T19:58:00.404670+0000","last_clean":"2024-04-22T19:58:00.404670+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404670+0000","last_undegraded":"2024-04-22T19:58:00.404670+0000","last_fullsized":"2024-04-22T19:58:00.404670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492364+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:00.492364+0000","last_peered":"2024-04-22T19:58:00.492364+0000","last_clean":"2024-04-22T19:58:00.492364+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:00.492364+0000","last_undegraded":"2024-04-22T19:58:00.492364+0000","last_fullsized":"2024-04-22T19:58:00.492364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486681+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:00.486681+0000","last_peered":"2024-04-22T19:58:00.486681+0000","last_clean":"2024-04-22T19:58:00.486681+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:00.486681+0000","last_undegraded":"2024-04-22T19:58:00.486681+0000","last_fullsized":"2024-04-22T19:58:00.486681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'17","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405364+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:00.405364+0000","last_peered":"2024-04-22T19:58:00.405364+0000","last_clean":"2024-04-22T19:58:00.405364+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:00.405364+0000","last_undegraded":"2024-04-22T19:58:00.405364+0000","last_fullsized":"2024-04-22T19:58:00.405364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'17","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486240+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:00.486240+0000","last_peered":"2024-04-22T19:58:00.486240+0000","last_clean":"2024-04-22T19:58:00.486240+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:00.486240+0000","last_undegraded":"2024-04-22T19:58:00.486240+0000","last_fullsized":"2024-04-22T19:58:00.486240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403251+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403251+0000","last_peered":"2024-04-22T19:58:00.403251+0000","last_clean":"2024-04-22T19:58:00.403251+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403251+0000","last_undegraded":"2024-04-22T19:58:00.403251+0000","last_fullsized":"2024-04-22T19:58:00.403251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485805+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:00.485805+0000","last_peered":"2024-04-22T19:58:00.485805+0000","last_clean":"2024-04-22T19:58:00.485805+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:00.485805+0000","last_undegraded":"2024-04-22T19:58:00.485805+0000","last_fullsized":"2024-04-22T19:58:00.485805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405531+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:00.405531+0000","last_peered":"2024-04-22T19:58:00.405531+0000","last_clean":"2024-04-22T19:58:00.405531+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:00.405531+0000","last_undegraded":"2024-04-22T19:58:00.405531+0000","last_fullsized":"2024-04-22T19:58:00.405531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400696+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:00.400696+0000","last_peered":"2024-04-22T19:58:00.400696+0000","last_clean":"2024-04-22T19:58:00.400696+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:00.400696+0000","last_undegraded":"2024-04-22T19:58:00.400696+0000","last_fullsized":"2024-04-22T19:58:00.400696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405680+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:00.405680+0000","last_peered":"2024-04-22T19:58:00.405680+0000","last_clean":"2024-04-22T19:58:00.405680+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:00.405680+0000","last_undegraded":"2024-04-22T19:58:00.405680+0000","last_fullsized":"2024-04-22T19:58:00.405680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'22","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401881+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:00.401881+0000","last_peered":"2024-04-22T19:58:00.401881+0000","last_clean":"2024-04-22T19:58:00.401881+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:00.401881+0000","last_undegraded":"2024-04-22T19:58:00.401881+0000","last_fullsized":"2024-04-22T19:58:00.401881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:59.453198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'23","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486786+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:00.486786+0000","last_peered":"2024-04-22T19:58:00.486786+0000","last_clean":"2024-04-22T19:58:00.486786+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:00.486786+0000","last_undegraded":"2024-04-22T19:58:00.486786+0000","last_fullsized":"2024-04-22T19:58:00.486786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401214+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401214+0000","last_peered":"2024-04-22T19:58:00.401214+0000","last_clean":"2024-04-22T19:58:00.401214+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401214+0000","last_undegraded":"2024-04-22T19:58:00.401214+0000","last_fullsized":"2024-04-22T19:58:00.401214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'20","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402622+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:00.402622+0000","last_peered":"2024-04-22T19:58:00.402622+0000","last_clean":"2024-04-22T19:58:00.402622+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:00.402622+0000","last_undegraded":"2024-04-22T19:58:00.402622+0000","last_fullsized":"2024-04-22T19:58:00.402622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487530+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:00.487530+0000","last_peered":"2024-04-22T19:58:00.487530+0000","last_clean":"2024-04-22T19:58:00.487530+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:00.487530+0000","last_undegraded":"2024-04-22T19:58:00.487530+0000","last_fullsized":"2024-04-22T19:58:00.487530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399918+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.399918+0000","last_peered":"2024-04-22T19:58:00.399918+0000","last_clean":"2024-04-22T19:58:00.399918+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.399918+0000","last_undegraded":"2024-04-22T19:58:00.399918+0000","last_fullsized":"2024-04-22T19:58:00.399918+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:49:58.016491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403254+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:00.403254+0000","last_peered":"2024-04-22T19:58:00.403254+0000","last_clean":"2024-04-22T19:58:00.403254+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:00.403254+0000","last_undegraded":"2024-04-22T19:58:00.403254+0000","last_fullsized":"2024-04-22T19:58:00.403254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401713+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401713+0000","last_peered":"2024-04-22T19:58:00.401713+0000","last_clean":"2024-04-22T19:58:00.401713+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401713+0000","last_undegraded":"2024-04-22T19:58:00.401713+0000","last_fullsized":"2024-04-22T19:58:00.401713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'135","reported_seq":417,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645767+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:03.645767+0000","last_peered":"2024-04-22T19:58:03.645767+0000","last_clean":"2024-04-22T19:58:03.645767+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:03.645767+0000","last_undegraded":"2024-04-22T19:58:03.645767+0000","last_fullsized":"2024-04-22T19:58:03.645767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488771+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:00.488771+0000","last_peered":"2024-04-22T19:58:00.488771+0000","last_clean":"2024-04-22T19:58:00.488771+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:00.488771+0000","last_undegraded":"2024-04-22T19:58:00.488771+0000","last_fullsized":"2024-04-22T19:58:00.488771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398468+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398468+0000","last_peered":"2024-04-22T19:58:00.398468+0000","last_clean":"2024-04-22T19:58:00.398468+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398468+0000","last_undegraded":"2024-04-22T19:58:00.398468+0000","last_fullsized":"2024-04-22T19:58:00.398468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492192+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:00.492192+0000","last_peered":"2024-04-22T19:58:00.492192+0000","last_clean":"2024-04-22T19:58:00.492192+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:00.492192+0000","last_undegraded":"2024-04-22T19:58:00.492192+0000","last_fullsized":"2024-04-22T19:58:00.492192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398675+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:00.398675+0000","last_peered":"2024-04-22T19:58:00.398675+0000","last_clean":"2024-04-22T19:58:00.398675+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:00.398675+0000","last_undegraded":"2024-04-22T19:58:00.398675+0000","last_fullsized":"2024-04-22T19:58:00.398675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'13","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487401+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:00.487401+0000","last_peered":"2024-04-22T19:58:00.487401+0000","last_clean":"2024-04-22T19:58:00.487401+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:00.487401+0000","last_undegraded":"2024-04-22T19:58:00.487401+0000","last_fullsized":"2024-04-22T19:58:00.487401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'23","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405337+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:00.405337+0000","last_peered":"2024-04-22T19:58:00.405337+0000","last_clean":"2024-04-22T19:58:00.405337+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:00.405337+0000","last_undegraded":"2024-04-22T19:58:00.405337+0000","last_fullsized":"2024-04-22T19:58:00.405337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400493+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400493+0000","last_peered":"2024-04-22T19:58:00.400493+0000","last_clean":"2024-04-22T19:58:00.400493+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400493+0000","last_undegraded":"2024-04-22T19:58:00.400493+0000","last_fullsized":"2024-04-22T19:58:00.400493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401679+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:00.401679+0000","last_peered":"2024-04-22T19:58:00.401679+0000","last_clean":"2024-04-22T19:58:00.401679+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:00.401679+0000","last_undegraded":"2024-04-22T19:58:00.401679+0000","last_fullsized":"2024-04-22T19:58:00.401679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403081+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403081+0000","last_peered":"2024-04-22T19:58:00.403081+0000","last_clean":"2024-04-22T19:58:00.403081+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403081+0000","last_undegraded":"2024-04-22T19:58:00.403081+0000","last_fullsized":"2024-04-22T19:58:00.403081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405057+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405057+0000","last_peered":"2024-04-22T19:58:00.405057+0000","last_clean":"2024-04-22T19:58:00.405057+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405057+0000","last_undegraded":"2024-04-22T19:58:00.405057+0000","last_fullsized":"2024-04-22T19:58:00.405057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490506+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:00.490506+0000","last_peered":"2024-04-22T19:58:00.490506+0000","last_clean":"2024-04-22T19:58:00.490506+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:00.490506+0000","last_undegraded":"2024-04-22T19:58:00.490506+0000","last_fullsized":"2024-04-22T19:58:00.490506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404333+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404333+0000","last_peered":"2024-04-22T19:58:00.404333+0000","last_clean":"2024-04-22T19:58:00.404333+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404333+0000","last_undegraded":"2024-04-22T19:58:00.404333+0000","last_fullsized":"2024-04-22T19:58:00.404333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484910+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:00.484910+0000","last_peered":"2024-04-22T19:58:00.484910+0000","last_clean":"2024-04-22T19:58:00.484910+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:00.484910+0000","last_undegraded":"2024-04-22T19:58:00.484910+0000","last_fullsized":"2024-04-22T19:58:00.484910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'23","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490973+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:00.490973+0000","last_peered":"2024-04-22T19:58:00.490973+0000","last_clean":"2024-04-22T19:58:00.490973+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:00.490973+0000","last_undegraded":"2024-04-22T19:58:00.490973+0000","last_fullsized":"2024-04-22T19:58:00.490973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403420+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403420+0000","last_peered":"2024-04-22T19:58:00.403420+0000","last_clean":"2024-04-22T19:58:00.403420+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403420+0000","last_undegraded":"2024-04-22T19:58:00.403420+0000","last_fullsized":"2024-04-22T19:58:00.403420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'16","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403555+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:00.403555+0000","last_peered":"2024-04-22T19:58:00.403555+0000","last_clean":"2024-04-22T19:58:00.403555+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:00.403555+0000","last_undegraded":"2024-04-22T19:58:00.403555+0000","last_fullsized":"2024-04-22T19:58:00.403555+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:54.651586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'31","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487609+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:00.487609+0000","last_peered":"2024-04-22T19:58:00.487609+0000","last_clean":"2024-04-22T19:58:00.487609+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:00.487609+0000","last_undegraded":"2024-04-22T19:58:00.487609+0000","last_fullsized":"2024-04-22T19:58:00.487609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'19","reported_seq":301,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402407+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:00.402407+0000","last_peered":"2024-04-22T19:58:00.402407+0000","last_clean":"2024-04-22T19:58:00.402407+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:00.402407+0000","last_undegraded":"2024-04-22T19:58:00.402407+0000","last_fullsized":"2024-04-22T19:58:00.402407+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:07.458707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493418+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:00.493418+0000","last_peered":"2024-04-22T19:58:00.493418+0000","last_clean":"2024-04-22T19:58:00.493418+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:00.493418+0000","last_undegraded":"2024-04-22T19:58:00.493418+0000","last_fullsized":"2024-04-22T19:58:00.493418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'18","reported_seq":76,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487784+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:00.487784+0000","last_peered":"2024-04-22T19:58:00.487784+0000","last_clean":"2024-04-22T19:58:00.487784+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:00.487784+0000","last_undegraded":"2024-04-22T19:58:00.487784+0000","last_fullsized":"2024-04-22T19:58:00.487784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405228+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405228+0000","last_peered":"2024-04-22T19:58:00.405228+0000","last_clean":"2024-04-22T19:58:00.405228+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405228+0000","last_undegraded":"2024-04-22T19:58:00.405228+0000","last_fullsized":"2024-04-22T19:58:00.405228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:23.329522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'27","reported_seq":325,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489055+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:00.489055+0000","last_peered":"2024-04-22T19:58:00.489055+0000","last_clean":"2024-04-22T19:58:00.489055+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:00.489055+0000","last_undegraded":"2024-04-22T19:58:00.489055+0000","last_fullsized":"2024-04-22T19:58:00.489055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'34","reported_seq":108,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485798+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:00.485798+0000","last_peered":"2024-04-22T19:58:00.485798+0000","last_clean":"2024-04-22T19:58:00.485798+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:00.485798+0000","last_undegraded":"2024-04-22T19:58:00.485798+0000","last_fullsized":"2024-04-22T19:58:00.485798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'36","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489673+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:00.489673+0000","last_peered":"2024-04-22T19:58:00.489673+0000","last_clean":"2024-04-22T19:58:00.489673+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:00.489673+0000","last_undegraded":"2024-04-22T19:58:00.489673+0000","last_fullsized":"2024-04-22T19:58:00.489673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'31","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403819+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:00.403819+0000","last_peered":"2024-04-22T19:58:00.403819+0000","last_clean":"2024-04-22T19:58:00.403819+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:00.403819+0000","last_undegraded":"2024-04-22T19:58:00.403819+0000","last_fullsized":"2024-04-22T19:58:00.403819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'29","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490942+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:00.490942+0000","last_peered":"2024-04-22T19:58:00.490942+0000","last_clean":"2024-04-22T19:58:00.490942+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:00.490942+0000","last_undegraded":"2024-04-22T19:58:00.490942+0000","last_fullsized":"2024-04-22T19:58:00.490942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403218+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403218+0000","last_peered":"2024-04-22T19:58:00.403218+0000","last_clean":"2024-04-22T19:58:00.403218+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403218+0000","last_undegraded":"2024-04-22T19:58:00.403218+0000","last_fullsized":"2024-04-22T19:58:00.403218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'22","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489472+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:00.489472+0000","last_peered":"2024-04-22T19:58:00.489472+0000","last_clean":"2024-04-22T19:58:00.489472+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:00.489472+0000","last_undegraded":"2024-04-22T19:58:00.489472+0000","last_fullsized":"2024-04-22T19:58:00.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486323+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:00.486323+0000","last_peered":"2024-04-22T19:58:00.486323+0000","last_clean":"2024-04-22T19:58:00.486323+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:00.486323+0000","last_undegraded":"2024-04-22T19:58:00.486323+0000","last_fullsized":"2024-04-22T19:58:00.486323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'28","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486127+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:00.486127+0000","last_peered":"2024-04-22T19:58:00.486127+0000","last_clean":"2024-04-22T19:58:00.486127+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:00.486127+0000","last_undegraded":"2024-04-22T19:58:00.486127+0000","last_fullsized":"2024-04-22T19:58:00.486127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"110'27","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488968+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:00.488968+0000","last_peered":"2024-04-22T19:58:00.488968+0000","last_clean":"2024-04-22T19:58:00.488968+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:00.488968+0000","last_undegraded":"2024-04-22T19:58:00.488968+0000","last_fullsized":"2024-04-22T19:58:00.488968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405158+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405158+0000","last_peered":"2024-04-22T19:58:00.405158+0000","last_clean":"2024-04-22T19:58:00.405158+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405158+0000","last_undegraded":"2024-04-22T19:58:00.405158+0000","last_fullsized":"2024-04-22T19:58:00.405158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401480+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:00.401480+0000","last_peered":"2024-04-22T19:58:00.401480+0000","last_clean":"2024-04-22T19:58:00.401480+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:00.401480+0000","last_undegraded":"2024-04-22T19:58:00.401480+0000","last_fullsized":"2024-04-22T19:58:00.401480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1092,"ondisk_log_size":1092,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386922,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":604,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":311,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1985188,"kb_used_data":1949852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92386652,"statfs":{"total":96636764160,"available":94603931648,"internally_reserved":0,"allocated":1996648448,"data_stored":1995950769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1243132,"kb_used_data":1211956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93128708,"statfs":{"total":96636764160,"available":95363796992,"internally_reserved":0,"allocated":1241042944,"data_stored":1240384017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775960,"kb_used_data":1740624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92595880,"statfs":{"total":96636764160,"available":94818181120,"internally_reserved":0,"allocated":1782398976,"data_stored":1781684417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1961980,"kb_used_data":1926636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92409860,"statfs":{"total":96636764160,"available":94627696640,"internally_reserved":0,"allocated":1972875264,"data_stored":1972231414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1892440,"kb_used_data":1852944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92479400,"statfs":{"total":96636764160,"available":94698905600,"internally_reserved":0,"allocated":1897414656,"data_stored":1896735122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948212,"kb_used_data":912876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93423628,"statfs":{"total":96636764160,"available":95665795072,"internally_reserved":0,"allocated":934785024,"data_stored":934141674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1034552,"kb_used_data":999216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93337288,"statfs":{"total":96636764160,"available":95577382912,"internally_reserved":0,"allocated":1023197184,"data_stored":1022513657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1759824,"kb_used_data":1724480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92612016,"statfs":{"total":96636764160,"available":94834704384,"internally_reserved":0,"allocated":1765867520,"data_stored":1765204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1763704832,"data_stored":1763704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1021313024,"data_stored":1021313024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933232640,"data_stored":933232640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1895825408,"data_stored":1895825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1971322880,"data_stored":1971322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1780482048,"data_stored":1780482048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239416832,"data_stored":1239416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1994391552,"data_stored":1994391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":293527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:12.904 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T19:58:12.904 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:13.289 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:13.312 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-22T19:58:11.426586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823914,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3066,"num_read_kb":2749,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3911,"ondisk_log_size":3911,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12601288,"kb_used_data":12318584,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":742373432,"statfs":{"total":773094113280,"available":760190394368,"internally_reserved":0,"allocated":12614230016,"data_stored":12608845372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.027544"},"pg_stats":[{"pgid":"3.3f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487868+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:00.487868+0000","last_peered":"2024-04-22T19:58:00.487868+0000","last_clean":"2024-04-22T19:58:00.487868+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:00.487868+0000","last_undegraded":"2024-04-22T19:58:00.487868+0000","last_fullsized":"2024-04-22T19:58:00.487868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'18","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404530+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:00.404530+0000","last_peered":"2024-04-22T19:58:00.404530+0000","last_clean":"2024-04-22T19:58:00.404530+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:00.404530+0000","last_undegraded":"2024-04-22T19:58:00.404530+0000","last_fullsized":"2024-04-22T19:58:00.404530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405121+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:00.405121+0000","last_peered":"2024-04-22T19:58:00.405121+0000","last_clean":"2024-04-22T19:58:00.405121+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:00.405121+0000","last_undegraded":"2024-04-22T19:58:00.405121+0000","last_fullsized":"2024-04-22T19:58:00.405121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'23","reported_seq":310,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491906+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:00.491906+0000","last_peered":"2024-04-22T19:58:00.491906+0000","last_clean":"2024-04-22T19:58:00.491906+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:00.491906+0000","last_undegraded":"2024-04-22T19:58:00.491906+0000","last_fullsized":"2024-04-22T19:58:00.491906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403422+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403422+0000","last_peered":"2024-04-22T19:58:00.403422+0000","last_clean":"2024-04-22T19:58:00.403422+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403422+0000","last_undegraded":"2024-04-22T19:58:00.403422+0000","last_fullsized":"2024-04-22T19:58:00.403422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'28","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489291+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:00.489291+0000","last_peered":"2024-04-22T19:58:00.489291+0000","last_clean":"2024-04-22T19:58:00.489291+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:00.489291+0000","last_undegraded":"2024-04-22T19:58:00.489291+0000","last_fullsized":"2024-04-22T19:58:00.489291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490875+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490875+0000","last_peered":"2024-04-22T19:58:00.490875+0000","last_clean":"2024-04-22T19:58:00.490875+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490875+0000","last_undegraded":"2024-04-22T19:58:00.490875+0000","last_fullsized":"2024-04-22T19:58:00.490875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'11","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489417+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:00.489417+0000","last_peered":"2024-04-22T19:58:00.489417+0000","last_clean":"2024-04-22T19:58:00.489417+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:00.489417+0000","last_undegraded":"2024-04-22T19:58:00.489417+0000","last_fullsized":"2024-04-22T19:58:00.489417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'23","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486624+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:00.486624+0000","last_peered":"2024-04-22T19:58:00.486624+0000","last_clean":"2024-04-22T19:58:00.486624+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:00.486624+0000","last_undegraded":"2024-04-22T19:58:00.486624+0000","last_fullsized":"2024-04-22T19:58:00.486624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485363+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:00.485363+0000","last_peered":"2024-04-22T19:58:00.485363+0000","last_clean":"2024-04-22T19:58:00.485363+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:00.485363+0000","last_undegraded":"2024-04-22T19:58:00.485363+0000","last_fullsized":"2024-04-22T19:58:00.485363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'16","reported_seq":128,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487089+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:00.487089+0000","last_peered":"2024-04-22T19:58:00.487089+0000","last_clean":"2024-04-22T19:58:00.487089+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:00.487089+0000","last_undegraded":"2024-04-22T19:58:00.487089+0000","last_fullsized":"2024-04-22T19:58:00.487089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493301+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:00.493301+0000","last_peered":"2024-04-22T19:58:00.493301+0000","last_clean":"2024-04-22T19:58:00.493301+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:00.493301+0000","last_undegraded":"2024-04-22T19:58:00.493301+0000","last_fullsized":"2024-04-22T19:58:00.493301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493680+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:00.493680+0000","last_peered":"2024-04-22T19:58:00.493680+0000","last_clean":"2024-04-22T19:58:00.493680+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:00.493680+0000","last_undegraded":"2024-04-22T19:58:00.493680+0000","last_fullsized":"2024-04-22T19:58:00.493680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'21","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402285+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:00.402285+0000","last_peered":"2024-04-22T19:58:00.402285+0000","last_clean":"2024-04-22T19:58:00.402285+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:00.402285+0000","last_undegraded":"2024-04-22T19:58:00.402285+0000","last_fullsized":"2024-04-22T19:58:00.402285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'22","reported_seq":84,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'32","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403823+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:00.403823+0000","last_peered":"2024-04-22T19:58:00.403823+0000","last_clean":"2024-04-22T19:58:00.403823+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:00.403823+0000","last_undegraded":"2024-04-22T19:58:00.403823+0000","last_fullsized":"2024-04-22T19:58:00.403823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'27","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489495+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:00.489495+0000","last_peered":"2024-04-22T19:58:00.489495+0000","last_clean":"2024-04-22T19:58:00.489495+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:00.489495+0000","last_undegraded":"2024-04-22T19:58:00.489495+0000","last_fullsized":"2024-04-22T19:58:00.489495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405197+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:00.405197+0000","last_peered":"2024-04-22T19:58:00.405197+0000","last_clean":"2024-04-22T19:58:00.405197+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:00.405197+0000","last_undegraded":"2024-04-22T19:58:00.405197+0000","last_fullsized":"2024-04-22T19:58:00.405197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:43:31.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'27","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403836+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:00.403836+0000","last_peered":"2024-04-22T19:58:00.403836+0000","last_clean":"2024-04-22T19:58:00.403836+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:00.403836+0000","last_undegraded":"2024-04-22T19:58:00.403836+0000","last_fullsized":"2024-04-22T19:58:00.403836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":47,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487480+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:00.487480+0000","last_peered":"2024-04-22T19:58:00.487480+0000","last_clean":"2024-04-22T19:58:00.487480+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:00.487480+0000","last_undegraded":"2024-04-22T19:58:00.487480+0000","last_fullsized":"2024-04-22T19:58:00.487480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403429+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403429+0000","last_peered":"2024-04-22T19:58:00.403429+0000","last_clean":"2024-04-22T19:58:00.403429+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403429+0000","last_undegraded":"2024-04-22T19:58:00.403429+0000","last_fullsized":"2024-04-22T19:58:00.403429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405797+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405797+0000","last_peered":"2024-04-22T19:58:00.405797+0000","last_clean":"2024-04-22T19:58:00.405797+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405797+0000","last_undegraded":"2024-04-22T19:58:00.405797+0000","last_fullsized":"2024-04-22T19:58:00.405797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:03.662478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486690+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:00.486690+0000","last_peered":"2024-04-22T19:58:00.486690+0000","last_clean":"2024-04-22T19:58:00.486690+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:00.486690+0000","last_undegraded":"2024-04-22T19:58:00.486690+0000","last_fullsized":"2024-04-22T19:58:00.486690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'135","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645684+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:03.645684+0000","last_peered":"2024-04-22T19:58:03.645684+0000","last_clean":"2024-04-22T19:58:03.645684+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:03.645684+0000","last_undegraded":"2024-04-22T19:58:03.645684+0000","last_fullsized":"2024-04-22T19:58:03.645684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'30","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490735+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:00.490735+0000","last_peered":"2024-04-22T19:58:00.490735+0000","last_clean":"2024-04-22T19:58:00.490735+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:00.490735+0000","last_undegraded":"2024-04-22T19:58:00.490735+0000","last_fullsized":"2024-04-22T19:58:00.490735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'18","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487740+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:00.487740+0000","last_peered":"2024-04-22T19:58:00.487740+0000","last_clean":"2024-04-22T19:58:00.487740+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:00.487740+0000","last_undegraded":"2024-04-22T19:58:00.487740+0000","last_fullsized":"2024-04-22T19:58:00.487740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"128'141","reported_seq":385,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645079+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:03.645079+0000","last_peered":"2024-04-22T19:58:03.645079+0000","last_clean":"2024-04-22T19:58:03.645079+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:03.645079+0000","last_undegraded":"2024-04-22T19:58:03.645079+0000","last_fullsized":"2024-04-22T19:58:03.645079+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'25","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488107+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:00.488107+0000","last_peered":"2024-04-22T19:58:00.488107+0000","last_clean":"2024-04-22T19:58:00.488107+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:00.488107+0000","last_undegraded":"2024-04-22T19:58:00.488107+0000","last_fullsized":"2024-04-22T19:58:00.488107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487464+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:00.487464+0000","last_peered":"2024-04-22T19:58:00.487464+0000","last_clean":"2024-04-22T19:58:00.487464+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:00.487464+0000","last_undegraded":"2024-04-22T19:58:00.487464+0000","last_fullsized":"2024-04-22T19:58:00.487464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399938+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.399938+0000","last_peered":"2024-04-22T19:58:00.399938+0000","last_clean":"2024-04-22T19:58:00.399938+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.399938+0000","last_undegraded":"2024-04-22T19:58:00.399938+0000","last_fullsized":"2024-04-22T19:58:00.399938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:22.397390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'30","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487876+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:00.487876+0000","last_peered":"2024-04-22T19:58:00.487876+0000","last_clean":"2024-04-22T19:58:00.487876+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:00.487876+0000","last_undegraded":"2024-04-22T19:58:00.487876+0000","last_fullsized":"2024-04-22T19:58:00.487876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'17","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486948+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:00.486948+0000","last_peered":"2024-04-22T19:58:00.486948+0000","last_clean":"2024-04-22T19:58:00.486948+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:00.486948+0000","last_undegraded":"2024-04-22T19:58:00.486948+0000","last_fullsized":"2024-04-22T19:58:00.486948+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'25","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489043+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:00.489043+0000","last_peered":"2024-04-22T19:58:00.489043+0000","last_clean":"2024-04-22T19:58:00.489043+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:00.489043+0000","last_undegraded":"2024-04-22T19:58:00.489043+0000","last_fullsized":"2024-04-22T19:58:00.489043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'24","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486021+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:00.486021+0000","last_peered":"2024-04-22T19:58:00.486021+0000","last_clean":"2024-04-22T19:58:00.486021+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:00.486021+0000","last_undegraded":"2024-04-22T19:58:00.486021+0000","last_fullsized":"2024-04-22T19:58:00.486021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'135","reported_seq":390,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645400+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:03.645400+0000","last_peered":"2024-04-22T19:58:03.645400+0000","last_clean":"2024-04-22T19:58:03.645400+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:03.645400+0000","last_undegraded":"2024-04-22T19:58:03.645400+0000","last_fullsized":"2024-04-22T19:58:03.645400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:58:18.647872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405362+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405362+0000","last_peered":"2024-04-22T19:58:00.405362+0000","last_clean":"2024-04-22T19:58:00.405362+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405362+0000","last_undegraded":"2024-04-22T19:58:00.405362+0000","last_fullsized":"2024-04-22T19:58:00.405362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:33:15.677856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404257+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404257+0000","last_peered":"2024-04-22T19:58:00.404257+0000","last_clean":"2024-04-22T19:58:00.404257+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404257+0000","last_undegraded":"2024-04-22T19:58:00.404257+0000","last_fullsized":"2024-04-22T19:58:00.404257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'25","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492146+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:00.492146+0000","last_peered":"2024-04-22T19:58:00.492146+0000","last_clean":"2024-04-22T19:58:00.492146+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:00.492146+0000","last_undegraded":"2024-04-22T19:58:00.492146+0000","last_fullsized":"2024-04-22T19:58:00.492146+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'30","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403345+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:00.403345+0000","last_peered":"2024-04-22T19:58:00.403345+0000","last_clean":"2024-04-22T19:58:00.403345+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:00.403345+0000","last_undegraded":"2024-04-22T19:58:00.403345+0000","last_fullsized":"2024-04-22T19:58:00.403345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403953+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.403953+0000","last_peered":"2024-04-22T19:58:00.403953+0000","last_clean":"2024-04-22T19:58:00.403953+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.403953+0000","last_undegraded":"2024-04-22T19:58:00.403953+0000","last_fullsized":"2024-04-22T19:58:00.403953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:23.427873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486634+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:00.486634+0000","last_peered":"2024-04-22T19:58:00.486634+0000","last_clean":"2024-04-22T19:58:00.486634+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:00.486634+0000","last_undegraded":"2024-04-22T19:58:00.486634+0000","last_fullsized":"2024-04-22T19:58:00.486634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'19","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404161+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:00.404161+0000","last_peered":"2024-04-22T19:58:00.404161+0000","last_clean":"2024-04-22T19:58:00.404161+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:00.404161+0000","last_undegraded":"2024-04-22T19:58:00.404161+0000","last_fullsized":"2024-04-22T19:58:00.404161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405099+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405099+0000","last_peered":"2024-04-22T19:58:00.405099+0000","last_clean":"2024-04-22T19:58:00.405099+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405099+0000","last_undegraded":"2024-04-22T19:58:00.405099+0000","last_fullsized":"2024-04-22T19:58:00.405099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'25","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492958+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:00.492958+0000","last_peered":"2024-04-22T19:58:00.492958+0000","last_clean":"2024-04-22T19:58:00.492958+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:00.492958+0000","last_undegraded":"2024-04-22T19:58:00.492958+0000","last_fullsized":"2024-04-22T19:58:00.492958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402426+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402426+0000","last_peered":"2024-04-22T19:58:00.402426+0000","last_clean":"2024-04-22T19:58:00.402426+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402426+0000","last_undegraded":"2024-04-22T19:58:00.402426+0000","last_fullsized":"2024-04-22T19:58:00.402426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:01.917839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'23","reported_seq":286,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486495+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:00.486495+0000","last_peered":"2024-04-22T19:58:00.486495+0000","last_clean":"2024-04-22T19:58:00.486495+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:00.486495+0000","last_undegraded":"2024-04-22T19:58:00.486495+0000","last_fullsized":"2024-04-22T19:58:00.486495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'135","reported_seq":403,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400977+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.400977+0000","last_peered":"2024-04-22T19:58:00.400977+0000","last_clean":"2024-04-22T19:58:00.400977+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.400977+0000","last_undegraded":"2024-04-22T19:58:00.400977+0000","last_fullsized":"2024-04-22T19:58:00.400977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:36.470549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'34","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401789+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:00.401789+0000","last_peered":"2024-04-22T19:58:00.401789+0000","last_clean":"2024-04-22T19:58:00.401789+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:00.401789+0000","last_undegraded":"2024-04-22T19:58:00.401789+0000","last_fullsized":"2024-04-22T19:58:00.401789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":396,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'135","reported_seq":435,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"109'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485602+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:00.485602+0000","last_peered":"2024-04-22T19:58:00.485602+0000","last_clean":"2024-04-22T19:58:00.485602+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:00.485602+0000","last_undegraded":"2024-04-22T19:58:00.485602+0000","last_fullsized":"2024-04-22T19:58:00.485602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'26","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491674+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:00.491674+0000","last_peered":"2024-04-22T19:58:00.491674+0000","last_clean":"2024-04-22T19:58:00.491674+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:00.491674+0000","last_undegraded":"2024-04-22T19:58:00.491674+0000","last_fullsized":"2024-04-22T19:58:00.491674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399679+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399679+0000","last_peered":"2024-04-22T19:58:00.399679+0000","last_clean":"2024-04-22T19:58:00.399679+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399679+0000","last_undegraded":"2024-04-22T19:58:00.399679+0000","last_fullsized":"2024-04-22T19:58:00.399679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:16.573384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491504+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491504+0000","last_peered":"2024-04-22T19:58:00.491504+0000","last_clean":"2024-04-22T19:58:00.491504+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491504+0000","last_undegraded":"2024-04-22T19:58:00.491504+0000","last_fullsized":"2024-04-22T19:58:00.491504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":80,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486632+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:00.486632+0000","last_peered":"2024-04-22T19:58:00.486632+0000","last_clean":"2024-04-22T19:58:00.486632+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:00.486632+0000","last_undegraded":"2024-04-22T19:58:00.486632+0000","last_fullsized":"2024-04-22T19:58:00.486632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'37","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492246+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:00.492246+0000","last_peered":"2024-04-22T19:58:00.492246+0000","last_clean":"2024-04-22T19:58:00.492246+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:00.492246+0000","last_undegraded":"2024-04-22T19:58:00.492246+0000","last_fullsized":"2024-04-22T19:58:00.492246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405389+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405389+0000","last_peered":"2024-04-22T19:58:00.405389+0000","last_clean":"2024-04-22T19:58:00.405389+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405389+0000","last_undegraded":"2024-04-22T19:58:00.405389+0000","last_fullsized":"2024-04-22T19:58:00.405389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:41.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405703+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405703+0000","last_peered":"2024-04-22T19:58:00.405703+0000","last_clean":"2024-04-22T19:58:00.405703+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405703+0000","last_undegraded":"2024-04-22T19:58:00.405703+0000","last_fullsized":"2024-04-22T19:58:00.405703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485965+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485965+0000","last_peered":"2024-04-22T19:58:00.485965+0000","last_clean":"2024-04-22T19:58:00.485965+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485965+0000","last_undegraded":"2024-04-22T19:58:00.485965+0000","last_fullsized":"2024-04-22T19:58:00.485965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'20","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403486+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:00.403486+0000","last_peered":"2024-04-22T19:58:00.403486+0000","last_clean":"2024-04-22T19:58:00.403486+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:00.403486+0000","last_undegraded":"2024-04-22T19:58:00.403486+0000","last_fullsized":"2024-04-22T19:58:00.403486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'138","reported_seq":456,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645042+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:03.645042+0000","last_peered":"2024-04-22T19:58:03.645042+0000","last_clean":"2024-04-22T19:58:03.645042+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:03.645042+0000","last_undegraded":"2024-04-22T19:58:03.645042+0000","last_fullsized":"2024-04-22T19:58:03.645042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:04:59.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":163,"num_write":30,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399623+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399623+0000","last_peered":"2024-04-22T19:58:00.399623+0000","last_clean":"2024-04-22T19:58:00.399623+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399623+0000","last_undegraded":"2024-04-22T19:58:00.399623+0000","last_fullsized":"2024-04-22T19:58:00.399623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:07.236032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405126+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405126+0000","last_peered":"2024-04-22T19:58:00.405126+0000","last_clean":"2024-04-22T19:58:00.405126+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405126+0000","last_undegraded":"2024-04-22T19:58:00.405126+0000","last_fullsized":"2024-04-22T19:58:00.405126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485136+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485136+0000","last_peered":"2024-04-22T19:58:00.485136+0000","last_clean":"2024-04-22T19:58:00.485136+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485136+0000","last_undegraded":"2024-04-22T19:58:00.485136+0000","last_fullsized":"2024-04-22T19:58:00.485136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402613+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:00.402613+0000","last_peered":"2024-04-22T19:58:00.402613+0000","last_clean":"2024-04-22T19:58:00.402613+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:00.402613+0000","last_undegraded":"2024-04-22T19:58:00.402613+0000","last_fullsized":"2024-04-22T19:58:00.402613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":306,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486116+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:00.486116+0000","last_peered":"2024-04-22T19:58:00.486116+0000","last_clean":"2024-04-22T19:58:00.486116+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:00.486116+0000","last_undegraded":"2024-04-22T19:58:00.486116+0000","last_fullsized":"2024-04-22T19:58:00.486116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'16","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403797+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403797+0000","last_peered":"2024-04-22T19:58:00.403797+0000","last_clean":"2024-04-22T19:58:00.403797+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403797+0000","last_undegraded":"2024-04-22T19:58:00.403797+0000","last_fullsized":"2024-04-22T19:58:00.403797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402931+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.402931+0000","last_peered":"2024-04-22T19:58:00.402931+0000","last_clean":"2024-04-22T19:58:00.402931+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.402931+0000","last_undegraded":"2024-04-22T19:58:00.402931+0000","last_fullsized":"2024-04-22T19:58:00.402931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491149+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491149+0000","last_peered":"2024-04-22T19:58:00.491149+0000","last_clean":"2024-04-22T19:58:00.491149+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491149+0000","last_undegraded":"2024-04-22T19:58:00.491149+0000","last_fullsized":"2024-04-22T19:58:00.491149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403427+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:00.403427+0000","last_peered":"2024-04-22T19:58:00.403427+0000","last_clean":"2024-04-22T19:58:00.403427+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:00.403427+0000","last_undegraded":"2024-04-22T19:58:00.403427+0000","last_fullsized":"2024-04-22T19:58:00.403427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404832+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404832+0000","last_peered":"2024-04-22T19:58:00.404832+0000","last_clean":"2024-04-22T19:58:00.404832+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404832+0000","last_undegraded":"2024-04-22T19:58:00.404832+0000","last_fullsized":"2024-04-22T19:58:00.404832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400634+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400634+0000","last_peered":"2024-04-22T19:58:00.400634+0000","last_clean":"2024-04-22T19:58:00.400634+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400634+0000","last_undegraded":"2024-04-22T19:58:00.400634+0000","last_fullsized":"2024-04-22T19:58:00.400634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:29.937845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'18","reported_seq":298,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492228+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:00.492228+0000","last_peered":"2024-04-22T19:58:00.492228+0000","last_clean":"2024-04-22T19:58:00.492228+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:00.492228+0000","last_undegraded":"2024-04-22T19:58:00.492228+0000","last_fullsized":"2024-04-22T19:58:00.492228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403589+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:00.403589+0000","last_peered":"2024-04-22T19:58:00.403589+0000","last_clean":"2024-04-22T19:58:00.403589+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:00.403589+0000","last_undegraded":"2024-04-22T19:58:00.403589+0000","last_fullsized":"2024-04-22T19:58:00.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403696+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403696+0000","last_peered":"2024-04-22T19:58:00.403696+0000","last_clean":"2024-04-22T19:58:00.403696+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403696+0000","last_undegraded":"2024-04-22T19:58:00.403696+0000","last_fullsized":"2024-04-22T19:58:00.403696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:48.711919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'35","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399220+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:00.399220+0000","last_peered":"2024-04-22T19:58:00.399220+0000","last_clean":"2024-04-22T19:58:00.399220+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.399220+0000","last_undegraded":"2024-04-22T19:58:00.399220+0000","last_fullsized":"2024-04-22T19:58:00.399220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:38.161593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404915+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404915+0000","last_peered":"2024-04-22T19:58:00.404915+0000","last_clean":"2024-04-22T19:58:00.404915+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404915+0000","last_undegraded":"2024-04-22T19:58:00.404915+0000","last_fullsized":"2024-04-22T19:58:00.404915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:54:29.178471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404153+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404153+0000","last_peered":"2024-04-22T19:58:00.404153+0000","last_clean":"2024-04-22T19:58:00.404153+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404153+0000","last_undegraded":"2024-04-22T19:58:00.404153+0000","last_fullsized":"2024-04-22T19:58:00.404153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403175+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:00.403175+0000","last_peered":"2024-04-22T19:58:00.403175+0000","last_clean":"2024-04-22T19:58:00.403175+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:00.403175+0000","last_undegraded":"2024-04-22T19:58:00.403175+0000","last_fullsized":"2024-04-22T19:58:00.403175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489726+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489726+0000","last_peered":"2024-04-22T19:58:00.489726+0000","last_clean":"2024-04-22T19:58:00.489726+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489726+0000","last_undegraded":"2024-04-22T19:58:00.489726+0000","last_fullsized":"2024-04-22T19:58:00.489726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400210+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400210+0000","last_peered":"2024-04-22T19:58:00.400210+0000","last_clean":"2024-04-22T19:58:00.400210+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400210+0000","last_undegraded":"2024-04-22T19:58:00.400210+0000","last_fullsized":"2024-04-22T19:58:00.400210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:01:50.717909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'135","reported_seq":389,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.646418+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:03.646418+0000","last_peered":"2024-04-22T19:58:03.646418+0000","last_clean":"2024-04-22T19:58:03.646418+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:03.646418+0000","last_undegraded":"2024-04-22T19:58:03.646418+0000","last_fullsized":"2024-04-22T19:58:03.646418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'16","reported_seq":72,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487578+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:00.487578+0000","last_peered":"2024-04-22T19:58:00.487578+0000","last_clean":"2024-04-22T19:58:00.487578+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:00.487578+0000","last_undegraded":"2024-04-22T19:58:00.487578+0000","last_fullsized":"2024-04-22T19:58:00.487578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404614+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404614+0000","last_peered":"2024-04-22T19:58:00.404614+0000","last_clean":"2024-04-22T19:58:00.404614+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404614+0000","last_undegraded":"2024-04-22T19:58:00.404614+0000","last_fullsized":"2024-04-22T19:58:00.404614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'141","reported_seq":465,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645052+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:03.645052+0000","last_peered":"2024-04-22T19:58:03.645052+0000","last_clean":"2024-04-22T19:58:03.645052+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:03.645052+0000","last_undegraded":"2024-04-22T19:58:03.645052+0000","last_fullsized":"2024-04-22T19:58:03.645052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404604+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404604+0000","last_peered":"2024-04-22T19:58:00.404604+0000","last_clean":"2024-04-22T19:58:00.404604+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404604+0000","last_undegraded":"2024-04-22T19:58:00.404604+0000","last_fullsized":"2024-04-22T19:58:00.404604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:39.990552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405842+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:00.405842+0000","last_peered":"2024-04-22T19:58:00.405842+0000","last_clean":"2024-04-22T19:58:00.405842+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:00.405842+0000","last_undegraded":"2024-04-22T19:58:00.405842+0000","last_fullsized":"2024-04-22T19:58:00.405842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:16:18.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'45","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488495+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:00.488495+0000","last_peered":"2024-04-22T19:58:00.488495+0000","last_clean":"2024-04-22T19:58:00.488495+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:00.488495+0000","last_undegraded":"2024-04-22T19:58:00.488495+0000","last_fullsized":"2024-04-22T19:58:00.488495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404977+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.404977+0000","last_peered":"2024-04-22T19:58:00.404977+0000","last_clean":"2024-04-22T19:58:00.404977+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.404977+0000","last_undegraded":"2024-04-22T19:58:00.404977+0000","last_fullsized":"2024-04-22T19:58:00.404977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:46:21.357356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402134+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:00.402134+0000","last_peered":"2024-04-22T19:58:00.402134+0000","last_clean":"2024-04-22T19:58:00.402134+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:00.402134+0000","last_undegraded":"2024-04-22T19:58:00.402134+0000","last_fullsized":"2024-04-22T19:58:00.402134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401039+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401039+0000","last_peered":"2024-04-22T19:58:00.401039+0000","last_clean":"2024-04-22T19:58:00.401039+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401039+0000","last_undegraded":"2024-04-22T19:58:00.401039+0000","last_fullsized":"2024-04-22T19:58:00.401039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:50.517959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485520+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:00.485520+0000","last_peered":"2024-04-22T19:58:00.485520+0000","last_clean":"2024-04-22T19:58:00.485520+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:00.485520+0000","last_undegraded":"2024-04-22T19:58:00.485520+0000","last_fullsized":"2024-04-22T19:58:00.485520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400380+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400380+0000","last_peered":"2024-04-22T19:58:00.400380+0000","last_clean":"2024-04-22T19:58:00.400380+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400380+0000","last_undegraded":"2024-04-22T19:58:00.400380+0000","last_fullsized":"2024-04-22T19:58:00.400380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:21.141355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'29","reported_seq":335,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488786+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:00.488786+0000","last_peered":"2024-04-22T19:58:00.488786+0000","last_clean":"2024-04-22T19:58:00.488786+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:00.488786+0000","last_undegraded":"2024-04-22T19:58:00.488786+0000","last_fullsized":"2024-04-22T19:58:00.488786+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398955+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.398955+0000","last_peered":"2024-04-22T19:58:00.398955+0000","last_clean":"2024-04-22T19:58:00.398955+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.398955+0000","last_undegraded":"2024-04-22T19:58:00.398955+0000","last_fullsized":"2024-04-22T19:58:00.398955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404670+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404670+0000","last_peered":"2024-04-22T19:58:00.404670+0000","last_clean":"2024-04-22T19:58:00.404670+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404670+0000","last_undegraded":"2024-04-22T19:58:00.404670+0000","last_fullsized":"2024-04-22T19:58:00.404670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:43:15.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492364+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:00.492364+0000","last_peered":"2024-04-22T19:58:00.492364+0000","last_clean":"2024-04-22T19:58:00.492364+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:00.492364+0000","last_undegraded":"2024-04-22T19:58:00.492364+0000","last_fullsized":"2024-04-22T19:58:00.492364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'19","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486681+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:00.486681+0000","last_peered":"2024-04-22T19:58:00.486681+0000","last_clean":"2024-04-22T19:58:00.486681+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:00.486681+0000","last_undegraded":"2024-04-22T19:58:00.486681+0000","last_fullsized":"2024-04-22T19:58:00.486681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'17","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405364+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:00.405364+0000","last_peered":"2024-04-22T19:58:00.405364+0000","last_clean":"2024-04-22T19:58:00.405364+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:00.405364+0000","last_undegraded":"2024-04-22T19:58:00.405364+0000","last_fullsized":"2024-04-22T19:58:00.405364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'17","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486240+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:00.486240+0000","last_peered":"2024-04-22T19:58:00.486240+0000","last_clean":"2024-04-22T19:58:00.486240+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:00.486240+0000","last_undegraded":"2024-04-22T19:58:00.486240+0000","last_fullsized":"2024-04-22T19:58:00.486240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403251+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403251+0000","last_peered":"2024-04-22T19:58:00.403251+0000","last_clean":"2024-04-22T19:58:00.403251+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403251+0000","last_undegraded":"2024-04-22T19:58:00.403251+0000","last_fullsized":"2024-04-22T19:58:00.403251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:24:51.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'23","reported_seq":86,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485805+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:00.485805+0000","last_peered":"2024-04-22T19:58:00.485805+0000","last_clean":"2024-04-22T19:58:00.485805+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:00.485805+0000","last_undegraded":"2024-04-22T19:58:00.485805+0000","last_fullsized":"2024-04-22T19:58:00.485805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405531+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:00.405531+0000","last_peered":"2024-04-22T19:58:00.405531+0000","last_clean":"2024-04-22T19:58:00.405531+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:00.405531+0000","last_undegraded":"2024-04-22T19:58:00.405531+0000","last_fullsized":"2024-04-22T19:58:00.405531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:23.397122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400696+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:00.400696+0000","last_peered":"2024-04-22T19:58:00.400696+0000","last_clean":"2024-04-22T19:58:00.400696+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:00.400696+0000","last_undegraded":"2024-04-22T19:58:00.400696+0000","last_fullsized":"2024-04-22T19:58:00.400696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:02:35.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405680+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:00.405680+0000","last_peered":"2024-04-22T19:58:00.405680+0000","last_clean":"2024-04-22T19:58:00.405680+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:00.405680+0000","last_undegraded":"2024-04-22T19:58:00.405680+0000","last_fullsized":"2024-04-22T19:58:00.405680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:55.055729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'22","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401881+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:00.401881+0000","last_peered":"2024-04-22T19:58:00.401881+0000","last_clean":"2024-04-22T19:58:00.401881+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:00.401881+0000","last_undegraded":"2024-04-22T19:58:00.401881+0000","last_fullsized":"2024-04-22T19:58:00.401881+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:59.453198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'23","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486786+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:00.486786+0000","last_peered":"2024-04-22T19:58:00.486786+0000","last_clean":"2024-04-22T19:58:00.486786+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:00.486786+0000","last_undegraded":"2024-04-22T19:58:00.486786+0000","last_fullsized":"2024-04-22T19:58:00.486786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401214+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401214+0000","last_peered":"2024-04-22T19:58:00.401214+0000","last_clean":"2024-04-22T19:58:00.401214+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401214+0000","last_undegraded":"2024-04-22T19:58:00.401214+0000","last_fullsized":"2024-04-22T19:58:00.401214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:23.165255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'20","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402622+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:00.402622+0000","last_peered":"2024-04-22T19:58:00.402622+0000","last_clean":"2024-04-22T19:58:00.402622+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:00.402622+0000","last_undegraded":"2024-04-22T19:58:00.402622+0000","last_fullsized":"2024-04-22T19:58:00.402622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487530+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:00.487530+0000","last_peered":"2024-04-22T19:58:00.487530+0000","last_clean":"2024-04-22T19:58:00.487530+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:00.487530+0000","last_undegraded":"2024-04-22T19:58:00.487530+0000","last_fullsized":"2024-04-22T19:58:00.487530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399918+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.399918+0000","last_peered":"2024-04-22T19:58:00.399918+0000","last_clean":"2024-04-22T19:58:00.399918+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.399918+0000","last_undegraded":"2024-04-22T19:58:00.399918+0000","last_fullsized":"2024-04-22T19:58:00.399918+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:49:58.016491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'19","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403254+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:00.403254+0000","last_peered":"2024-04-22T19:58:00.403254+0000","last_clean":"2024-04-22T19:58:00.403254+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:00.403254+0000","last_undegraded":"2024-04-22T19:58:00.403254+0000","last_fullsized":"2024-04-22T19:58:00.403254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401713+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401713+0000","last_peered":"2024-04-22T19:58:00.401713+0000","last_clean":"2024-04-22T19:58:00.401713+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401713+0000","last_undegraded":"2024-04-22T19:58:00.401713+0000","last_fullsized":"2024-04-22T19:58:00.401713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'135","reported_seq":417,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645767+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:03.645767+0000","last_peered":"2024-04-22T19:58:03.645767+0000","last_clean":"2024-04-22T19:58:03.645767+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:03.645767+0000","last_undegraded":"2024-04-22T19:58:03.645767+0000","last_fullsized":"2024-04-22T19:58:03.645767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"110'28","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491873+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:00.491873+0000","last_peered":"2024-04-22T19:58:00.491873+0000","last_clean":"2024-04-22T19:58:00.491873+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:00.491873+0000","last_undegraded":"2024-04-22T19:58:00.491873+0000","last_fullsized":"2024-04-22T19:58:00.491873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488771+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:00.488771+0000","last_peered":"2024-04-22T19:58:00.488771+0000","last_clean":"2024-04-22T19:58:00.488771+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:00.488771+0000","last_undegraded":"2024-04-22T19:58:00.488771+0000","last_fullsized":"2024-04-22T19:58:00.488771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398468+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398468+0000","last_peered":"2024-04-22T19:58:00.398468+0000","last_clean":"2024-04-22T19:58:00.398468+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398468+0000","last_undegraded":"2024-04-22T19:58:00.398468+0000","last_fullsized":"2024-04-22T19:58:00.398468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'21","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492192+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:00.492192+0000","last_peered":"2024-04-22T19:58:00.492192+0000","last_clean":"2024-04-22T19:58:00.492192+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:00.492192+0000","last_undegraded":"2024-04-22T19:58:00.492192+0000","last_fullsized":"2024-04-22T19:58:00.492192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'17","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398675+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:00.398675+0000","last_peered":"2024-04-22T19:58:00.398675+0000","last_clean":"2024-04-22T19:58:00.398675+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:00.398675+0000","last_undegraded":"2024-04-22T19:58:00.398675+0000","last_fullsized":"2024-04-22T19:58:00.398675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'24","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'13","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487401+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:00.487401+0000","last_peered":"2024-04-22T19:58:00.487401+0000","last_clean":"2024-04-22T19:58:00.487401+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:00.487401+0000","last_undegraded":"2024-04-22T19:58:00.487401+0000","last_fullsized":"2024-04-22T19:58:00.487401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'23","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405337+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:00.405337+0000","last_peered":"2024-04-22T19:58:00.405337+0000","last_clean":"2024-04-22T19:58:00.405337+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:00.405337+0000","last_undegraded":"2024-04-22T19:58:00.405337+0000","last_fullsized":"2024-04-22T19:58:00.405337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400493+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400493+0000","last_peered":"2024-04-22T19:58:00.400493+0000","last_clean":"2024-04-22T19:58:00.400493+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400493+0000","last_undegraded":"2024-04-22T19:58:00.400493+0000","last_fullsized":"2024-04-22T19:58:00.400493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:39.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401679+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:00.401679+0000","last_peered":"2024-04-22T19:58:00.401679+0000","last_clean":"2024-04-22T19:58:00.401679+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:00.401679+0000","last_undegraded":"2024-04-22T19:58:00.401679+0000","last_fullsized":"2024-04-22T19:58:00.401679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403081+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403081+0000","last_peered":"2024-04-22T19:58:00.403081+0000","last_clean":"2024-04-22T19:58:00.403081+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403081+0000","last_undegraded":"2024-04-22T19:58:00.403081+0000","last_fullsized":"2024-04-22T19:58:00.403081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.898422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405057+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405057+0000","last_peered":"2024-04-22T19:58:00.405057+0000","last_clean":"2024-04-22T19:58:00.405057+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405057+0000","last_undegraded":"2024-04-22T19:58:00.405057+0000","last_fullsized":"2024-04-22T19:58:00.405057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'24","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490506+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:00.490506+0000","last_peered":"2024-04-22T19:58:00.490506+0000","last_clean":"2024-04-22T19:58:00.490506+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:00.490506+0000","last_undegraded":"2024-04-22T19:58:00.490506+0000","last_fullsized":"2024-04-22T19:58:00.490506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404333+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404333+0000","last_peered":"2024-04-22T19:58:00.404333+0000","last_clean":"2024-04-22T19:58:00.404333+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404333+0000","last_undegraded":"2024-04-22T19:58:00.404333+0000","last_fullsized":"2024-04-22T19:58:00.404333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:53.729866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484910+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:00.484910+0000","last_peered":"2024-04-22T19:58:00.484910+0000","last_clean":"2024-04-22T19:58:00.484910+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:00.484910+0000","last_undegraded":"2024-04-22T19:58:00.484910+0000","last_fullsized":"2024-04-22T19:58:00.484910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'23","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490973+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:00.490973+0000","last_peered":"2024-04-22T19:58:00.490973+0000","last_clean":"2024-04-22T19:58:00.490973+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:00.490973+0000","last_undegraded":"2024-04-22T19:58:00.490973+0000","last_fullsized":"2024-04-22T19:58:00.490973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403420+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403420+0000","last_peered":"2024-04-22T19:58:00.403420+0000","last_clean":"2024-04-22T19:58:00.403420+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403420+0000","last_undegraded":"2024-04-22T19:58:00.403420+0000","last_fullsized":"2024-04-22T19:58:00.403420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'16","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403555+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:00.403555+0000","last_peered":"2024-04-22T19:58:00.403555+0000","last_clean":"2024-04-22T19:58:00.403555+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:00.403555+0000","last_undegraded":"2024-04-22T19:58:00.403555+0000","last_fullsized":"2024-04-22T19:58:00.403555+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:54.651586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'31","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487609+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:00.487609+0000","last_peered":"2024-04-22T19:58:00.487609+0000","last_clean":"2024-04-22T19:58:00.487609+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:00.487609+0000","last_undegraded":"2024-04-22T19:58:00.487609+0000","last_fullsized":"2024-04-22T19:58:00.487609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'19","reported_seq":301,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402407+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:00.402407+0000","last_peered":"2024-04-22T19:58:00.402407+0000","last_clean":"2024-04-22T19:58:00.402407+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:00.402407+0000","last_undegraded":"2024-04-22T19:58:00.402407+0000","last_fullsized":"2024-04-22T19:58:00.402407+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:07.458707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"110'28","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493418+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:00.493418+0000","last_peered":"2024-04-22T19:58:00.493418+0000","last_clean":"2024-04-22T19:58:00.493418+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:00.493418+0000","last_undegraded":"2024-04-22T19:58:00.493418+0000","last_fullsized":"2024-04-22T19:58:00.493418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'18","reported_seq":76,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487784+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:00.487784+0000","last_peered":"2024-04-22T19:58:00.487784+0000","last_clean":"2024-04-22T19:58:00.487784+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:00.487784+0000","last_undegraded":"2024-04-22T19:58:00.487784+0000","last_fullsized":"2024-04-22T19:58:00.487784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405228+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405228+0000","last_peered":"2024-04-22T19:58:00.405228+0000","last_clean":"2024-04-22T19:58:00.405228+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405228+0000","last_undegraded":"2024-04-22T19:58:00.405228+0000","last_fullsized":"2024-04-22T19:58:00.405228+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:23.329522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'27","reported_seq":325,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489055+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:00.489055+0000","last_peered":"2024-04-22T19:58:00.489055+0000","last_clean":"2024-04-22T19:58:00.489055+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:00.489055+0000","last_undegraded":"2024-04-22T19:58:00.489055+0000","last_fullsized":"2024-04-22T19:58:00.489055+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'34","reported_seq":108,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485798+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:00.485798+0000","last_peered":"2024-04-22T19:58:00.485798+0000","last_clean":"2024-04-22T19:58:00.485798+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:00.485798+0000","last_undegraded":"2024-04-22T19:58:00.485798+0000","last_fullsized":"2024-04-22T19:58:00.485798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'36","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489673+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:00.489673+0000","last_peered":"2024-04-22T19:58:00.489673+0000","last_clean":"2024-04-22T19:58:00.489673+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:00.489673+0000","last_undegraded":"2024-04-22T19:58:00.489673+0000","last_fullsized":"2024-04-22T19:58:00.489673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'31","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403819+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:00.403819+0000","last_peered":"2024-04-22T19:58:00.403819+0000","last_clean":"2024-04-22T19:58:00.403819+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:00.403819+0000","last_undegraded":"2024-04-22T19:58:00.403819+0000","last_fullsized":"2024-04-22T19:58:00.403819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'29","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490942+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:00.490942+0000","last_peered":"2024-04-22T19:58:00.490942+0000","last_clean":"2024-04-22T19:58:00.490942+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:00.490942+0000","last_undegraded":"2024-04-22T19:58:00.490942+0000","last_fullsized":"2024-04-22T19:58:00.490942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403218+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403218+0000","last_peered":"2024-04-22T19:58:00.403218+0000","last_clean":"2024-04-22T19:58:00.403218+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403218+0000","last_undegraded":"2024-04-22T19:58:00.403218+0000","last_fullsized":"2024-04-22T19:58:00.403218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'22","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489472+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:00.489472+0000","last_peered":"2024-04-22T19:58:00.489472+0000","last_clean":"2024-04-22T19:58:00.489472+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:00.489472+0000","last_undegraded":"2024-04-22T19:58:00.489472+0000","last_fullsized":"2024-04-22T19:58:00.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'22","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486323+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:00.486323+0000","last_peered":"2024-04-22T19:58:00.486323+0000","last_clean":"2024-04-22T19:58:00.486323+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:00.486323+0000","last_undegraded":"2024-04-22T19:58:00.486323+0000","last_fullsized":"2024-04-22T19:58:00.486323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'28","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486127+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:00.486127+0000","last_peered":"2024-04-22T19:58:00.486127+0000","last_clean":"2024-04-22T19:58:00.486127+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:00.486127+0000","last_undegraded":"2024-04-22T19:58:00.486127+0000","last_fullsized":"2024-04-22T19:58:00.486127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"110'27","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488968+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:00.488968+0000","last_peered":"2024-04-22T19:58:00.488968+0000","last_clean":"2024-04-22T19:58:00.488968+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:00.488968+0000","last_undegraded":"2024-04-22T19:58:00.488968+0000","last_fullsized":"2024-04-22T19:58:00.488968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405158+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405158+0000","last_peered":"2024-04-22T19:58:00.405158+0000","last_clean":"2024-04-22T19:58:00.405158+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405158+0000","last_undegraded":"2024-04-22T19:58:00.405158+0000","last_fullsized":"2024-04-22T19:58:00.405158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'23","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401480+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:00.401480+0000","last_peered":"2024-04-22T19:58:00.401480+0000","last_clean":"2024-04-22T19:58:00.401480+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:00.401480+0000","last_undegraded":"2024-04-22T19:58:00.401480+0000","last_fullsized":"2024-04-22T19:58:00.401480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1092,"ondisk_log_size":1092,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386922,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":604,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":311,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1985188,"kb_used_data":1949852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92386652,"statfs":{"total":96636764160,"available":94603931648,"internally_reserved":0,"allocated":1996648448,"data_stored":1995950769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1243132,"kb_used_data":1211956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93128708,"statfs":{"total":96636764160,"available":95363796992,"internally_reserved":0,"allocated":1241042944,"data_stored":1240384017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775960,"kb_used_data":1740624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92595880,"statfs":{"total":96636764160,"available":94818181120,"internally_reserved":0,"allocated":1782398976,"data_stored":1781684417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1961980,"kb_used_data":1926636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92409860,"statfs":{"total":96636764160,"available":94627696640,"internally_reserved":0,"allocated":1972875264,"data_stored":1972231414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1892440,"kb_used_data":1852944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92479400,"statfs":{"total":96636764160,"available":94698905600,"internally_reserved":0,"allocated":1897414656,"data_stored":1896735122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948212,"kb_used_data":912876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93423628,"statfs":{"total":96636764160,"available":95665795072,"internally_reserved":0,"allocated":934785024,"data_stored":934141674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1034552,"kb_used_data":999216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93337288,"statfs":{"total":96636764160,"available":95577382912,"internally_reserved":0,"allocated":1023197184,"data_stored":1022513657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1759824,"kb_used_data":1724480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92612016,"statfs":{"total":96636764160,"available":94834704384,"internally_reserved":0,"allocated":1765867520,"data_stored":1765204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1763704832,"data_stored":1763704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1021313024,"data_stored":1021313024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933232640,"data_stored":933232640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1895825408,"data_stored":1895825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1971322880,"data_stored":1971322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1780482048,"data_stored":1780482048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239416832,"data_stored":1239416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1994391552,"data_stored":1994391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":293527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:13.322 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T19:58:13.664 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:13.664 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":128,"fsid":"ac92bbc9-e567-4064-a7f4-2e610e35d3cc","created":"2024-04-22T19:53:42.573687+0000","modified":"2024-04-22T19:58:00.387133+0000","last_up_change":"2024-04-22T19:53:54.653127+0000","last_in_change":"2024-04-22T19:57:44.698445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T19:53:55.362814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-22T19:54:01.541706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-22T19:54:07.985692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-22T19:54:09.656252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-22T19:54:11.591758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-22T19:54:13.498929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-22T19:54:15.382119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-22T19:54:17.508620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"996ea3c2-f75d-41f0-9267-69befdc4ab4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6825","nonce":1848271487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6827","nonce":1848271487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6831","nonce":1848271487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1848271487},{"type":"v1","addr":"172.21.15.111:6829","nonce":1848271487}]},"public_addr":"172.21.15.111:6825/1848271487","cluster_addr":"172.21.15.111:6827/1848271487","heartbeat_back_addr":"172.21.15.111:6831/1848271487","heartbeat_front_addr":"172.21.15.111:6829/1848271487","state":["exists","up"]},{"osd":1,"uuid":"277fd7fa-608c-48e4-800d-c26294428dd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6813","nonce":1193123721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6819","nonce":1193123721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6823","nonce":1193123721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1193123721},{"type":"v1","addr":"172.21.15.111:6821","nonce":1193123721}]},"public_addr":"172.21.15.111:6813/1193123721","cluster_addr":"172.21.15.111:6819/1193123721","heartbeat_back_addr":"172.21.15.111:6823/1193123721","heartbeat_front_addr":"172.21.15.111:6821/1193123721","state":["exists","up"]},{"osd":2,"uuid":"bac442e5-3a55-4562-8665-70da37ab5ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6801","nonce":2226119870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6803","nonce":2226119870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6807","nonce":2226119870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2226119870},{"type":"v1","addr":"172.21.15.111:6805","nonce":2226119870}]},"public_addr":"172.21.15.111:6801/2226119870","cluster_addr":"172.21.15.111:6803/2226119870","heartbeat_back_addr":"172.21.15.111:6807/2226119870","heartbeat_front_addr":"172.21.15.111:6805/2226119870","state":["exists","up"]},{"osd":3,"uuid":"3195716c-c2fb-4f8d-916a-dc0525a8c456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6809","nonce":4032621477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6812","nonce":4032621477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6818","nonce":4032621477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4032621477},{"type":"v1","addr":"172.21.15.111:6815","nonce":4032621477}]},"public_addr":"172.21.15.111:6809/4032621477","cluster_addr":"172.21.15.111:6812/4032621477","heartbeat_back_addr":"172.21.15.111:6818/4032621477","heartbeat_front_addr":"172.21.15.111:6815/4032621477","state":["exists","up"]},{"osd":4,"uuid":"cbf466e6-386f-4838-ad24-52702ac92370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6801","nonce":1643232987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6803","nonce":1643232987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6807","nonce":1643232987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1643232987},{"type":"v1","addr":"172.21.15.138:6805","nonce":1643232987}]},"public_addr":"172.21.15.138:6801/1643232987","cluster_addr":"172.21.15.138:6803/1643232987","heartbeat_back_addr":"172.21.15.138:6807/1643232987","heartbeat_front_addr":"172.21.15.138:6805/1643232987","state":["exists","up"]},{"osd":5,"uuid":"5813db8d-fb71-4489-af1f-2e8223206f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6809","nonce":1294966407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6811","nonce":1294966407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6815","nonce":1294966407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1294966407},{"type":"v1","addr":"172.21.15.138:6813","nonce":1294966407}]},"public_addr":"172.21.15.138:6809/1294966407","cluster_addr":"172.21.15.138:6811/1294966407","heartbeat_back_addr":"172.21.15.138:6815/1294966407","heartbeat_front_addr":"172.21.15.138:6813/1294966407","state":["exists","up"]},{"osd":6,"uuid":"4117bfb9-ad8e-4b51-a9e0-f858a7402a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6825","nonce":2579086149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6827","nonce":2579086149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6831","nonce":2579086149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2579086149},{"type":"v1","addr":"172.21.15.138:6829","nonce":2579086149}]},"public_addr":"172.21.15.138:6825/2579086149","cluster_addr":"172.21.15.138:6827/2579086149","heartbeat_back_addr":"172.21.15.138:6831/2579086149","heartbeat_front_addr":"172.21.15.138:6829/2579086149","state":["exists","up"]},{"osd":7,"uuid":"a91542a5-1ccd-4fb1-95be-7d51aa24f193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6817","nonce":1077004569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6819","nonce":1077004569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6823","nonce":1077004569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1077004569},{"type":"v1","addr":"172.21.15.138:6821","nonce":1077004569}]},"public_addr":"172.21.15.138:6817/1077004569","cluster_addr":"172.21.15.138:6819/1077004569","heartbeat_back_addr":"172.21.15.138:6823/1077004569","heartbeat_front_addr":"172.21.15.138:6821/1077004569","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.775866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.087145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.270011+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.250163+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.201467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.185857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:50.789318+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T19:53:51.273134+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T19:58:14.684 INFO:tasks.ceph:Scrubbing osd.0 2024-04-22T19:58:14.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:14.844 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:14.845 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:14.845 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:14.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-22T19:58:15.146 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 0 to deep-scrub 2024-04-22T19:58:15.165 INFO:tasks.ceph:Scrubbing osd.1 2024-04-22T19:58:15.165 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:15.323 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:15.324 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:15.324 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:15.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-22T19:58:15.622 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 1 to deep-scrub 2024-04-22T19:58:15.640 INFO:tasks.ceph:Scrubbing osd.2 2024-04-22T19:58:15.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:15.776 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:15.776 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:15.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-22T19:58:16.069 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 2 to deep-scrub 2024-04-22T19:58:16.087 INFO:tasks.ceph:Scrubbing osd.3 2024-04-22T19:58:16.087 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:16.221 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:16.222 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:16.222 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:16.236 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-22T19:58:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 3 to deep-scrub 2024-04-22T19:58:16.519 INFO:tasks.ceph:Scrubbing osd.4 2024-04-22T19:58:16.519 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:16.661 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:16.661 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:16.661 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:16.676 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-22T19:58:16.947 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 4 to deep-scrub 2024-04-22T19:58:16.964 INFO:tasks.ceph:Scrubbing osd.5 2024-04-22T19:58:16.964 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:16.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-22T19:58:17.100 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:17.101 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:17.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-22T19:58:17.395 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 5 to deep-scrub 2024-04-22T19:58:17.413 INFO:tasks.ceph:Scrubbing osd.6 2024-04-22T19:58:17.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:17.564 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:17.564 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:17.564 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:17.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-22T19:58:17.872 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 6 to deep-scrub 2024-04-22T19:58:17.891 INFO:tasks.ceph:Scrubbing osd.7 2024-04-22T19:58:17.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-22T19:58:18.038 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T19:58:18.038 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T19:58:18.038 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T19:58:18.056 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-22T19:58:18.344 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 7 to deep-scrub 2024-04-22T19:58:18.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:18.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:18.704 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:18.721 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-22T19:58:17.428788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5545,"ondisk_log_size":5545,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300804,"kb_used_data":13464,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754673916,"statfs":{"total":773094113280,"available":772786089984,"internally_reserved":0,"allocated":13787136,"data_stored":8453492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195940,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1733,"num_read_kb":953,"num_write":1584,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005415"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.052936+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:12.052936+0000","last_peered":"2024-04-22T19:58:12.052936+0000","last_clean":"2024-04-22T19:58:12.052936+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:12.052936+0000","last_undegraded":"2024-04-22T19:58:12.052936+0000","last_fullsized":"2024-04-22T19:58:12.052936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488161+0000","last_change":"2024-04-22T19:54:11.370742+0000","last_active":"2024-04-22T19:58:00.488161+0000","last_peered":"2024-04-22T19:58:00.488161+0000","last_clean":"2024-04-22T19:58:00.488161+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:00.488161+0000","last_undegraded":"2024-04-22T19:58:00.488161+0000","last_fullsized":"2024-04-22T19:58:00.488161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":259,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.999458+0000","last_change":"2024-04-22T19:54:09.312488+0000","last_active":"2024-04-22T19:58:11.999458+0000","last_peered":"2024-04-22T19:58:11.999458+0000","last_clean":"2024-04-22T19:58:11.999458+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:11.999458+0000","last_undegraded":"2024-04-22T19:58:11.999458+0000","last_fullsized":"2024-04-22T19:58:11.999458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486343+0000","last_change":"2024-04-22T19:54:11.376618+0000","last_active":"2024-04-22T19:58:00.486343+0000","last_peered":"2024-04-22T19:58:00.486343+0000","last_clean":"2024-04-22T19:58:00.486343+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:00.486343+0000","last_undegraded":"2024-04-22T19:58:00.486343+0000","last_fullsized":"2024-04-22T19:58:00.486343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.059306+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:12.059306+0000","last_peered":"2024-04-22T19:58:12.059306+0000","last_clean":"2024-04-22T19:58:12.059306+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:12.059306+0000","last_undegraded":"2024-04-22T19:58:12.059306+0000","last_fullsized":"2024-04-22T19:58:12.059306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402103+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402103+0000","last_peered":"2024-04-22T19:58:00.402103+0000","last_clean":"2024-04-22T19:58:00.402103+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402103+0000","last_undegraded":"2024-04-22T19:58:00.402103+0000","last_fullsized":"2024-04-22T19:58:00.402103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:03.112472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":333,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.030032+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:12.030032+0000","last_peered":"2024-04-22T19:58:12.030032+0000","last_clean":"2024-04-22T19:58:12.030032+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:12.030032+0000","last_undegraded":"2024-04-22T19:58:12.030032+0000","last_fullsized":"2024-04-22T19:58:12.030032+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:28.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403482+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403482+0000","last_peered":"2024-04-22T19:58:00.403482+0000","last_clean":"2024-04-22T19:58:00.403482+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403482+0000","last_undegraded":"2024-04-22T19:58:00.403482+0000","last_fullsized":"2024-04-22T19:58:00.403482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.007176+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:12.007176+0000","last_peered":"2024-04-22T19:58:12.007176+0000","last_clean":"2024-04-22T19:58:12.007176+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:12.007176+0000","last_undegraded":"2024-04-22T19:58:12.007176+0000","last_fullsized":"2024-04-22T19:58:12.007176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490875+0000","last_change":"2024-04-22T19:54:11.366207+0000","last_active":"2024-04-22T19:58:00.490875+0000","last_peered":"2024-04-22T19:58:00.490875+0000","last_clean":"2024-04-22T19:58:00.490875+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:00.490875+0000","last_undegraded":"2024-04-22T19:58:00.490875+0000","last_fullsized":"2024-04-22T19:58:00.490875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:09.073358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.047032+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:12.047032+0000","last_peered":"2024-04-22T19:58:12.047032+0000","last_clean":"2024-04-22T19:58:12.047032+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:12.047032+0000","last_undegraded":"2024-04-22T19:58:12.047032+0000","last_fullsized":"2024-04-22T19:58:12.047032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403233+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:00.403233+0000","last_peered":"2024-04-22T19:58:00.403233+0000","last_clean":"2024-04-22T19:58:00.403233+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:00.403233+0000","last_undegraded":"2024-04-22T19:58:00.403233+0000","last_fullsized":"2024-04-22T19:58:00.403233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.936306+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:11.936306+0000","last_peered":"2024-04-22T19:58:11.936306+0000","last_clean":"2024-04-22T19:58:11.936306+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:11.936306+0000","last_undegraded":"2024-04-22T19:58:11.936306+0000","last_fullsized":"2024-04-22T19:58:11.936306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491932+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:00.491932+0000","last_peered":"2024-04-22T19:58:00.491932+0000","last_clean":"2024-04-22T19:58:00.491932+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:00.491932+0000","last_undegraded":"2024-04-22T19:58:00.491932+0000","last_fullsized":"2024-04-22T19:58:00.491932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":106,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.001661+0000","last_change":"2024-04-22T19:57:48.747528+0000","last_active":"2024-04-22T19:58:12.001661+0000","last_peered":"2024-04-22T19:58:12.001661+0000","last_clean":"2024-04-22T19:58:12.001661+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:12.001661+0000","last_undegraded":"2024-04-22T19:58:12.001661+0000","last_fullsized":"2024-04-22T19:58:12.001661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:53:45.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486387+0000","last_change":"2024-04-22T19:57:46.194449+0000","last_active":"2024-04-22T19:58:00.486387+0000","last_peered":"2024-04-22T19:58:00.486387+0000","last_clean":"2024-04-22T19:58:00.486387+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:00.486387+0000","last_undegraded":"2024-04-22T19:58:00.486387+0000","last_fullsized":"2024-04-22T19:58:00.486387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:44:56.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401499+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401499+0000","last_peered":"2024-04-22T19:58:00.401499+0000","last_clean":"2024-04-22T19:58:00.401499+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401499+0000","last_undegraded":"2024-04-22T19:58:00.401499+0000","last_fullsized":"2024-04-22T19:58:00.401499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:24:22.932418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":144,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.007249+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:12.007249+0000","last_peered":"2024-04-22T19:58:12.007249+0000","last_clean":"2024-04-22T19:58:12.007249+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:12.007249+0000","last_undegraded":"2024-04-22T19:58:12.007249+0000","last_fullsized":"2024-04-22T19:58:12.007249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:13:39.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486582+0000","last_change":"2024-04-22T19:54:11.378571+0000","last_active":"2024-04-22T19:58:00.486582+0000","last_peered":"2024-04-22T19:58:00.486582+0000","last_clean":"2024-04-22T19:58:00.486582+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:00.486582+0000","last_undegraded":"2024-04-22T19:58:00.486582+0000","last_fullsized":"2024-04-22T19:58:00.486582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.981471+0000","last_change":"2024-04-22T19:54:09.336458+0000","last_active":"2024-04-22T19:58:11.981471+0000","last_peered":"2024-04-22T19:58:11.981471+0000","last_clean":"2024-04-22T19:58:11.981471+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:11.981471+0000","last_undegraded":"2024-04-22T19:58:11.981471+0000","last_fullsized":"2024-04-22T19:58:11.981471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489582+0000","last_change":"2024-04-22T19:54:11.376128+0000","last_active":"2024-04-22T19:58:00.489582+0000","last_peered":"2024-04-22T19:58:00.489582+0000","last_clean":"2024-04-22T19:58:00.489582+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:00.489582+0000","last_undegraded":"2024-04-22T19:58:00.489582+0000","last_fullsized":"2024-04-22T19:58:00.489582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":268,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.941948+0000","last_change":"2024-04-22T19:54:09.335265+0000","last_active":"2024-04-22T19:58:11.941948+0000","last_peered":"2024-04-22T19:58:11.941948+0000","last_clean":"2024-04-22T19:58:11.941948+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:11.941948+0000","last_undegraded":"2024-04-22T19:58:11.941948+0000","last_fullsized":"2024-04-22T19:58:11.941948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:51:53.737664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485211+0000","last_change":"2024-04-22T19:57:49.786746+0000","last_active":"2024-04-22T19:58:00.485211+0000","last_peered":"2024-04-22T19:58:00.485211+0000","last_clean":"2024-04-22T19:58:00.485211+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:00.485211+0000","last_undegraded":"2024-04-22T19:58:00.485211+0000","last_fullsized":"2024-04-22T19:58:00.485211+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:48.790468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.956991+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:11.956991+0000","last_peered":"2024-04-22T19:58:11.956991+0000","last_clean":"2024-04-22T19:58:11.956991+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:11.956991+0000","last_undegraded":"2024-04-22T19:58:11.956991+0000","last_fullsized":"2024-04-22T19:58:11.956991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485855+0000","last_change":"2024-04-22T19:54:11.366861+0000","last_active":"2024-04-22T19:58:00.485855+0000","last_peered":"2024-04-22T19:58:00.485855+0000","last_clean":"2024-04-22T19:58:00.485855+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:00.485855+0000","last_undegraded":"2024-04-22T19:58:00.485855+0000","last_fullsized":"2024-04-22T19:58:00.485855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:54.124185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":106,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.921225+0000","last_change":"2024-04-22T19:57:49.580929+0000","last_active":"2024-04-22T19:58:11.921225+0000","last_peered":"2024-04-22T19:58:11.921225+0000","last_clean":"2024-04-22T19:58:11.921225+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:11.921225+0000","last_undegraded":"2024-04-22T19:58:11.921225+0000","last_fullsized":"2024-04-22T19:58:11.921225+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.391589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403493+0000","last_change":"2024-04-22T19:54:11.382919+0000","last_active":"2024-04-22T19:58:00.403493+0000","last_peered":"2024-04-22T19:58:00.403493+0000","last_clean":"2024-04-22T19:58:00.403493+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:00.403493+0000","last_undegraded":"2024-04-22T19:58:00.403493+0000","last_fullsized":"2024-04-22T19:58:00.403493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:12.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":290,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.041690+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:12.041690+0000","last_peered":"2024-04-22T19:58:12.041690+0000","last_clean":"2024-04-22T19:58:12.041690+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:12.041690+0000","last_undegraded":"2024-04-22T19:58:12.041690+0000","last_fullsized":"2024-04-22T19:58:12.041690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401046+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401046+0000","last_peered":"2024-04-22T19:58:00.401046+0000","last_clean":"2024-04-22T19:58:00.401046+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401046+0000","last_undegraded":"2024-04-22T19:58:00.401046+0000","last_fullsized":"2024-04-22T19:58:00.401046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487522+0000","last_change":"2024-04-22T19:57:48.786726+0000","last_active":"2024-04-22T19:58:00.487522+0000","last_peered":"2024-04-22T19:58:00.487522+0000","last_clean":"2024-04-22T19:58:00.487522+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:00.487522+0000","last_undegraded":"2024-04-22T19:58:00.487522+0000","last_fullsized":"2024-04-22T19:58:00.487522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:30:43.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":274,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.023300+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:12.023300+0000","last_peered":"2024-04-22T19:58:12.023300+0000","last_clean":"2024-04-22T19:58:12.023300+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:12.023300+0000","last_undegraded":"2024-04-22T19:58:12.023300+0000","last_fullsized":"2024-04-22T19:58:12.023300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:53.171731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491779+0000","last_change":"2024-04-22T19:54:13.370171+0000","last_active":"2024-04-22T19:58:00.491779+0000","last_peered":"2024-04-22T19:58:00.491779+0000","last_clean":"2024-04-22T19:58:00.491779+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:00.491779+0000","last_undegraded":"2024-04-22T19:58:00.491779+0000","last_fullsized":"2024-04-22T19:58:00.491779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:19.623802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'20","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.592366+0000","last_change":"2024-04-22T19:54:15.367189+0000","last_active":"2024-04-22T19:58:11.592366+0000","last_peered":"2024-04-22T19:58:11.592366+0000","last_clean":"2024-04-22T19:58:11.592366+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:11.592366+0000","last_undegraded":"2024-04-22T19:58:11.592366+0000","last_fullsized":"2024-04-22T19:58:11.592366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487347+0000","last_change":"2024-04-22T19:54:17.381820+0000","last_active":"2024-04-22T19:58:00.487347+0000","last_peered":"2024-04-22T19:58:00.487347+0000","last_clean":"2024-04-22T19:58:00.487347+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:00.487347+0000","last_undegraded":"2024-04-22T19:58:00.487347+0000","last_fullsized":"2024-04-22T19:58:00.487347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:59:58.031090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488076+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488076+0000","last_peered":"2024-04-22T19:58:00.488076+0000","last_clean":"2024-04-22T19:58:00.488076+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488076+0000","last_undegraded":"2024-04-22T19:58:00.488076+0000","last_fullsized":"2024-04-22T19:58:00.488076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:31:35.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492043+0000","last_change":"2024-04-22T19:54:11.377071+0000","last_active":"2024-04-22T19:58:00.492043+0000","last_peered":"2024-04-22T19:58:00.492043+0000","last_clean":"2024-04-22T19:58:00.492043+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:00.492043+0000","last_undegraded":"2024-04-22T19:58:00.492043+0000","last_fullsized":"2024-04-22T19:58:00.492043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066950+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:12.066950+0000","last_peered":"2024-04-22T19:58:12.066950+0000","last_clean":"2024-04-22T19:58:12.066950+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:12.066950+0000","last_undegraded":"2024-04-22T19:58:12.066950+0000","last_fullsized":"2024-04-22T19:58:12.066950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.935563+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:10.935563+0000","last_peered":"2024-04-22T19:58:10.935563+0000","last_clean":"2024-04-22T19:58:10.935563+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:10.935563+0000","last_undegraded":"2024-04-22T19:58:10.935563+0000","last_fullsized":"2024-04-22T19:58:10.935563+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:42:12.227488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403039+0000","last_change":"2024-04-22T19:54:15.368523+0000","last_active":"2024-04-22T19:58:00.403039+0000","last_peered":"2024-04-22T19:58:00.403039+0000","last_clean":"2024-04-22T19:58:00.403039+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:00.403039+0000","last_undegraded":"2024-04-22T19:58:00.403039+0000","last_fullsized":"2024-04-22T19:58:00.403039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:32.458895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404044+0000","last_change":"2024-04-22T19:54:17.372441+0000","last_active":"2024-04-22T19:58:00.404044+0000","last_peered":"2024-04-22T19:58:00.404044+0000","last_clean":"2024-04-22T19:58:00.404044+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:00.404044+0000","last_undegraded":"2024-04-22T19:58:00.404044+0000","last_fullsized":"2024-04-22T19:58:00.404044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:14.092648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403499+0000","last_change":"2024-04-22T19:54:19.377705+0000","last_active":"2024-04-22T19:58:00.403499+0000","last_peered":"2024-04-22T19:58:00.403499+0000","last_clean":"2024-04-22T19:58:00.403499+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:00.403499+0000","last_undegraded":"2024-04-22T19:58:00.403499+0000","last_fullsized":"2024-04-22T19:58:00.403499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405836+0000","last_change":"2024-04-22T19:57:45.778232+0000","last_active":"2024-04-22T19:58:00.405836+0000","last_peered":"2024-04-22T19:58:00.405836+0000","last_clean":"2024-04-22T19:58:00.405836+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:00.405836+0000","last_undegraded":"2024-04-22T19:58:00.405836+0000","last_fullsized":"2024-04-22T19:58:00.405836+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.971975+0000","last_change":"2024-04-22T19:54:09.358395+0000","last_active":"2024-04-22T19:58:11.971975+0000","last_peered":"2024-04-22T19:58:11.971975+0000","last_clean":"2024-04-22T19:58:11.971975+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:11.971975+0000","last_undegraded":"2024-04-22T19:58:11.971975+0000","last_fullsized":"2024-04-22T19:58:11.971975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:12.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487679+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487679+0000","last_peered":"2024-04-22T19:58:00.487679+0000","last_clean":"2024-04-22T19:58:00.487679+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487679+0000","last_undegraded":"2024-04-22T19:58:00.487679+0000","last_fullsized":"2024-04-22T19:58:00.487679+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:02:25.341617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"71'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:15.359521+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:40:59.073814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":388,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.984119+0000","last_change":"2024-04-22T19:54:17.390826+0000","last_active":"2024-04-22T19:58:10.984119+0000","last_peered":"2024-04-22T19:58:10.984119+0000","last_clean":"2024-04-22T19:58:10.984119+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:10.984119+0000","last_undegraded":"2024-04-22T19:58:10.984119+0000","last_fullsized":"2024-04-22T19:58:10.984119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:14.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401955+0000","last_change":"2024-04-22T19:54:19.962330+0000","last_active":"2024-04-22T19:58:00.401955+0000","last_peered":"2024-04-22T19:58:00.401955+0000","last_clean":"2024-04-22T19:58:00.401955+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:00.401955+0000","last_undegraded":"2024-04-22T19:58:00.401955+0000","last_fullsized":"2024-04-22T19:58:00.401955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487684+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487684+0000","last_peered":"2024-04-22T19:58:00.487684+0000","last_clean":"2024-04-22T19:58:00.487684+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487684+0000","last_undegraded":"2024-04-22T19:58:00.487684+0000","last_fullsized":"2024-04-22T19:58:00.487684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:27:34.563073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.981497+0000","last_change":"2024-04-22T19:54:09.334793+0000","last_active":"2024-04-22T19:58:11.981497+0000","last_peered":"2024-04-22T19:58:11.981497+0000","last_clean":"2024-04-22T19:58:11.981497+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:11.981497+0000","last_undegraded":"2024-04-22T19:58:11.981497+0000","last_fullsized":"2024-04-22T19:58:11.981497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:51:52.091553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491755+0000","last_change":"2024-04-22T19:57:45.778828+0000","last_active":"2024-04-22T19:58:00.491755+0000","last_peered":"2024-04-22T19:58:00.491755+0000","last_clean":"2024-04-22T19:58:00.491755+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:00.491755+0000","last_undegraded":"2024-04-22T19:58:00.491755+0000","last_fullsized":"2024-04-22T19:58:00.491755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:48.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'22","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.572354+0000","last_change":"2024-04-22T19:54:15.379981+0000","last_active":"2024-04-22T19:58:11.572354+0000","last_peered":"2024-04-22T19:58:11.572354+0000","last_clean":"2024-04-22T19:58:11.572354+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:11.572354+0000","last_undegraded":"2024-04-22T19:58:11.572354+0000","last_fullsized":"2024-04-22T19:58:11.572354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:27:45.721813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"128'144","reported_seq":388,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.992782+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:10.992782+0000","last_peered":"2024-04-22T19:58:10.992782+0000","last_clean":"2024-04-22T19:58:10.992782+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:10.992782+0000","last_undegraded":"2024-04-22T19:58:10.992782+0000","last_fullsized":"2024-04-22T19:58:10.992782+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:23:32.146229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488817+0000","last_change":"2024-04-22T19:54:11.379244+0000","last_active":"2024-04-22T19:58:00.488817+0000","last_peered":"2024-04-22T19:58:00.488817+0000","last_clean":"2024-04-22T19:58:00.488817+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:00.488817+0000","last_undegraded":"2024-04-22T19:58:00.488817+0000","last_fullsized":"2024-04-22T19:58:00.488817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:02.409641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.994203+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:11.994203+0000","last_peered":"2024-04-22T19:58:11.994203+0000","last_clean":"2024-04-22T19:58:11.994203+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:11.994203+0000","last_undegraded":"2024-04-22T19:58:11.994203+0000","last_fullsized":"2024-04-22T19:58:11.994203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486080+0000","last_change":"2024-04-22T19:54:13.371911+0000","last_active":"2024-04-22T19:58:00.486080+0000","last_peered":"2024-04-22T19:58:00.486080+0000","last_clean":"2024-04-22T19:58:00.486080+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:00.486080+0000","last_undegraded":"2024-04-22T19:58:00.486080+0000","last_fullsized":"2024-04-22T19:58:00.486080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:37.938484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'31","reported_seq":259,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.747784+0000","last_change":"2024-04-22T19:54:15.377309+0000","last_active":"2024-04-22T19:58:11.747784+0000","last_peered":"2024-04-22T19:58:11.747784+0000","last_clean":"2024-04-22T19:58:11.747784+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:11.747784+0000","last_undegraded":"2024-04-22T19:58:11.747784+0000","last_fullsized":"2024-04-22T19:58:11.747784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400035+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.400035+0000","last_peered":"2024-04-22T19:58:00.400035+0000","last_clean":"2024-04-22T19:58:00.400035+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.400035+0000","last_undegraded":"2024-04-22T19:58:00.400035+0000","last_fullsized":"2024-04-22T19:58:00.400035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491318+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:00.491318+0000","last_peered":"2024-04-22T19:58:00.491318+0000","last_clean":"2024-04-22T19:58:00.491318+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:00.491318+0000","last_undegraded":"2024-04-22T19:58:00.491318+0000","last_fullsized":"2024-04-22T19:58:00.491318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.973428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401317+0000","last_change":"2024-04-22T19:54:11.375279+0000","last_active":"2024-04-22T19:58:00.401317+0000","last_peered":"2024-04-22T19:58:00.401317+0000","last_clean":"2024-04-22T19:58:00.401317+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:00.401317+0000","last_undegraded":"2024-04-22T19:58:00.401317+0000","last_fullsized":"2024-04-22T19:58:00.401317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:08.187995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":280,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.010955+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:12.010955+0000","last_peered":"2024-04-22T19:58:12.010955+0000","last_clean":"2024-04-22T19:58:12.010955+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:12.010955+0000","last_undegraded":"2024-04-22T19:58:12.010955+0000","last_fullsized":"2024-04-22T19:58:12.010955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:37.573328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484901+0000","last_change":"2024-04-22T19:54:13.362047+0000","last_active":"2024-04-22T19:58:00.484901+0000","last_peered":"2024-04-22T19:58:00.484901+0000","last_clean":"2024-04-22T19:58:00.484901+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:00.484901+0000","last_undegraded":"2024-04-22T19:58:00.484901+0000","last_fullsized":"2024-04-22T19:58:00.484901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:57.216458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'20","reported_seq":55,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.093506+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:12.093506+0000","last_peered":"2024-04-22T19:58:12.093506+0000","last_clean":"2024-04-22T19:58:12.093506+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:12.093506+0000","last_undegraded":"2024-04-22T19:58:12.093506+0000","last_fullsized":"2024-04-22T19:58:12.093506+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:56.804711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486633+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486633+0000","last_peered":"2024-04-22T19:58:00.486633+0000","last_clean":"2024-04-22T19:58:00.486633+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486633+0000","last_undegraded":"2024-04-22T19:58:00.486633+0000","last_fullsized":"2024-04-22T19:58:00.486633+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490501+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:00.490501+0000","last_peered":"2024-04-22T19:58:00.490501+0000","last_clean":"2024-04-22T19:58:00.490501+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:00.490501+0000","last_undegraded":"2024-04-22T19:58:00.490501+0000","last_fullsized":"2024-04-22T19:58:00.490501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:04.840743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490849+0000","last_change":"2024-04-22T19:54:11.365723+0000","last_active":"2024-04-22T19:58:00.490849+0000","last_peered":"2024-04-22T19:58:00.490849+0000","last_clean":"2024-04-22T19:58:00.490849+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:00.490849+0000","last_undegraded":"2024-04-22T19:58:00.490849+0000","last_fullsized":"2024-04-22T19:58:00.490849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:51.567387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.967688+0000","last_change":"2024-04-22T19:54:09.360917+0000","last_active":"2024-04-22T19:58:11.967688+0000","last_peered":"2024-04-22T19:58:11.967688+0000","last_clean":"2024-04-22T19:58:11.967688+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:11.967688+0000","last_undegraded":"2024-04-22T19:58:11.967688+0000","last_fullsized":"2024-04-22T19:58:11.967688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:30.018375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485585+0000","last_change":"2024-04-22T19:54:13.364081+0000","last_active":"2024-04-22T19:58:00.485585+0000","last_peered":"2024-04-22T19:58:00.485585+0000","last_clean":"2024-04-22T19:58:00.485585+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:00.485585+0000","last_undegraded":"2024-04-22T19:58:00.485585+0000","last_fullsized":"2024-04-22T19:58:00.485585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:12:55.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'27","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.755474+0000","last_change":"2024-04-22T19:54:15.372484+0000","last_active":"2024-04-22T19:58:11.755474+0000","last_peered":"2024-04-22T19:58:11.755474+0000","last_clean":"2024-04-22T19:58:11.755474+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:11.755474+0000","last_undegraded":"2024-04-22T19:58:11.755474+0000","last_fullsized":"2024-04-22T19:58:11.755474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:20.391492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":394,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.110320+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:12.110320+0000","last_peered":"2024-04-22T19:58:12.110320+0000","last_clean":"2024-04-22T19:58:12.110320+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:12.110320+0000","last_undegraded":"2024-04-22T19:58:12.110320+0000","last_fullsized":"2024-04-22T19:58:12.110320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405513+0000","last_change":"2024-04-22T19:54:19.381300+0000","last_active":"2024-04-22T19:58:00.405513+0000","last_peered":"2024-04-22T19:58:00.405513+0000","last_clean":"2024-04-22T19:58:00.405513+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:00.405513+0000","last_undegraded":"2024-04-22T19:58:00.405513+0000","last_fullsized":"2024-04-22T19:58:00.405513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404290+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404290+0000","last_peered":"2024-04-22T19:58:00.404290+0000","last_clean":"2024-04-22T19:58:00.404290+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404290+0000","last_undegraded":"2024-04-22T19:58:00.404290+0000","last_fullsized":"2024-04-22T19:58:00.404290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":343,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.052891+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:12.052891+0000","last_peered":"2024-04-22T19:58:12.052891+0000","last_clean":"2024-04-22T19:58:12.052891+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:12.052891+0000","last_undegraded":"2024-04-22T19:58:12.052891+0000","last_fullsized":"2024-04-22T19:58:12.052891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:04.913550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485371+0000","last_change":"2024-04-22T19:54:13.355476+0000","last_active":"2024-04-22T19:58:00.485371+0000","last_peered":"2024-04-22T19:58:00.485371+0000","last_clean":"2024-04-22T19:58:00.485371+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:00.485371+0000","last_undegraded":"2024-04-22T19:58:00.485371+0000","last_fullsized":"2024-04-22T19:58:00.485371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:51.878372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'37","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.767318+0000","last_change":"2024-04-22T19:54:15.367291+0000","last_active":"2024-04-22T19:58:11.767318+0000","last_peered":"2024-04-22T19:58:11.767318+0000","last_clean":"2024-04-22T19:58:11.767318+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:11.767318+0000","last_undegraded":"2024-04-22T19:58:11.767318+0000","last_fullsized":"2024-04-22T19:58:11.767318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.484768+0000","last_change":"2024-04-22T19:54:17.378983+0000","last_active":"2024-04-22T19:58:00.484768+0000","last_peered":"2024-04-22T19:58:00.484768+0000","last_clean":"2024-04-22T19:58:00.484768+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:00.484768+0000","last_undegraded":"2024-04-22T19:58:00.484768+0000","last_fullsized":"2024-04-22T19:58:00.484768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:43.505045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404063+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.404063+0000","last_peered":"2024-04-22T19:58:00.404063+0000","last_clean":"2024-04-22T19:58:00.404063+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.404063+0000","last_undegraded":"2024-04-22T19:58:00.404063+0000","last_fullsized":"2024-04-22T19:58:00.404063+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402531+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402531+0000","last_peered":"2024-04-22T19:58:00.402531+0000","last_clean":"2024-04-22T19:58:00.402531+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402531+0000","last_undegraded":"2024-04-22T19:58:00.402531+0000","last_fullsized":"2024-04-22T19:58:00.402531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:30.864644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":112,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.052502+0000","last_change":"2024-04-22T19:57:46.356619+0000","last_active":"2024-04-22T19:58:12.052502+0000","last_peered":"2024-04-22T19:58:12.052502+0000","last_clean":"2024-04-22T19:58:12.052502+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:12.052502+0000","last_undegraded":"2024-04-22T19:58:12.052502+0000","last_fullsized":"2024-04-22T19:58:12.052502+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:04.988115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485708+0000","last_change":"2024-04-22T19:54:13.358509+0000","last_active":"2024-04-22T19:58:00.485708+0000","last_peered":"2024-04-22T19:58:00.485708+0000","last_clean":"2024-04-22T19:58:00.485708+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:00.485708+0000","last_undegraded":"2024-04-22T19:58:00.485708+0000","last_fullsized":"2024-04-22T19:58:00.485708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:31.949940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'22","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.407707+0000","last_change":"2024-04-22T19:54:15.363261+0000","last_active":"2024-04-22T19:58:11.407707+0000","last_peered":"2024-04-22T19:58:11.407707+0000","last_clean":"2024-04-22T19:58:11.407707+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:11.407707+0000","last_undegraded":"2024-04-22T19:58:11.407707+0000","last_fullsized":"2024-04-22T19:58:11.407707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:03.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405155+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405155+0000","last_peered":"2024-04-22T19:58:00.405155+0000","last_clean":"2024-04-22T19:58:00.405155+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405155+0000","last_undegraded":"2024-04-22T19:58:00.405155+0000","last_fullsized":"2024-04-22T19:58:00.405155+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485484+0000","last_change":"2024-04-22T19:57:48.795583+0000","last_active":"2024-04-22T19:58:00.485484+0000","last_peered":"2024-04-22T19:58:00.485484+0000","last_clean":"2024-04-22T19:58:00.485484+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:00.485484+0000","last_undegraded":"2024-04-22T19:58:00.485484+0000","last_fullsized":"2024-04-22T19:58:00.485484+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:58:32.014544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403747+0000","last_change":"2024-04-22T19:54:11.363842+0000","last_active":"2024-04-22T19:58:00.403747+0000","last_peered":"2024-04-22T19:58:00.403747+0000","last_clean":"2024-04-22T19:58:00.403747+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:00.403747+0000","last_undegraded":"2024-04-22T19:58:00.403747+0000","last_fullsized":"2024-04-22T19:58:00.403747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:35.926390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.020304+0000","last_change":"2024-04-22T19:54:09.349044+0000","last_active":"2024-04-22T19:58:12.020304+0000","last_peered":"2024-04-22T19:58:12.020304+0000","last_clean":"2024-04-22T19:58:12.020304+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:12.020304+0000","last_undegraded":"2024-04-22T19:58:12.020304+0000","last_fullsized":"2024-04-22T19:58:12.020304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:01:05.775109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402526+0000","last_change":"2024-04-22T19:54:13.356312+0000","last_active":"2024-04-22T19:58:00.402526+0000","last_peered":"2024-04-22T19:58:00.402526+0000","last_clean":"2024-04-22T19:58:00.402526+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:00.402526+0000","last_undegraded":"2024-04-22T19:58:00.402526+0000","last_fullsized":"2024-04-22T19:58:00.402526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'26","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.080331+0000","last_change":"2024-04-22T19:57:48.005770+0000","last_active":"2024-04-22T19:58:12.080331+0000","last_peered":"2024-04-22T19:58:12.080331+0000","last_clean":"2024-04-22T19:58:12.080331+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:12.080331+0000","last_undegraded":"2024-04-22T19:58:12.080331+0000","last_fullsized":"2024-04-22T19:58:12.080331+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:52.084217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":406,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.985900+0000","last_change":"2024-04-22T19:54:17.380367+0000","last_active":"2024-04-22T19:58:10.985900+0000","last_peered":"2024-04-22T19:58:10.985900+0000","last_clean":"2024-04-22T19:58:10.985900+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:10.985900+0000","last_undegraded":"2024-04-22T19:58:10.985900+0000","last_fullsized":"2024-04-22T19:58:10.985900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:54.529848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401092+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:00.401092+0000","last_peered":"2024-04-22T19:58:00.401092+0000","last_clean":"2024-04-22T19:58:00.401092+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:00.401092+0000","last_undegraded":"2024-04-22T19:58:00.401092+0000","last_fullsized":"2024-04-22T19:58:00.401092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404435+0000","last_change":"2024-04-22T19:54:11.372884+0000","last_active":"2024-04-22T19:58:00.404435+0000","last_peered":"2024-04-22T19:58:00.404435+0000","last_clean":"2024-04-22T19:58:00.404435+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:00.404435+0000","last_undegraded":"2024-04-22T19:58:00.404435+0000","last_fullsized":"2024-04-22T19:58:00.404435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:02.887297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":290,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.007389+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:12.007389+0000","last_peered":"2024-04-22T19:58:12.007389+0000","last_clean":"2024-04-22T19:58:12.007389+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:12.007389+0000","last_undegraded":"2024-04-22T19:58:12.007389+0000","last_fullsized":"2024-04-22T19:58:12.007389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:11:08.605900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":400,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.947571+0000","last_change":"2024-04-22T19:54:13.372689+0000","last_active":"2024-04-22T19:58:10.947571+0000","last_peered":"2024-04-22T19:58:10.947571+0000","last_clean":"2024-04-22T19:58:10.947571+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:10.947571+0000","last_undegraded":"2024-04-22T19:58:10.947571+0000","last_fullsized":"2024-04-22T19:58:10.947571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"72'11","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487265+0000","last_change":"2024-04-22T19:57:50.998430+0000","last_active":"2024-04-22T19:58:00.487265+0000","last_peered":"2024-04-22T19:58:00.487265+0000","last_clean":"2024-04-22T19:58:00.487265+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:00.487265+0000","last_undegraded":"2024-04-22T19:58:00.487265+0000","last_fullsized":"2024-04-22T19:58:00.487265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:52:43.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":438,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.987510+0000","last_change":"2024-04-22T19:54:17.375793+0000","last_active":"2024-04-22T19:58:10.987510+0000","last_peered":"2024-04-22T19:58:10.987510+0000","last_clean":"2024-04-22T19:58:10.987510+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:10.987510+0000","last_undegraded":"2024-04-22T19:58:10.987510+0000","last_fullsized":"2024-04-22T19:58:10.987510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:08.911281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401978+0000","last_change":"2024-04-22T19:54:19.379599+0000","last_active":"2024-04-22T19:58:00.401978+0000","last_peered":"2024-04-22T19:58:00.401978+0000","last_clean":"2024-04-22T19:58:00.401978+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:00.401978+0000","last_undegraded":"2024-04-22T19:58:00.401978+0000","last_fullsized":"2024-04-22T19:58:00.401978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486182+0000","last_change":"2024-04-22T19:57:49.011934+0000","last_active":"2024-04-22T19:58:00.486182+0000","last_peered":"2024-04-22T19:58:00.486182+0000","last_clean":"2024-04-22T19:58:00.486182+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:00.486182+0000","last_undegraded":"2024-04-22T19:58:00.486182+0000","last_fullsized":"2024-04-22T19:58:00.486182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:19:16.453947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":109,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.016510+0000","last_change":"2024-04-22T19:57:50.058075+0000","last_active":"2024-04-22T19:58:12.016510+0000","last_peered":"2024-04-22T19:58:12.016510+0000","last_clean":"2024-04-22T19:58:12.016510+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:12.016510+0000","last_undegraded":"2024-04-22T19:58:12.016510+0000","last_fullsized":"2024-04-22T19:58:12.016510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:16:03.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404320+0000","last_change":"2024-04-22T19:54:13.362721+0000","last_active":"2024-04-22T19:58:00.404320+0000","last_peered":"2024-04-22T19:58:00.404320+0000","last_clean":"2024-04-22T19:58:00.404320+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:00.404320+0000","last_undegraded":"2024-04-22T19:58:00.404320+0000","last_fullsized":"2024-04-22T19:58:00.404320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:37.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'29","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.594661+0000","last_change":"2024-04-22T19:54:15.365668+0000","last_active":"2024-04-22T19:58:11.594661+0000","last_peered":"2024-04-22T19:58:11.594661+0000","last_clean":"2024-04-22T19:58:11.594661+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:11.594661+0000","last_undegraded":"2024-04-22T19:58:11.594661+0000","last_fullsized":"2024-04-22T19:58:11.594661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490547+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490547+0000","last_peered":"2024-04-22T19:58:00.490547+0000","last_clean":"2024-04-22T19:58:00.490547+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490547+0000","last_undegraded":"2024-04-22T19:58:00.490547+0000","last_fullsized":"2024-04-22T19:58:00.490547+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:11:07.967127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399805+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:00.399805+0000","last_peered":"2024-04-22T19:58:00.399805+0000","last_clean":"2024-04-22T19:58:00.399805+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:00.399805+0000","last_undegraded":"2024-04-22T19:58:00.399805+0000","last_fullsized":"2024-04-22T19:58:00.399805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493434+0000","last_change":"2024-04-22T19:54:11.380336+0000","last_active":"2024-04-22T19:58:00.493434+0000","last_peered":"2024-04-22T19:58:00.493434+0000","last_clean":"2024-04-22T19:58:00.493434+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:00.493434+0000","last_undegraded":"2024-04-22T19:58:00.493434+0000","last_fullsized":"2024-04-22T19:58:00.493434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:48:55.204363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486222+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.486222+0000","last_peered":"2024-04-22T19:58:00.486222+0000","last_clean":"2024-04-22T19:58:00.486222+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.486222+0000","last_undegraded":"2024-04-22T19:58:00.486222+0000","last_fullsized":"2024-04-22T19:58:00.486222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:57.447129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491625+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:00.491625+0000","last_peered":"2024-04-22T19:58:00.491625+0000","last_clean":"2024-04-22T19:58:00.491625+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:00.491625+0000","last_undegraded":"2024-04-22T19:58:00.491625+0000","last_fullsized":"2024-04-22T19:58:00.491625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":100,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.977530+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:11.977530+0000","last_peered":"2024-04-22T19:58:11.977530+0000","last_clean":"2024-04-22T19:58:11.977530+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:11.977530+0000","last_undegraded":"2024-04-22T19:58:11.977530+0000","last_fullsized":"2024-04-22T19:58:11.977530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:54:17.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487032+0000","last_change":"2024-04-22T19:54:13.367782+0000","last_active":"2024-04-22T19:58:00.487032+0000","last_peered":"2024-04-22T19:58:00.487032+0000","last_clean":"2024-04-22T19:58:00.487032+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:00.487032+0000","last_undegraded":"2024-04-22T19:58:00.487032+0000","last_fullsized":"2024-04-22T19:58:00.487032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:44.281753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"128'46","reported_seq":318,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.073908+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:12.073908+0000","last_peered":"2024-04-22T19:58:12.073908+0000","last_clean":"2024-04-22T19:58:12.073908+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:12.073908+0000","last_undegraded":"2024-04-22T19:58:12.073908+0000","last_fullsized":"2024-04-22T19:58:12.073908+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:07.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405459+0000","last_change":"2024-04-22T19:54:17.378547+0000","last_active":"2024-04-22T19:58:00.405459+0000","last_peered":"2024-04-22T19:58:00.405459+0000","last_clean":"2024-04-22T19:58:00.405459+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:00.405459+0000","last_undegraded":"2024-04-22T19:58:00.405459+0000","last_fullsized":"2024-04-22T19:58:00.405459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":202,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489876+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489876+0000","last_peered":"2024-04-22T19:58:00.489876+0000","last_clean":"2024-04-22T19:58:00.489876+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489876+0000","last_undegraded":"2024-04-22T19:58:00.489876+0000","last_fullsized":"2024-04-22T19:58:00.489876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:25.641447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405764+0000","last_change":"2024-04-22T19:54:11.353551+0000","last_active":"2024-04-22T19:58:00.405764+0000","last_peered":"2024-04-22T19:58:00.405764+0000","last_clean":"2024-04-22T19:58:00.405764+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:00.405764+0000","last_undegraded":"2024-04-22T19:58:00.405764+0000","last_fullsized":"2024-04-22T19:58:00.405764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485965+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.485965+0000","last_peered":"2024-04-22T19:58:00.485965+0000","last_clean":"2024-04-22T19:58:00.485965+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:00.485965+0000","last_undegraded":"2024-04-22T19:58:00.485965+0000","last_fullsized":"2024-04-22T19:58:00.485965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:47:57.160952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":265,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.028954+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:12.028954+0000","last_peered":"2024-04-22T19:58:12.028954+0000","last_clean":"2024-04-22T19:58:12.028954+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:12.028954+0000","last_undegraded":"2024-04-22T19:58:12.028954+0000","last_fullsized":"2024-04-22T19:58:12.028954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492590+0000","last_change":"2024-04-22T19:54:13.370705+0000","last_active":"2024-04-22T19:58:00.492590+0000","last_peered":"2024-04-22T19:58:00.492590+0000","last_clean":"2024-04-22T19:58:00.492590+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:00.492590+0000","last_undegraded":"2024-04-22T19:58:00.492590+0000","last_fullsized":"2024-04-22T19:58:00.492590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:18.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'151","reported_seq":483,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.098720+0000","last_change":"2024-04-22T19:54:15.371103+0000","last_active":"2024-04-22T19:58:12.098720+0000","last_peered":"2024-04-22T19:58:12.098720+0000","last_clean":"2024-04-22T19:58:12.098720+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:12.098720+0000","last_undegraded":"2024-04-22T19:58:12.098720+0000","last_fullsized":"2024-04-22T19:58:12.098720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487504+0000","last_change":"2024-04-22T19:54:17.382945+0000","last_active":"2024-04-22T19:58:00.487504+0000","last_peered":"2024-04-22T19:58:00.487504+0000","last_clean":"2024-04-22T19:58:00.487504+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:00.487504+0000","last_undegraded":"2024-04-22T19:58:00.487504+0000","last_fullsized":"2024-04-22T19:58:00.487504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:45:34.464794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399764+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399764+0000","last_peered":"2024-04-22T19:58:00.399764+0000","last_clean":"2024-04-22T19:58:00.399764+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399764+0000","last_undegraded":"2024-04-22T19:58:00.399764+0000","last_fullsized":"2024-04-22T19:58:00.399764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405248+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:00.405248+0000","last_peered":"2024-04-22T19:58:00.405248+0000","last_clean":"2024-04-22T19:58:00.405248+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:00.405248+0000","last_undegraded":"2024-04-22T19:58:00.405248+0000","last_fullsized":"2024-04-22T19:58:00.405248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485136+0000","last_change":"2024-04-22T19:57:45.767608+0000","last_active":"2024-04-22T19:58:00.485136+0000","last_peered":"2024-04-22T19:58:00.485136+0000","last_clean":"2024-04-22T19:58:00.485136+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:00.485136+0000","last_undegraded":"2024-04-22T19:58:00.485136+0000","last_fullsized":"2024-04-22T19:58:00.485136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:10:53.867999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":268,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.044387+0000","last_change":"2024-04-22T19:54:09.316365+0000","last_active":"2024-04-22T19:58:12.044387+0000","last_peered":"2024-04-22T19:58:12.044387+0000","last_clean":"2024-04-22T19:58:12.044387+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:12.044387+0000","last_undegraded":"2024-04-22T19:58:12.044387+0000","last_fullsized":"2024-04-22T19:58:12.044387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.934015+0000","last_change":"2024-04-22T19:54:13.373641+0000","last_active":"2024-04-22T19:58:10.934015+0000","last_peered":"2024-04-22T19:58:10.934015+0000","last_clean":"2024-04-22T19:58:10.934015+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:10.934015+0000","last_undegraded":"2024-04-22T19:58:10.934015+0000","last_fullsized":"2024-04-22T19:58:10.934015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:23.153450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'16","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:03.645649+0000","last_change":"2024-04-22T19:54:15.380449+0000","last_active":"2024-04-22T19:58:03.645649+0000","last_peered":"2024-04-22T19:58:03.645649+0000","last_clean":"2024-04-22T19:58:03.645649+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:03.645649+0000","last_undegraded":"2024-04-22T19:58:03.645649+0000","last_fullsized":"2024-04-22T19:58:03.645649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:20:59.946131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403855+0000","last_change":"2024-04-22T19:54:17.366943+0000","last_active":"2024-04-22T19:58:00.403855+0000","last_peered":"2024-04-22T19:58:00.403855+0000","last_clean":"2024-04-22T19:58:00.403855+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:00.403855+0000","last_undegraded":"2024-04-22T19:58:00.403855+0000","last_fullsized":"2024-04-22T19:58:00.403855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487600+0000","last_change":"2024-04-22T19:57:50.066556+0000","last_active":"2024-04-22T19:58:00.487600+0000","last_peered":"2024-04-22T19:58:00.487600+0000","last_clean":"2024-04-22T19:58:00.487600+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:00.487600+0000","last_undegraded":"2024-04-22T19:58:00.487600+0000","last_fullsized":"2024-04-22T19:58:00.487600+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:29.103115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403051+0000","last_change":"2024-04-22T19:54:11.373004+0000","last_active":"2024-04-22T19:58:00.403051+0000","last_peered":"2024-04-22T19:58:00.403051+0000","last_clean":"2024-04-22T19:58:00.403051+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:00.403051+0000","last_undegraded":"2024-04-22T19:58:00.403051+0000","last_fullsized":"2024-04-22T19:58:00.403051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491199+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:00.491199+0000","last_peered":"2024-04-22T19:58:00.491199+0000","last_clean":"2024-04-22T19:58:00.491199+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:00.491199+0000","last_undegraded":"2024-04-22T19:58:00.491199+0000","last_fullsized":"2024-04-22T19:58:00.491199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:55:37.464797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.944345+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:11.944345+0000","last_peered":"2024-04-22T19:58:11.944345+0000","last_clean":"2024-04-22T19:58:11.944345+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:11.944345+0000","last_undegraded":"2024-04-22T19:58:11.944345+0000","last_fullsized":"2024-04-22T19:58:11.944345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404880+0000","last_change":"2024-04-22T19:54:13.354285+0000","last_active":"2024-04-22T19:58:00.404880+0000","last_peered":"2024-04-22T19:58:00.404880+0000","last_clean":"2024-04-22T19:58:00.404880+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:00.404880+0000","last_undegraded":"2024-04-22T19:58:00.404880+0000","last_fullsized":"2024-04-22T19:58:00.404880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487843+0000","last_change":"2024-04-22T19:57:48.771968+0000","last_active":"2024-04-22T19:58:00.487843+0000","last_peered":"2024-04-22T19:58:00.487843+0000","last_clean":"2024-04-22T19:58:00.487843+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:00.487843+0000","last_undegraded":"2024-04-22T19:58:00.487843+0000","last_fullsized":"2024-04-22T19:58:00.487843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:29.766026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493752+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493752+0000","last_peered":"2024-04-22T19:58:00.493752+0000","last_clean":"2024-04-22T19:58:00.493752+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493752+0000","last_undegraded":"2024-04-22T19:58:00.493752+0000","last_fullsized":"2024-04-22T19:58:00.493752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:40:27.409011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487621+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487621+0000","last_peered":"2024-04-22T19:58:00.487621+0000","last_clean":"2024-04-22T19:58:00.487621+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487621+0000","last_undegraded":"2024-04-22T19:58:00.487621+0000","last_fullsized":"2024-04-22T19:58:00.487621+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:18.439277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400738+0000","last_change":"2024-04-22T19:54:11.377651+0000","last_active":"2024-04-22T19:58:00.400738+0000","last_peered":"2024-04-22T19:58:00.400738+0000","last_clean":"2024-04-22T19:58:00.400738+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:00.400738+0000","last_undegraded":"2024-04-22T19:58:00.400738+0000","last_fullsized":"2024-04-22T19:58:00.400738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":316,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.969915+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:11.969915+0000","last_peered":"2024-04-22T19:58:11.969915+0000","last_clean":"2024-04-22T19:58:11.969915+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:11.969915+0000","last_undegraded":"2024-04-22T19:58:11.969915+0000","last_fullsized":"2024-04-22T19:58:11.969915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:24.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624010+0000","last_change":"2024-04-22T19:54:03.274098+0000","last_active":"2024-04-22T19:58:15.624010+0000","last_peered":"2024-04-22T19:58:15.624010+0000","last_clean":"2024-04-22T19:58:15.624010+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:15.624010+0000","last_undegraded":"2024-04-22T19:58:15.624010+0000","last_fullsized":"2024-04-22T19:58:15.624010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403745+0000","last_change":"2024-04-22T19:54:13.358874+0000","last_active":"2024-04-22T19:58:00.403745+0000","last_peered":"2024-04-22T19:58:00.403745+0000","last_clean":"2024-04-22T19:58:00.403745+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:00.403745+0000","last_undegraded":"2024-04-22T19:58:00.403745+0000","last_fullsized":"2024-04-22T19:58:00.403745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"128'41","reported_seq":324,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148392+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:15.148392+0000","last_peered":"2024-04-22T19:58:15.148392+0000","last_clean":"2024-04-22T19:58:15.148392+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:15.148392+0000","last_undegraded":"2024-04-22T19:58:15.148392+0000","last_fullsized":"2024-04-22T19:58:15.148392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401124+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:00.401124+0000","last_peered":"2024-04-22T19:58:00.401124+0000","last_clean":"2024-04-22T19:58:00.401124+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:00.401124+0000","last_undegraded":"2024-04-22T19:58:00.401124+0000","last_fullsized":"2024-04-22T19:58:00.401124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:37:32.450436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":222,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404983+0000","last_change":"2024-04-22T19:54:19.962343+0000","last_active":"2024-04-22T19:58:00.404983+0000","last_peered":"2024-04-22T19:58:00.404983+0000","last_clean":"2024-04-22T19:58:00.404983+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:00.404983+0000","last_undegraded":"2024-04-22T19:58:00.404983+0000","last_fullsized":"2024-04-22T19:58:00.404983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404196+0000","last_change":"2024-04-22T19:54:11.369304+0000","last_active":"2024-04-22T19:58:00.404196+0000","last_peered":"2024-04-22T19:58:00.404196+0000","last_clean":"2024-04-22T19:58:00.404196+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:00.404196+0000","last_undegraded":"2024-04-22T19:58:00.404196+0000","last_fullsized":"2024-04-22T19:58:00.404196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.085383+0000","last_change":"2024-04-22T19:54:09.317417+0000","last_active":"2024-04-22T19:58:12.085383+0000","last_peered":"2024-04-22T19:58:12.085383+0000","last_clean":"2024-04-22T19:58:12.085383+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:12.085383+0000","last_undegraded":"2024-04-22T19:58:12.085383+0000","last_fullsized":"2024-04-22T19:58:12.085383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489818+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:00.489818+0000","last_peered":"2024-04-22T19:58:00.489818+0000","last_clean":"2024-04-22T19:58:00.489818+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:00.489818+0000","last_undegraded":"2024-04-22T19:58:00.489818+0000","last_fullsized":"2024-04-22T19:58:00.489818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:32:17.783215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490453+0000","last_change":"2024-04-22T19:54:13.364493+0000","last_active":"2024-04-22T19:58:00.490453+0000","last_peered":"2024-04-22T19:58:00.490453+0000","last_clean":"2024-04-22T19:58:00.490453+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:00.490453+0000","last_undegraded":"2024-04-22T19:58:00.490453+0000","last_fullsized":"2024-04-22T19:58:00.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:41.521124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400340+0000","last_change":"2024-04-22T19:54:15.358096+0000","last_active":"2024-04-22T19:58:00.400340+0000","last_peered":"2024-04-22T19:58:00.400340+0000","last_clean":"2024-04-22T19:58:00.400340+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:00.400340+0000","last_undegraded":"2024-04-22T19:58:00.400340+0000","last_fullsized":"2024-04-22T19:58:00.400340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":392,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.981244+0000","last_change":"2024-04-22T19:54:17.379352+0000","last_active":"2024-04-22T19:58:10.981244+0000","last_peered":"2024-04-22T19:58:10.981244+0000","last_clean":"2024-04-22T19:58:10.981244+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:10.981244+0000","last_undegraded":"2024-04-22T19:58:10.981244+0000","last_fullsized":"2024-04-22T19:58:10.981244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487751+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487751+0000","last_peered":"2024-04-22T19:58:00.487751+0000","last_clean":"2024-04-22T19:58:00.487751+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487751+0000","last_undegraded":"2024-04-22T19:58:00.487751+0000","last_fullsized":"2024-04-22T19:58:00.487751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:27:42.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":48,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485982+0000","last_change":"2024-04-22T19:57:47.645438+0000","last_active":"2024-04-22T19:58:00.485982+0000","last_peered":"2024-04-22T19:58:00.485982+0000","last_clean":"2024-04-22T19:58:00.485982+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:00.485982+0000","last_undegraded":"2024-04-22T19:58:00.485982+0000","last_fullsized":"2024-04-22T19:58:00.485982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:47.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.992770+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:11.992770+0000","last_peered":"2024-04-22T19:58:11.992770+0000","last_clean":"2024-04-22T19:58:11.992770+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:11.992770+0000","last_undegraded":"2024-04-22T19:58:11.992770+0000","last_fullsized":"2024-04-22T19:58:11.992770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:49:52.143042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404713+0000","last_change":"2024-04-22T19:54:03.271682+0000","last_active":"2024-04-22T19:58:00.404713+0000","last_peered":"2024-04-22T19:58:00.404713+0000","last_clean":"2024-04-22T19:58:00.404713+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:00.404713+0000","last_undegraded":"2024-04-22T19:58:00.404713+0000","last_fullsized":"2024-04-22T19:58:00.404713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401334+0000","last_change":"2024-04-22T19:57:45.767698+0000","last_active":"2024-04-22T19:58:00.401334+0000","last_peered":"2024-04-22T19:58:00.401334+0000","last_clean":"2024-04-22T19:58:00.401334+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:00.401334+0000","last_undegraded":"2024-04-22T19:58:00.401334+0000","last_fullsized":"2024-04-22T19:58:00.401334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:44:12.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402242+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:00.402242+0000","last_peered":"2024-04-22T19:58:00.402242+0000","last_clean":"2024-04-22T19:58:00.402242+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:00.402242+0000","last_undegraded":"2024-04-22T19:58:00.402242+0000","last_fullsized":"2024-04-22T19:58:00.402242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:47.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'144","reported_seq":468,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.988366+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:10.988366+0000","last_peered":"2024-04-22T19:58:10.988366+0000","last_clean":"2024-04-22T19:58:10.988366+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:10.988366+0000","last_undegraded":"2024-04-22T19:58:10.988366+0000","last_fullsized":"2024-04-22T19:58:10.988366+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:08:52.784620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404671+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404671+0000","last_peered":"2024-04-22T19:58:00.404671+0000","last_clean":"2024-04-22T19:58:00.404671+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404671+0000","last_undegraded":"2024-04-22T19:58:00.404671+0000","last_fullsized":"2024-04-22T19:58:00.404671+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401419+0000","last_change":"2024-04-22T19:54:11.360354+0000","last_active":"2024-04-22T19:58:00.401419+0000","last_peered":"2024-04-22T19:58:00.401419+0000","last_clean":"2024-04-22T19:58:00.401419+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:00.401419+0000","last_undegraded":"2024-04-22T19:58:00.401419+0000","last_fullsized":"2024-04-22T19:58:00.401419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:02:39.509029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.978944+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:11.978944+0000","last_peered":"2024-04-22T19:58:11.978944+0000","last_clean":"2024-04-22T19:58:11.978944+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:11.978944+0000","last_undegraded":"2024-04-22T19:58:11.978944+0000","last_fullsized":"2024-04-22T19:58:11.978944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494248+0000","last_change":"2024-04-22T19:54:03.272676+0000","last_active":"2024-04-22T19:58:00.494248+0000","last_peered":"2024-04-22T19:58:00.494248+0000","last_clean":"2024-04-22T19:58:00.494248+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:00.494248+0000","last_undegraded":"2024-04-22T19:58:00.494248+0000","last_fullsized":"2024-04-22T19:58:00.494248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:43:48.015658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486245+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486245+0000","last_peered":"2024-04-22T19:58:00.486245+0000","last_clean":"2024-04-22T19:58:00.486245+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486245+0000","last_undegraded":"2024-04-22T19:58:00.486245+0000","last_fullsized":"2024-04-22T19:58:00.486245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:43:32.876738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'55","reported_seq":292,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.587766+0000","last_change":"2024-04-22T19:54:15.379444+0000","last_active":"2024-04-22T19:58:11.587766+0000","last_peered":"2024-04-22T19:58:11.587766+0000","last_clean":"2024-04-22T19:58:11.587766+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:11.587766+0000","last_undegraded":"2024-04-22T19:58:11.587766+0000","last_fullsized":"2024-04-22T19:58:11.587766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:33:21.159356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486772+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486772+0000","last_peered":"2024-04-22T19:58:00.486772+0000","last_clean":"2024-04-22T19:58:00.486772+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486772+0000","last_undegraded":"2024-04-22T19:58:00.486772+0000","last_fullsized":"2024-04-22T19:58:00.486772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:37.984796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491448+0000","last_change":"2024-04-22T19:54:19.396495+0000","last_active":"2024-04-22T19:58:00.491448+0000","last_peered":"2024-04-22T19:58:00.491448+0000","last_clean":"2024-04-22T19:58:00.491448+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:00.491448+0000","last_undegraded":"2024-04-22T19:58:00.491448+0000","last_fullsized":"2024-04-22T19:58:00.491448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:22:07.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405074+0000","last_change":"2024-04-22T19:54:19.395179+0000","last_active":"2024-04-22T19:58:00.405074+0000","last_peered":"2024-04-22T19:58:00.405074+0000","last_clean":"2024-04-22T19:58:00.405074+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:00.405074+0000","last_undegraded":"2024-04-22T19:58:00.405074+0000","last_fullsized":"2024-04-22T19:58:00.405074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402873+0000","last_change":"2024-04-22T19:54:11.368474+0000","last_active":"2024-04-22T19:58:00.402873+0000","last_peered":"2024-04-22T19:58:00.402873+0000","last_clean":"2024-04-22T19:58:00.402873+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:00.402873+0000","last_undegraded":"2024-04-22T19:58:00.402873+0000","last_fullsized":"2024-04-22T19:58:00.402873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:26:48.178970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.058928+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:12.058928+0000","last_peered":"2024-04-22T19:58:12.058928+0000","last_clean":"2024-04-22T19:58:12.058928+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:12.058928+0000","last_undegraded":"2024-04-22T19:58:12.058928+0000","last_fullsized":"2024-04-22T19:58:12.058928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:43.763373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401145+0000","last_change":"2024-04-22T19:54:13.376307+0000","last_active":"2024-04-22T19:58:00.401145+0000","last_peered":"2024-04-22T19:58:00.401145+0000","last_clean":"2024-04-22T19:58:00.401145+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:00.401145+0000","last_undegraded":"2024-04-22T19:58:00.401145+0000","last_fullsized":"2024-04-22T19:58:00.401145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'22","reported_seq":57,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.751149+0000","last_change":"2024-04-22T19:57:46.918324+0000","last_active":"2024-04-22T19:58:11.751149+0000","last_peered":"2024-04-22T19:58:11.751149+0000","last_clean":"2024-04-22T19:58:11.751149+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:11.751149+0000","last_undegraded":"2024-04-22T19:58:11.751149+0000","last_fullsized":"2024-04-22T19:58:11.751149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:41:27.240846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485706+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485706+0000","last_peered":"2024-04-22T19:58:00.485706+0000","last_clean":"2024-04-22T19:58:00.485706+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485706+0000","last_undegraded":"2024-04-22T19:58:00.485706+0000","last_fullsized":"2024-04-22T19:58:00.485706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:12.970166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"102'7","reported_seq":46,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487243+0000","last_change":"2024-04-22T19:57:46.923442+0000","last_active":"2024-04-22T19:58:00.487243+0000","last_peered":"2024-04-22T19:58:00.487243+0000","last_clean":"2024-04-22T19:58:00.487243+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:00.487243+0000","last_undegraded":"2024-04-22T19:58:00.487243+0000","last_fullsized":"2024-04-22T19:58:00.487243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:09:49.073608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400490+0000","last_change":"2024-04-22T19:54:11.352670+0000","last_active":"2024-04-22T19:58:00.400490+0000","last_peered":"2024-04-22T19:58:00.400490+0000","last_clean":"2024-04-22T19:58:00.400490+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:00.400490+0000","last_undegraded":"2024-04-22T19:58:00.400490+0000","last_fullsized":"2024-04-22T19:58:00.400490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":364,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.981031+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:11.981031+0000","last_peered":"2024-04-22T19:58:11.981031+0000","last_clean":"2024-04-22T19:58:11.981031+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:11.981031+0000","last_undegraded":"2024-04-22T19:58:11.981031+0000","last_fullsized":"2024-04-22T19:58:11.981031+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:35:32.160410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486849+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486849+0000","last_peered":"2024-04-22T19:58:00.486849+0000","last_clean":"2024-04-22T19:58:00.486849+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486849+0000","last_undegraded":"2024-04-22T19:58:00.486849+0000","last_fullsized":"2024-04-22T19:58:00.486849+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:45.833438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"117'9","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399070+0000","last_change":"2024-04-22T19:54:15.369225+0000","last_active":"2024-04-22T19:58:00.399070+0000","last_peered":"2024-04-22T19:58:00.399070+0000","last_clean":"2024-04-22T19:58:00.399070+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:00.399070+0000","last_undegraded":"2024-04-22T19:58:00.399070+0000","last_fullsized":"2024-04-22T19:58:00.399070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486325+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486325+0000","last_peered":"2024-04-22T19:58:00.486325+0000","last_clean":"2024-04-22T19:58:00.486325+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486325+0000","last_undegraded":"2024-04-22T19:58:00.486325+0000","last_fullsized":"2024-04-22T19:58:00.486325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:34:59.311719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404770+0000","last_change":"2024-04-22T19:54:19.377294+0000","last_active":"2024-04-22T19:58:00.404770+0000","last_peered":"2024-04-22T19:58:00.404770+0000","last_clean":"2024-04-22T19:58:00.404770+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:00.404770+0000","last_undegraded":"2024-04-22T19:58:00.404770+0000","last_fullsized":"2024-04-22T19:58:00.404770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":50,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485631+0000","last_change":"2024-04-22T19:57:48.068057+0000","last_active":"2024-04-22T19:58:00.485631+0000","last_peered":"2024-04-22T19:58:00.485631+0000","last_clean":"2024-04-22T19:58:00.485631+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:00.485631+0000","last_undegraded":"2024-04-22T19:58:00.485631+0000","last_fullsized":"2024-04-22T19:58:00.485631+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:06:55.884454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.023450+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:12.023450+0000","last_peered":"2024-04-22T19:58:12.023450+0000","last_clean":"2024-04-22T19:58:12.023450+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:12.023450+0000","last_undegraded":"2024-04-22T19:58:12.023450+0000","last_fullsized":"2024-04-22T19:58:12.023450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:47.833645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485593+0000","last_change":"2024-04-22T19:54:13.365642+0000","last_active":"2024-04-22T19:58:00.485593+0000","last_peered":"2024-04-22T19:58:00.485593+0000","last_clean":"2024-04-22T19:58:00.485593+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:00.485593+0000","last_undegraded":"2024-04-22T19:58:00.485593+0000","last_fullsized":"2024-04-22T19:58:00.485593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:02:14.977502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'22","reported_seq":57,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.429956+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:11.429956+0000","last_peered":"2024-04-22T19:58:11.429956+0000","last_clean":"2024-04-22T19:58:11.429956+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:11.429956+0000","last_undegraded":"2024-04-22T19:58:11.429956+0000","last_fullsized":"2024-04-22T19:58:11.429956+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:21:06.635158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490373+0000","last_change":"2024-04-22T19:54:17.373832+0000","last_active":"2024-04-22T19:58:00.490373+0000","last_peered":"2024-04-22T19:58:00.490373+0000","last_clean":"2024-04-22T19:58:00.490373+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:00.490373+0000","last_undegraded":"2024-04-22T19:58:00.490373+0000","last_fullsized":"2024-04-22T19:58:00.490373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:41.950374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491335+0000","last_change":"2024-04-22T19:54:19.392472+0000","last_active":"2024-04-22T19:58:00.491335+0000","last_peered":"2024-04-22T19:58:00.491335+0000","last_clean":"2024-04-22T19:58:00.491335+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:00.491335+0000","last_undegraded":"2024-04-22T19:58:00.491335+0000","last_fullsized":"2024-04-22T19:58:00.491335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:52.786544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485251+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485251+0000","last_peered":"2024-04-22T19:58:00.485251+0000","last_clean":"2024-04-22T19:58:00.485251+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485251+0000","last_undegraded":"2024-04-22T19:58:00.485251+0000","last_fullsized":"2024-04-22T19:58:00.485251+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:29.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.031439+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:12.031439+0000","last_peered":"2024-04-22T19:58:12.031439+0000","last_clean":"2024-04-22T19:58:12.031439+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:12.031439+0000","last_undegraded":"2024-04-22T19:58:12.031439+0000","last_fullsized":"2024-04-22T19:58:12.031439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490214+0000","last_change":"2024-04-22T19:54:13.369286+0000","last_active":"2024-04-22T19:58:00.490214+0000","last_peered":"2024-04-22T19:58:00.490214+0000","last_clean":"2024-04-22T19:58:00.490214+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:00.490214+0000","last_undegraded":"2024-04-22T19:58:00.490214+0000","last_fullsized":"2024-04-22T19:58:00.490214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:49:10.200090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'20","reported_seq":239,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.414424+0000","last_change":"2024-04-22T19:54:15.371011+0000","last_active":"2024-04-22T19:58:11.414424+0000","last_peered":"2024-04-22T19:58:11.414424+0000","last_clean":"2024-04-22T19:58:11.414424+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:11.414424+0000","last_undegraded":"2024-04-22T19:58:11.414424+0000","last_fullsized":"2024-04-22T19:58:11.414424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:33:00.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403334+0000","last_change":"2024-04-22T19:54:17.380909+0000","last_active":"2024-04-22T19:58:00.403334+0000","last_peered":"2024-04-22T19:58:00.403334+0000","last_clean":"2024-04-22T19:58:00.403334+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:00.403334+0000","last_undegraded":"2024-04-22T19:58:00.403334+0000","last_fullsized":"2024-04-22T19:58:00.403334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.494056+0000","last_change":"2024-04-22T19:54:11.365234+0000","last_active":"2024-04-22T19:58:00.494056+0000","last_peered":"2024-04-22T19:58:00.494056+0000","last_clean":"2024-04-22T19:58:00.494056+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:00.494056+0000","last_undegraded":"2024-04-22T19:58:00.494056+0000","last_fullsized":"2024-04-22T19:58:00.494056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:17:49.866277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":109,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.959973+0000","last_change":"2024-04-22T19:57:47.635244+0000","last_active":"2024-04-22T19:58:11.959973+0000","last_peered":"2024-04-22T19:58:11.959973+0000","last_clean":"2024-04-22T19:58:11.959973+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:11.959973+0000","last_undegraded":"2024-04-22T19:58:11.959973+0000","last_fullsized":"2024-04-22T19:58:11.959973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:34:44.324590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148385+0000","last_change":"2024-04-22T19:54:13.359579+0000","last_active":"2024-04-22T19:58:15.148385+0000","last_peered":"2024-04-22T19:58:15.148385+0000","last_clean":"2024-04-22T19:58:15.148385+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:15.148385+0000","last_undegraded":"2024-04-22T19:58:15.148385+0000","last_fullsized":"2024-04-22T19:58:15.148385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'36","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.071820+0000","last_change":"2024-04-22T19:54:15.364167+0000","last_active":"2024-04-22T19:58:12.071820+0000","last_peered":"2024-04-22T19:58:12.071820+0000","last_clean":"2024-04-22T19:58:12.071820+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:12.071820+0000","last_undegraded":"2024-04-22T19:58:12.071820+0000","last_fullsized":"2024-04-22T19:58:12.071820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491611+0000","last_change":"2024-04-22T19:57:45.778348+0000","last_active":"2024-04-22T19:58:00.491611+0000","last_peered":"2024-04-22T19:58:00.491611+0000","last_clean":"2024-04-22T19:58:00.491611+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:00.491611+0000","last_undegraded":"2024-04-22T19:58:00.491611+0000","last_fullsized":"2024-04-22T19:58:00.491611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:18:03.760575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486988+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.486988+0000","last_peered":"2024-04-22T19:58:00.486988+0000","last_clean":"2024-04-22T19:58:00.486988+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.486988+0000","last_undegraded":"2024-04-22T19:58:00.486988+0000","last_fullsized":"2024-04-22T19:58:00.486988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:25:04.713958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.686040+0000","last_change":"2024-04-22T19:54:11.363573+0000","last_active":"2024-04-22T19:58:10.686040+0000","last_peered":"2024-04-22T19:58:10.686040+0000","last_clean":"2024-04-22T19:58:10.686040+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:10.686040+0000","last_undegraded":"2024-04-22T19:58:10.686040+0000","last_fullsized":"2024-04-22T19:58:10.686040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":328,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.019953+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:12.019953+0000","last_peered":"2024-04-22T19:58:12.019953+0000","last_clean":"2024-04-22T19:58:12.019953+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:12.019953+0000","last_undegraded":"2024-04-22T19:58:12.019953+0000","last_fullsized":"2024-04-22T19:58:12.019953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493869+0000","last_change":"2024-04-22T19:54:13.364572+0000","last_active":"2024-04-22T19:58:00.493869+0000","last_peered":"2024-04-22T19:58:00.493869+0000","last_clean":"2024-04-22T19:58:00.493869+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:00.493869+0000","last_undegraded":"2024-04-22T19:58:00.493869+0000","last_fullsized":"2024-04-22T19:58:00.493869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:26:00.172795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'26","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.417645+0000","last_change":"2024-04-22T19:54:15.370845+0000","last_active":"2024-04-22T19:58:11.417645+0000","last_peered":"2024-04-22T19:58:11.417645+0000","last_clean":"2024-04-22T19:58:11.417645+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:11.417645+0000","last_undegraded":"2024-04-22T19:58:11.417645+0000","last_fullsized":"2024-04-22T19:58:11.417645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:39.903607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401310+0000","last_change":"2024-04-22T19:54:17.376451+0000","last_active":"2024-04-22T19:58:00.401310+0000","last_peered":"2024-04-22T19:58:00.401310+0000","last_clean":"2024-04-22T19:58:00.401310+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:00.401310+0000","last_undegraded":"2024-04-22T19:58:00.401310+0000","last_fullsized":"2024-04-22T19:58:00.401310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490126+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490126+0000","last_peered":"2024-04-22T19:58:00.490126+0000","last_clean":"2024-04-22T19:58:00.490126+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490126+0000","last_undegraded":"2024-04-22T19:58:00.490126+0000","last_fullsized":"2024-04-22T19:58:00.490126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:43.915262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487034+0000","last_change":"2024-04-22T19:57:46.365442+0000","last_active":"2024-04-22T19:58:00.487034+0000","last_peered":"2024-04-22T19:58:00.487034+0000","last_clean":"2024-04-22T19:58:00.487034+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:00.487034+0000","last_undegraded":"2024-04-22T19:58:00.487034+0000","last_fullsized":"2024-04-22T19:58:00.487034+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:15:29.539259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":262,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.026253+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:12.026253+0000","last_peered":"2024-04-22T19:58:12.026253+0000","last_clean":"2024-04-22T19:58:12.026253+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:12.026253+0000","last_undegraded":"2024-04-22T19:58:12.026253+0000","last_fullsized":"2024-04-22T19:58:12.026253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402917+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402917+0000","last_peered":"2024-04-22T19:58:00.402917+0000","last_clean":"2024-04-22T19:58:00.402917+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402917+0000","last_undegraded":"2024-04-22T19:58:00.402917+0000","last_fullsized":"2024-04-22T19:58:00.402917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:53.937674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"128'23","reported_seq":57,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.770310+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:11.770310+0000","last_peered":"2024-04-22T19:58:11.770310+0000","last_clean":"2024-04-22T19:58:11.770310+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:11.770310+0000","last_undegraded":"2024-04-22T19:58:11.770310+0000","last_fullsized":"2024-04-22T19:58:11.770310+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:28:19.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400036+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:00.400036+0000","last_peered":"2024-04-22T19:58:00.400036+0000","last_clean":"2024-04-22T19:58:00.400036+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:00.400036+0000","last_undegraded":"2024-04-22T19:58:00.400036+0000","last_fullsized":"2024-04-22T19:58:00.400036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488368+0000","last_change":"2024-04-22T19:54:19.395506+0000","last_active":"2024-04-22T19:58:00.488368+0000","last_peered":"2024-04-22T19:58:00.488368+0000","last_clean":"2024-04-22T19:58:00.488368+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:00.488368+0000","last_undegraded":"2024-04-22T19:58:00.488368+0000","last_fullsized":"2024-04-22T19:58:00.488368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:11:22.434840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485971+0000","last_change":"2024-04-22T19:54:11.373640+0000","last_active":"2024-04-22T19:58:00.485971+0000","last_peered":"2024-04-22T19:58:00.485971+0000","last_clean":"2024-04-22T19:58:00.485971+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:00.485971+0000","last_undegraded":"2024-04-22T19:58:00.485971+0000","last_fullsized":"2024-04-22T19:58:00.485971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:43:23.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.034040+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:12.034040+0000","last_peered":"2024-04-22T19:58:12.034040+0000","last_clean":"2024-04-22T19:58:12.034040+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:12.034040+0000","last_undegraded":"2024-04-22T19:58:12.034040+0000","last_fullsized":"2024-04-22T19:58:12.034040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401814+0000","last_change":"2024-04-22T19:54:13.356828+0000","last_active":"2024-04-22T19:58:00.401814+0000","last_peered":"2024-04-22T19:58:00.401814+0000","last_clean":"2024-04-22T19:58:00.401814+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:00.401814+0000","last_undegraded":"2024-04-22T19:58:00.401814+0000","last_fullsized":"2024-04-22T19:58:00.401814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404253+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:00.404253+0000","last_peered":"2024-04-22T19:58:00.404253+0000","last_clean":"2024-04-22T19:58:00.404253+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:00.404253+0000","last_undegraded":"2024-04-22T19:58:00.404253+0000","last_fullsized":"2024-04-22T19:58:00.404253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:48:12.561730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":420,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.979919+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:10.979919+0000","last_peered":"2024-04-22T19:58:10.979919+0000","last_clean":"2024-04-22T19:58:10.979919+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:10.979919+0000","last_undegraded":"2024-04-22T19:58:10.979919+0000","last_fullsized":"2024-04-22T19:58:10.979919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:48.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485516+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485516+0000","last_peered":"2024-04-22T19:58:00.485516+0000","last_clean":"2024-04-22T19:58:00.485516+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485516+0000","last_undegraded":"2024-04-22T19:58:00.485516+0000","last_fullsized":"2024-04-22T19:58:00.485516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:47.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402854+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.402854+0000","last_peered":"2024-04-22T19:58:00.402854+0000","last_clean":"2024-04-22T19:58:00.402854+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.402854+0000","last_undegraded":"2024-04-22T19:58:00.402854+0000","last_fullsized":"2024-04-22T19:58:00.402854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:31.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":280,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.983475+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:11.983475+0000","last_peered":"2024-04-22T19:58:11.983475+0000","last_clean":"2024-04-22T19:58:11.983475+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:11.983475+0000","last_undegraded":"2024-04-22T19:58:11.983475+0000","last_fullsized":"2024-04-22T19:58:11.983475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":212,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486355+0000","last_change":"2024-04-22T19:54:13.366203+0000","last_active":"2024-04-22T19:58:00.486355+0000","last_peered":"2024-04-22T19:58:00.486355+0000","last_clean":"2024-04-22T19:58:00.486355+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:00.486355+0000","last_undegraded":"2024-04-22T19:58:00.486355+0000","last_fullsized":"2024-04-22T19:58:00.486355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:04.899392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'28","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.086958+0000","last_change":"2024-04-22T19:54:15.363221+0000","last_active":"2024-04-22T19:58:12.086958+0000","last_peered":"2024-04-22T19:58:12.086958+0000","last_clean":"2024-04-22T19:58:12.086958+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:12.086958+0000","last_undegraded":"2024-04-22T19:58:12.086958+0000","last_fullsized":"2024-04-22T19:58:12.086958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:44.609853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398598+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398598+0000","last_peered":"2024-04-22T19:58:00.398598+0000","last_clean":"2024-04-22T19:58:00.398598+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398598+0000","last_undegraded":"2024-04-22T19:58:00.398598+0000","last_fullsized":"2024-04-22T19:58:00.398598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488359+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488359+0000","last_peered":"2024-04-22T19:58:00.488359+0000","last_clean":"2024-04-22T19:58:00.488359+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488359+0000","last_undegraded":"2024-04-22T19:58:00.488359+0000","last_fullsized":"2024-04-22T19:58:00.488359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:16.098404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402355+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402355+0000","last_peered":"2024-04-22T19:58:00.402355+0000","last_clean":"2024-04-22T19:58:00.402355+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402355+0000","last_undegraded":"2024-04-22T19:58:00.402355+0000","last_fullsized":"2024-04-22T19:58:00.402355+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:00:06.946182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.995673+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:11.995673+0000","last_peered":"2024-04-22T19:58:11.995673+0000","last_clean":"2024-04-22T19:58:11.995673+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:11.995673+0000","last_undegraded":"2024-04-22T19:58:11.995673+0000","last_fullsized":"2024-04-22T19:58:11.995673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:42:27.905213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489740+0000","last_change":"2024-04-22T19:54:13.370082+0000","last_active":"2024-04-22T19:58:00.489740+0000","last_peered":"2024-04-22T19:58:00.489740+0000","last_clean":"2024-04-22T19:58:00.489740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:00.489740+0000","last_undegraded":"2024-04-22T19:58:00.489740+0000","last_fullsized":"2024-04-22T19:58:00.489740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'20","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.090924+0000","last_change":"2024-04-22T19:54:15.356161+0000","last_active":"2024-04-22T19:58:12.090924+0000","last_peered":"2024-04-22T19:58:12.090924+0000","last_clean":"2024-04-22T19:58:12.090924+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:12.090924+0000","last_undegraded":"2024-04-22T19:58:12.090924+0000","last_fullsized":"2024-04-22T19:58:12.090924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490032+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490032+0000","last_peered":"2024-04-22T19:58:00.490032+0000","last_clean":"2024-04-22T19:58:00.490032+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490032+0000","last_undegraded":"2024-04-22T19:58:00.490032+0000","last_fullsized":"2024-04-22T19:58:00.490032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:51:05.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487757+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487757+0000","last_peered":"2024-04-22T19:58:00.487757+0000","last_clean":"2024-04-22T19:58:00.487757+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487757+0000","last_undegraded":"2024-04-22T19:58:00.487757+0000","last_fullsized":"2024-04-22T19:58:00.487757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:11.692218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":54,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485914+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485914+0000","last_peered":"2024-04-22T19:58:00.485914+0000","last_clean":"2024-04-22T19:58:00.485914+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485914+0000","last_undegraded":"2024-04-22T19:58:00.485914+0000","last_fullsized":"2024-04-22T19:58:00.485914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:20:38.365067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":112,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.964253+0000","last_change":"2024-04-22T19:57:46.910215+0000","last_active":"2024-04-22T19:58:11.964253+0000","last_peered":"2024-04-22T19:58:11.964253+0000","last_clean":"2024-04-22T19:58:11.964253+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:11.964253+0000","last_undegraded":"2024-04-22T19:58:11.964253+0000","last_fullsized":"2024-04-22T19:58:11.964253+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:26:10.074630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401093+0000","last_change":"2024-04-22T19:54:13.364873+0000","last_active":"2024-04-22T19:58:00.401093+0000","last_peered":"2024-04-22T19:58:00.401093+0000","last_clean":"2024-04-22T19:58:00.401093+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:00.401093+0000","last_undegraded":"2024-04-22T19:58:00.401093+0000","last_fullsized":"2024-04-22T19:58:00.401093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:29.528777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'16","reported_seq":51,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.760345+0000","last_change":"2024-04-22T19:57:50.064434+0000","last_active":"2024-04-22T19:58:11.760345+0000","last_peered":"2024-04-22T19:58:11.760345+0000","last_clean":"2024-04-22T19:58:11.760345+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:11.760345+0000","last_undegraded":"2024-04-22T19:58:11.760345+0000","last_fullsized":"2024-04-22T19:58:11.760345+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:03:23.214765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401502+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401502+0000","last_peered":"2024-04-22T19:58:00.401502+0000","last_clean":"2024-04-22T19:58:00.401502+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401502+0000","last_undegraded":"2024-04-22T19:58:00.401502+0000","last_fullsized":"2024-04-22T19:58:00.401502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:41:45.817294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":200,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487993+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.487993+0000","last_peered":"2024-04-22T19:58:00.487993+0000","last_clean":"2024-04-22T19:58:00.487993+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.487993+0000","last_undegraded":"2024-04-22T19:58:00.487993+0000","last_fullsized":"2024-04-22T19:58:00.487993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:21:43.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401599+0000","last_change":"2024-04-22T19:54:11.374977+0000","last_active":"2024-04-22T19:58:00.401599+0000","last_peered":"2024-04-22T19:58:00.401599+0000","last_clean":"2024-04-22T19:58:00.401599+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:00.401599+0000","last_undegraded":"2024-04-22T19:58:00.401599+0000","last_fullsized":"2024-04-22T19:58:00.401599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:25:58.160700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.049873+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:12.049873+0000","last_peered":"2024-04-22T19:58:12.049873+0000","last_clean":"2024-04-22T19:58:12.049873+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:12.049873+0000","last_undegraded":"2024-04-22T19:58:12.049873+0000","last_fullsized":"2024-04-22T19:58:12.049873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400610+0000","last_change":"2024-04-22T19:54:13.373584+0000","last_active":"2024-04-22T19:58:00.400610+0000","last_peered":"2024-04-22T19:58:00.400610+0000","last_clean":"2024-04-22T19:58:00.400610+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:00.400610+0000","last_undegraded":"2024-04-22T19:58:00.400610+0000","last_fullsized":"2024-04-22T19:58:00.400610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'22","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.778850+0000","last_change":"2024-04-22T19:54:15.373897+0000","last_active":"2024-04-22T19:58:11.778850+0000","last_peered":"2024-04-22T19:58:11.778850+0000","last_clean":"2024-04-22T19:58:11.778850+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:11.778850+0000","last_undegraded":"2024-04-22T19:58:11.778850+0000","last_fullsized":"2024-04-22T19:58:11.778850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:39:43.364359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403143+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403143+0000","last_peered":"2024-04-22T19:58:00.403143+0000","last_clean":"2024-04-22T19:58:00.403143+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403143+0000","last_undegraded":"2024-04-22T19:58:00.403143+0000","last_fullsized":"2024-04-22T19:58:00.403143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":208,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403022+0000","last_change":"2024-04-22T19:54:19.379403+0000","last_active":"2024-04-22T19:58:00.403022+0000","last_peered":"2024-04-22T19:58:00.403022+0000","last_clean":"2024-04-22T19:58:00.403022+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:00.403022+0000","last_undegraded":"2024-04-22T19:58:00.403022+0000","last_fullsized":"2024-04-22T19:58:00.403022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:14.401521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405104+0000","last_change":"2024-04-22T19:54:11.359240+0000","last_active":"2024-04-22T19:58:00.405104+0000","last_peered":"2024-04-22T19:58:00.405104+0000","last_clean":"2024-04-22T19:58:00.405104+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:00.405104+0000","last_undegraded":"2024-04-22T19:58:00.405104+0000","last_fullsized":"2024-04-22T19:58:00.405104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.020224+0000","last_change":"2024-04-22T19:54:09.334817+0000","last_active":"2024-04-22T19:58:12.020224+0000","last_peered":"2024-04-22T19:58:12.020224+0000","last_clean":"2024-04-22T19:58:12.020224+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:12.020224+0000","last_undegraded":"2024-04-22T19:58:12.020224+0000","last_fullsized":"2024-04-22T19:58:12.020224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:07:37.583257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404395+0000","last_change":"2024-04-22T19:54:11.356597+0000","last_active":"2024-04-22T19:58:00.404395+0000","last_peered":"2024-04-22T19:58:00.404395+0000","last_clean":"2024-04-22T19:58:00.404395+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:00.404395+0000","last_undegraded":"2024-04-22T19:58:00.404395+0000","last_fullsized":"2024-04-22T19:58:00.404395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.951688+0000","last_change":"2024-04-22T19:54:48.936565+0000","last_active":"2024-04-22T19:58:11.951688+0000","last_peered":"2024-04-22T19:58:11.951688+0000","last_clean":"2024-04-22T19:58:11.951688+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:11.951688+0000","last_undegraded":"2024-04-22T19:58:11.951688+0000","last_fullsized":"2024-04-22T19:58:11.951688+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:09:25.484050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.491788+0000","last_change":"2024-04-22T19:54:11.380828+0000","last_active":"2024-04-22T19:58:00.491788+0000","last_peered":"2024-04-22T19:58:00.491788+0000","last_clean":"2024-04-22T19:58:00.491788+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:00.491788+0000","last_undegraded":"2024-04-22T19:58:00.491788+0000","last_fullsized":"2024-04-22T19:58:00.491788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:50:59.905744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":341,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.883965+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:11.883965+0000","last_peered":"2024-04-22T19:58:11.883965+0000","last_clean":"2024-04-22T19:58:11.883965+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:11.883965+0000","last_undegraded":"2024-04-22T19:58:11.883965+0000","last_fullsized":"2024-04-22T19:58:11.883965+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:42:29.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403516+0000","last_change":"2024-04-22T19:54:11.363533+0000","last_active":"2024-04-22T19:58:00.403516+0000","last_peered":"2024-04-22T19:58:00.403516+0000","last_clean":"2024-04-22T19:58:00.403516+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:00.403516+0000","last_undegraded":"2024-04-22T19:58:00.403516+0000","last_fullsized":"2024-04-22T19:58:00.403516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.034930+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:12.034930+0000","last_peered":"2024-04-22T19:58:12.034930+0000","last_clean":"2024-04-22T19:58:12.034930+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:12.034930+0000","last_undegraded":"2024-04-22T19:58:12.034930+0000","last_fullsized":"2024-04-22T19:58:12.034930+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":44,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487181+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487181+0000","last_peered":"2024-04-22T19:58:00.487181+0000","last_clean":"2024-04-22T19:58:00.487181+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487181+0000","last_undegraded":"2024-04-22T19:58:00.487181+0000","last_fullsized":"2024-04-22T19:58:00.487181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:05:25.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":133,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.021344+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:12.021344+0000","last_peered":"2024-04-22T19:58:12.021344+0000","last_clean":"2024-04-22T19:58:12.021344+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:12.021344+0000","last_undegraded":"2024-04-22T19:58:12.021344+0000","last_fullsized":"2024-04-22T19:58:12.021344+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:28:52.550449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402593+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:00.402593+0000","last_peered":"2024-04-22T19:58:00.402593+0000","last_clean":"2024-04-22T19:58:00.402593+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:00.402593+0000","last_undegraded":"2024-04-22T19:58:00.402593+0000","last_fullsized":"2024-04-22T19:58:00.402593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:54.494696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":321,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.995494+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:11.995494+0000","last_peered":"2024-04-22T19:58:11.995494+0000","last_clean":"2024-04-22T19:58:11.995494+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:11.995494+0000","last_undegraded":"2024-04-22T19:58:11.995494+0000","last_fullsized":"2024-04-22T19:58:11.995494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":42,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485411+0000","last_change":"2024-04-22T19:57:46.362528+0000","last_active":"2024-04-22T19:58:00.485411+0000","last_peered":"2024-04-22T19:58:00.485411+0000","last_clean":"2024-04-22T19:58:00.485411+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:00.485411+0000","last_undegraded":"2024-04-22T19:58:00.485411+0000","last_fullsized":"2024-04-22T19:58:00.485411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:35:22.509202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.036865+0000","last_change":"2024-04-22T19:54:09.351769+0000","last_active":"2024-04-22T19:58:12.036865+0000","last_peered":"2024-04-22T19:58:12.036865+0000","last_clean":"2024-04-22T19:58:12.036865+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:12.036865+0000","last_undegraded":"2024-04-22T19:58:12.036865+0000","last_fullsized":"2024-04-22T19:58:12.036865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:52:55.699552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490237+0000","last_change":"2024-04-22T19:54:11.365952+0000","last_active":"2024-04-22T19:58:00.490237+0000","last_peered":"2024-04-22T19:58:00.490237+0000","last_clean":"2024-04-22T19:58:00.490237+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:00.490237+0000","last_undegraded":"2024-04-22T19:58:00.490237+0000","last_fullsized":"2024-04-22T19:58:00.490237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:17:39.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":94,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.014848+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:12.014848+0000","last_peered":"2024-04-22T19:58:12.014848+0000","last_clean":"2024-04-22T19:58:12.014848+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:12.014848+0000","last_undegraded":"2024-04-22T19:58:12.014848+0000","last_fullsized":"2024-04-22T19:58:12.014848+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:02:16.382298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405265+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405265+0000","last_peered":"2024-04-22T19:58:00.405265+0000","last_clean":"2024-04-22T19:58:00.405265+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405265+0000","last_undegraded":"2024-04-22T19:58:00.405265+0000","last_fullsized":"2024-04-22T19:58:00.405265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":352,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.039227+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:12.039227+0000","last_peered":"2024-04-22T19:58:12.039227+0000","last_clean":"2024-04-22T19:58:12.039227+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:12.039227+0000","last_undegraded":"2024-04-22T19:58:12.039227+0000","last_fullsized":"2024-04-22T19:58:12.039227+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:51:27.590945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":243,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404409+0000","last_change":"2024-04-22T19:54:11.362137+0000","last_active":"2024-04-22T19:58:00.404409+0000","last_peered":"2024-04-22T19:58:00.404409+0000","last_clean":"2024-04-22T19:58:00.404409+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:00.404409+0000","last_undegraded":"2024-04-22T19:58:00.404409+0000","last_fullsized":"2024-04-22T19:58:00.404409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:15:42.269658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":142,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.049825+0000","last_change":"2024-04-22T19:57:50.964307+0000","last_active":"2024-04-22T19:58:12.049825+0000","last_peered":"2024-04-22T19:58:12.049825+0000","last_clean":"2024-04-22T19:58:12.049825+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:12.049825+0000","last_undegraded":"2024-04-22T19:58:12.049825+0000","last_fullsized":"2024-04-22T19:58:12.049825+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:22:00.200638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485934+0000","last_change":"2024-04-22T19:54:11.357275+0000","last_active":"2024-04-22T19:58:00.485934+0000","last_peered":"2024-04-22T19:58:00.485934+0000","last_clean":"2024-04-22T19:58:00.485934+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:00.485934+0000","last_undegraded":"2024-04-22T19:58:00.485934+0000","last_fullsized":"2024-04-22T19:58:00.485934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:51.128516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":296,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.996124+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:11.996124+0000","last_peered":"2024-04-22T19:58:11.996124+0000","last_clean":"2024-04-22T19:58:11.996124+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:11.996124+0000","last_undegraded":"2024-04-22T19:58:11.996124+0000","last_fullsized":"2024-04-22T19:58:11.996124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:04:19.108723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402706+0000","last_change":"2024-04-22T19:54:11.368017+0000","last_active":"2024-04-22T19:58:00.402706+0000","last_peered":"2024-04-22T19:58:00.402706+0000","last_clean":"2024-04-22T19:58:00.402706+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:00.402706+0000","last_undegraded":"2024-04-22T19:58:00.402706+0000","last_fullsized":"2024-04-22T19:58:00.402706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:37:37.481061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":288,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066941+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:12.066941+0000","last_peered":"2024-04-22T19:58:12.066941+0000","last_clean":"2024-04-22T19:58:12.066941+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:12.066941+0000","last_undegraded":"2024-04-22T19:58:12.066941+0000","last_fullsized":"2024-04-22T19:58:12.066941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489049+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489049+0000","last_peered":"2024-04-22T19:58:00.489049+0000","last_clean":"2024-04-22T19:58:00.489049+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489049+0000","last_undegraded":"2024-04-22T19:58:00.489049+0000","last_fullsized":"2024-04-22T19:58:00.489049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:02:44.561618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":279,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066986+0000","last_change":"2024-04-22T19:54:09.349131+0000","last_active":"2024-04-22T19:58:12.066986+0000","last_peered":"2024-04-22T19:58:12.066986+0000","last_clean":"2024-04-22T19:58:12.066986+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:12.066986+0000","last_undegraded":"2024-04-22T19:58:12.066986+0000","last_fullsized":"2024-04-22T19:58:12.066986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:07:11.260559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403321+0000","last_change":"2024-04-22T19:54:11.354667+0000","last_active":"2024-04-22T19:58:00.403321+0000","last_peered":"2024-04-22T19:58:00.403321+0000","last_clean":"2024-04-22T19:58:00.403321+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:00.403321+0000","last_undegraded":"2024-04-22T19:58:00.403321+0000","last_fullsized":"2024-04-22T19:58:00.403321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.020646+0000","last_change":"2024-04-22T19:54:09.359291+0000","last_active":"2024-04-22T19:58:12.020646+0000","last_peered":"2024-04-22T19:58:12.020646+0000","last_clean":"2024-04-22T19:58:12.020646+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:12.020646+0000","last_undegraded":"2024-04-22T19:58:12.020646+0000","last_fullsized":"2024-04-22T19:58:12.020646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:36:07.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485307+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485307+0000","last_peered":"2024-04-22T19:58:00.485307+0000","last_clean":"2024-04-22T19:58:00.485307+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485307+0000","last_undegraded":"2024-04-22T19:58:00.485307+0000","last_fullsized":"2024-04-22T19:58:00.485307+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:11:51.925580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.865158+0000","last_change":"2024-04-22T19:54:09.323344+0000","last_active":"2024-04-22T19:58:11.865158+0000","last_peered":"2024-04-22T19:58:11.865158+0000","last_clean":"2024-04-22T19:58:11.865158+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:11.865158+0000","last_undegraded":"2024-04-22T19:58:11.865158+0000","last_fullsized":"2024-04-22T19:58:11.865158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:51.265371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":293,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485869+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:00.485869+0000","last_peered":"2024-04-22T19:58:00.485869+0000","last_clean":"2024-04-22T19:58:00.485869+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:00.485869+0000","last_undegraded":"2024-04-22T19:58:00.485869+0000","last_fullsized":"2024-04-22T19:58:00.485869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:16.741062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.034143+0000","last_change":"2024-04-22T19:54:48.940917+0000","last_active":"2024-04-22T19:58:12.034143+0000","last_peered":"2024-04-22T19:58:12.034143+0000","last_clean":"2024-04-22T19:58:12.034143+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:12.034143+0000","last_undegraded":"2024-04-22T19:58:12.034143+0000","last_fullsized":"2024-04-22T19:58:12.034143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:32:54.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.926865+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:11.926865+0000","last_peered":"2024-04-22T19:58:11.926865+0000","last_clean":"2024-04-22T19:58:11.926865+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:11.926865+0000","last_undegraded":"2024-04-22T19:58:11.926865+0000","last_fullsized":"2024-04-22T19:58:11.926865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:01:49.095884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405248+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405248+0000","last_peered":"2024-04-22T19:58:00.405248+0000","last_clean":"2024-04-22T19:58:00.405248+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405248+0000","last_undegraded":"2024-04-22T19:58:00.405248+0000","last_fullsized":"2024-04-22T19:58:00.405248+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.064488+0000","last_change":"2024-04-22T19:54:09.346881+0000","last_active":"2024-04-22T19:58:12.064488+0000","last_peered":"2024-04-22T19:58:12.064488+0000","last_clean":"2024-04-22T19:58:12.064488+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:12.064488+0000","last_undegraded":"2024-04-22T19:58:12.064488+0000","last_fullsized":"2024-04-22T19:58:12.064488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.492182+0000","last_change":"2024-04-22T19:54:11.384067+0000","last_active":"2024-04-22T19:58:00.492182+0000","last_peered":"2024-04-22T19:58:00.492182+0000","last_clean":"2024-04-22T19:58:00.492182+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:00.492182+0000","last_undegraded":"2024-04-22T19:58:00.492182+0000","last_fullsized":"2024-04-22T19:58:00.492182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:48.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1116,"ondisk_log_size":1116,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2187264,"data_stored":1499954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36860,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334980,"statfs":{"total":96636764160,"available":96599019520,"internally_reserved":0,"allocated":1560576,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1609728,"data_stored":910300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1548288,"data_stored":907977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41048,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330792,"statfs":{"total":96636764160,"available":96594731008,"internally_reserved":0,"allocated":1589248,"data_stored":909714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1552384,"data_stored":909034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":1581056,"data_stored":909121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37448,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334392,"statfs":{"total":96636764160,"available":96598417408,"internally_reserved":0,"allocated":2158592,"data_stored":1498913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.735 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.736 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.737 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.738 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.739 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.740 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.741 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.742 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.743 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.744 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.745 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.746 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-22T19:53:55.656066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=53, tm_sec=55, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.747 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.748 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.749 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.750 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.751 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.752 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.753 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.754 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.755 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.756 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.757 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.758 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.759 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.760 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.761 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.762 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.763 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.764 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:18.765 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T19:58:38.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:39.119 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:39.135 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-22T19:58:37.439915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":750,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5668,"ondisk_log_size":5668,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304472,"kb_used_data":13464,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670248,"statfs":{"total":773094113280,"available":772782333952,"internally_reserved":0,"allocated":13787136,"data_stored":8453492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006188"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.347079+0000","last_change":"2024-04-22T19:54:09.357167+0000","last_active":"2024-04-22T19:58:18.347079+0000","last_peered":"2024-04-22T19:58:18.347079+0000","last_clean":"2024-04-22T19:58:18.347079+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:18.347079+0000","last_undegraded":"2024-04-22T19:58:18.347079+0000","last_fullsized":"2024-04-22T19:58:18.347079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":258,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:35.623400+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:35.623400+0000","last_peered":"2024-04-22T19:58:35.623400+0000","last_clean":"2024-04-22T19:58:35.623400+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:35.623400+0000","last_undegraded":"2024-04-22T19:58:35.623400+0000","last_fullsized":"2024-04-22T19:58:35.623400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":268,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.399110+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:31.399110+0000","last_peered":"2024-04-22T19:58:31.399110+0000","last_clean":"2024-04-22T19:58:31.399110+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:31.399110+0000","last_undegraded":"2024-04-22T19:58:31.399110+0000","last_fullsized":"2024-04-22T19:58:31.399110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.368899+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:28.368899+0000","last_peered":"2024-04-22T19:58:28.368899+0000","last_clean":"2024-04-22T19:58:28.368899+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:28.368899+0000","last_undegraded":"2024-04-22T19:58:28.368899+0000","last_fullsized":"2024-04-22T19:58:28.368899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":265,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148296+0000","last_change":"2024-04-22T19:54:09.312288+0000","last_active":"2024-04-22T19:58:15.148296+0000","last_peered":"2024-04-22T19:58:15.148296+0000","last_clean":"2024-04-22T19:58:15.148296+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:15.148296+0000","last_undegraded":"2024-04-22T19:58:15.148296+0000","last_fullsized":"2024-04-22T19:58:15.148296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402226+0000","last_change":"2024-04-22T19:54:11.349345+0000","last_active":"2024-04-22T19:58:00.402226+0000","last_peered":"2024-04-22T19:58:00.402226+0000","last_clean":"2024-04-22T19:58:00.402226+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:00.402226+0000","last_undegraded":"2024-04-22T19:58:00.402226+0000","last_fullsized":"2024-04-22T19:58:00.402226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":334,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.069333+0000","last_change":"2024-04-22T19:57:51.065934+0000","last_active":"2024-04-22T19:58:12.069333+0000","last_peered":"2024-04-22T19:58:12.069333+0000","last_clean":"2024-04-22T19:58:12.069333+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:12.069333+0000","last_undegraded":"2024-04-22T19:58:12.069333+0000","last_fullsized":"2024-04-22T19:58:12.069333+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403482+0000","last_change":"2024-04-22T19:57:45.792967+0000","last_active":"2024-04-22T19:58:00.403482+0000","last_peered":"2024-04-22T19:58:00.403482+0000","last_clean":"2024-04-22T19:58:00.403482+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:00.403482+0000","last_undegraded":"2024-04-22T19:58:00.403482+0000","last_fullsized":"2024-04-22T19:58:00.403482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.010982+0000","last_change":"2024-04-22T19:54:09.352874+0000","last_active":"2024-04-22T19:58:12.010982+0000","last_peered":"2024-04-22T19:58:12.010982+0000","last_clean":"2024-04-22T19:58:12.010982+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:12.010982+0000","last_undegraded":"2024-04-22T19:58:12.010982+0000","last_fullsized":"2024-04-22T19:58:12.010982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.058402+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:20.058402+0000","last_peered":"2024-04-22T19:58:20.058402+0000","last_clean":"2024-04-22T19:58:20.058402+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:20.058402+0000","last_undegraded":"2024-04-22T19:58:20.058402+0000","last_fullsized":"2024-04-22T19:58:20.058402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.059088+0000","last_change":"2024-04-22T19:54:09.325494+0000","last_active":"2024-04-22T19:58:12.059088+0000","last_peered":"2024-04-22T19:58:12.059088+0000","last_clean":"2024-04-22T19:58:12.059088+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:12.059088+0000","last_undegraded":"2024-04-22T19:58:12.059088+0000","last_fullsized":"2024-04-22T19:58:12.059088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":238,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.949386+0000","last_change":"2024-04-22T19:54:11.347412+0000","last_active":"2024-04-22T19:58:16.949386+0000","last_peered":"2024-04-22T19:58:16.949386+0000","last_clean":"2024-04-22T19:58:16.949386+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:16.949386+0000","last_undegraded":"2024-04-22T19:58:16.949386+0000","last_fullsized":"2024-04-22T19:58:16.949386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.987670+0000","last_change":"2024-04-22T19:54:09.348873+0000","last_active":"2024-04-22T19:58:11.987670+0000","last_peered":"2024-04-22T19:58:11.987670+0000","last_clean":"2024-04-22T19:58:11.987670+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:11.987670+0000","last_undegraded":"2024-04-22T19:58:11.987670+0000","last_fullsized":"2024-04-22T19:58:11.987670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":239,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.398574+0000","last_change":"2024-04-22T19:54:11.360347+0000","last_active":"2024-04-22T19:58:17.398574+0000","last_peered":"2024-04-22T19:58:17.398574+0000","last_clean":"2024-04-22T19:58:17.398574+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:17.398574+0000","last_undegraded":"2024-04-22T19:58:17.398574+0000","last_fullsized":"2024-04-22T19:58:17.398574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":115,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.835393+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:24.835393+0000","last_peered":"2024-04-22T19:58:24.835393+0000","last_clean":"2024-04-22T19:58:24.835393+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:24.835393+0000","last_undegraded":"2024-04-22T19:58:24.835393+0000","last_fullsized":"2024-04-22T19:58:24.835393+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":268,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.475702+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:31.475702+0000","last_peered":"2024-04-22T19:58:31.475702+0000","last_clean":"2024-04-22T19:58:31.475702+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:31.475702+0000","last_undegraded":"2024-04-22T19:58:31.475702+0000","last_fullsized":"2024-04-22T19:58:31.475702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401632+0000","last_change":"2024-04-22T19:54:11.344362+0000","last_active":"2024-04-22T19:58:00.401632+0000","last_peered":"2024-04-22T19:58:00.401632+0000","last_clean":"2024-04-22T19:58:00.401632+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:00.401632+0000","last_undegraded":"2024-04-22T19:58:00.401632+0000","last_fullsized":"2024-04-22T19:58:00.401632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":145,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.030588+0000","last_change":"2024-04-22T19:56:13.619828+0000","last_active":"2024-04-22T19:58:12.030588+0000","last_peered":"2024-04-22T19:58:12.030588+0000","last_clean":"2024-04-22T19:58:12.030588+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:12.030588+0000","last_undegraded":"2024-04-22T19:58:12.030588+0000","last_fullsized":"2024-04-22T19:58:12.030588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.412030+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:26.412030+0000","last_peered":"2024-04-22T19:58:26.412030+0000","last_clean":"2024-04-22T19:58:26.412030+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:26.412030+0000","last_undegraded":"2024-04-22T19:58:26.412030+0000","last_fullsized":"2024-04-22T19:58:26.412030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":281,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.095172+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:31.095172+0000","last_peered":"2024-04-22T19:58:31.095172+0000","last_clean":"2024-04-22T19:58:31.095172+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:31.095172+0000","last_undegraded":"2024-04-22T19:58:31.095172+0000","last_fullsized":"2024-04-22T19:58:31.095172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.637187+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:33.637187+0000","last_peered":"2024-04-22T19:58:33.637187+0000","last_clean":"2024-04-22T19:58:33.637187+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:33.637187+0000","last_undegraded":"2024-04-22T19:58:33.637187+0000","last_fullsized":"2024-04-22T19:58:33.637187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.087898+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:30.087898+0000","last_peered":"2024-04-22T19:58:30.087898+0000","last_clean":"2024-04-22T19:58:30.087898+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:30.087898+0000","last_undegraded":"2024-04-22T19:58:30.087898+0000","last_fullsized":"2024-04-22T19:58:30.087898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.470564+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:34.470564+0000","last_peered":"2024-04-22T19:58:34.470564+0000","last_clean":"2024-04-22T19:58:34.470564+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:34.470564+0000","last_undegraded":"2024-04-22T19:58:34.470564+0000","last_fullsized":"2024-04-22T19:58:34.470564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":265,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.996307+0000","last_change":"2024-04-22T19:54:09.353842+0000","last_active":"2024-04-22T19:58:11.996307+0000","last_peered":"2024-04-22T19:58:11.996307+0000","last_clean":"2024-04-22T19:58:11.996307+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:11.996307+0000","last_undegraded":"2024-04-22T19:58:11.996307+0000","last_fullsized":"2024-04-22T19:58:11.996307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.518525+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:21.518525+0000","last_peered":"2024-04-22T19:58:21.518525+0000","last_clean":"2024-04-22T19:58:21.518525+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:21.518525+0000","last_undegraded":"2024-04-22T19:58:21.518525+0000","last_fullsized":"2024-04-22T19:58:21.518525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":115,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.961164+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:19.961164+0000","last_peered":"2024-04-22T19:58:19.961164+0000","last_clean":"2024-04-22T19:58:19.961164+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:19.961164+0000","last_undegraded":"2024-04-22T19:58:19.961164+0000","last_fullsized":"2024-04-22T19:58:19.961164+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.306266+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:24.306266+0000","last_peered":"2024-04-22T19:58:24.306266+0000","last_clean":"2024-04-22T19:58:24.306266+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:24.306266+0000","last_undegraded":"2024-04-22T19:58:24.306266+0000","last_fullsized":"2024-04-22T19:58:24.306266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":290,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.041690+0000","last_change":"2024-04-22T19:54:09.313030+0000","last_active":"2024-04-22T19:58:12.041690+0000","last_peered":"2024-04-22T19:58:12.041690+0000","last_clean":"2024-04-22T19:58:12.041690+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:12.041690+0000","last_undegraded":"2024-04-22T19:58:12.041690+0000","last_fullsized":"2024-04-22T19:58:12.041690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401206+0000","last_change":"2024-04-22T19:57:45.795818+0000","last_active":"2024-04-22T19:58:00.401206+0000","last_peered":"2024-04-22T19:58:00.401206+0000","last_clean":"2024-04-22T19:58:00.401206+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:00.401206+0000","last_undegraded":"2024-04-22T19:58:00.401206+0000","last_fullsized":"2024-04-22T19:58:00.401206+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":53,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.905832+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:22.905832+0000","last_peered":"2024-04-22T19:58:22.905832+0000","last_clean":"2024-04-22T19:58:22.905832+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:22.905832+0000","last_undegraded":"2024-04-22T19:58:22.905832+0000","last_fullsized":"2024-04-22T19:58:22.905832+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.026088+0000","last_change":"2024-04-22T19:54:09.358233+0000","last_active":"2024-04-22T19:58:12.026088+0000","last_peered":"2024-04-22T19:58:12.026088+0000","last_clean":"2024-04-22T19:58:12.026088+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:12.026088+0000","last_undegraded":"2024-04-22T19:58:12.026088+0000","last_fullsized":"2024-04-22T19:58:12.026088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.717548+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:22.717548+0000","last_peered":"2024-04-22T19:58:22.717548+0000","last_clean":"2024-04-22T19:58:22.717548+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:22.717548+0000","last_undegraded":"2024-04-22T19:58:22.717548+0000","last_fullsized":"2024-04-22T19:58:22.717548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.718017+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:29.718017+0000","last_peered":"2024-04-22T19:58:29.718017+0000","last_clean":"2024-04-22T19:58:29.718017+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:29.718017+0000","last_undegraded":"2024-04-22T19:58:29.718017+0000","last_fullsized":"2024-04-22T19:58:29.718017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.474168+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:20.474168+0000","last_peered":"2024-04-22T19:58:20.474168+0000","last_clean":"2024-04-22T19:58:20.474168+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:20.474168+0000","last_undegraded":"2024-04-22T19:58:20.474168+0000","last_fullsized":"2024-04-22T19:58:20.474168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"110'51","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488217+0000","last_change":"2024-04-22T19:54:19.392418+0000","last_active":"2024-04-22T19:58:00.488217+0000","last_peered":"2024-04-22T19:58:00.488217+0000","last_clean":"2024-04-22T19:58:00.488217+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:00.488217+0000","last_undegraded":"2024-04-22T19:58:00.488217+0000","last_fullsized":"2024-04-22T19:58:00.488217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.634220+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:31.634220+0000","last_peered":"2024-04-22T19:58:31.634220+0000","last_clean":"2024-04-22T19:58:31.634220+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:31.634220+0000","last_undegraded":"2024-04-22T19:58:31.634220+0000","last_fullsized":"2024-04-22T19:58:31.634220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066950+0000","last_change":"2024-04-22T19:54:09.341763+0000","last_active":"2024-04-22T19:58:12.066950+0000","last_peered":"2024-04-22T19:58:12.066950+0000","last_clean":"2024-04-22T19:58:12.066950+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:12.066950+0000","last_undegraded":"2024-04-22T19:58:12.066950+0000","last_fullsized":"2024-04-22T19:58:12.066950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"25'1","reported_seq":45,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:10.972848+0000","last_change":"2024-04-22T19:57:47.650512+0000","last_active":"2024-04-22T19:58:10.972848+0000","last_peered":"2024-04-22T19:58:10.972848+0000","last_clean":"2024-04-22T19:58:10.972848+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:10.972848+0000","last_undegraded":"2024-04-22T19:58:10.972848+0000","last_fullsized":"2024-04-22T19:58:10.972848+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.302531+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:32.302531+0000","last_peered":"2024-04-22T19:58:32.302531+0000","last_clean":"2024-04-22T19:58:32.302531+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:32.302531+0000","last_undegraded":"2024-04-22T19:58:32.302531+0000","last_fullsized":"2024-04-22T19:58:32.302531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.272817+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:21.272817+0000","last_peered":"2024-04-22T19:58:21.272817+0000","last_clean":"2024-04-22T19:58:21.272817+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:21.272817+0000","last_undegraded":"2024-04-22T19:58:21.272817+0000","last_fullsized":"2024-04-22T19:58:21.272817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.778872+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:18.778872+0000","last_peered":"2024-04-22T19:58:18.778872+0000","last_clean":"2024-04-22T19:58:18.778872+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:18.778872+0000","last_undegraded":"2024-04-22T19:58:18.778872+0000","last_fullsized":"2024-04-22T19:58:18.778872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.839559+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:21.839559+0000","last_peered":"2024-04-22T19:58:21.839559+0000","last_clean":"2024-04-22T19:58:21.839559+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:21.839559+0000","last_undegraded":"2024-04-22T19:58:21.839559+0000","last_fullsized":"2024-04-22T19:58:21.839559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":263,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.438756+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:34.438756+0000","last_peered":"2024-04-22T19:58:34.438756+0000","last_clean":"2024-04-22T19:58:34.438756+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:34.438756+0000","last_undegraded":"2024-04-22T19:58:34.438756+0000","last_fullsized":"2024-04-22T19:58:34.438756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487708+0000","last_change":"2024-04-22T19:57:45.787247+0000","last_active":"2024-04-22T19:58:00.487708+0000","last_peered":"2024-04-22T19:58:00.487708+0000","last_clean":"2024-04-22T19:58:00.487708+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:00.487708+0000","last_undegraded":"2024-04-22T19:58:00.487708+0000","last_fullsized":"2024-04-22T19:58:00.487708+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.479338+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:16.479338+0000","last_peered":"2024-04-22T19:58:16.479338+0000","last_clean":"2024-04-22T19:58:16.479338+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:16.479338+0000","last_undegraded":"2024-04-22T19:58:16.479338+0000","last_fullsized":"2024-04-22T19:58:16.479338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":397,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.498739+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:19.498739+0000","last_peered":"2024-04-22T19:58:19.498739+0000","last_clean":"2024-04-22T19:58:19.498739+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:19.498739+0000","last_undegraded":"2024-04-22T19:58:19.498739+0000","last_fullsized":"2024-04-22T19:58:19.498739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.187980+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:17.187980+0000","last_peered":"2024-04-22T19:58:17.187980+0000","last_clean":"2024-04-22T19:58:17.187980+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:17.187980+0000","last_undegraded":"2024-04-22T19:58:17.187980+0000","last_fullsized":"2024-04-22T19:58:17.187980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":49,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487729+0000","last_change":"2024-04-22T19:57:52.391897+0000","last_active":"2024-04-22T19:58:00.487729+0000","last_peered":"2024-04-22T19:58:00.487729+0000","last_clean":"2024-04-22T19:58:00.487729+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:00.487729+0000","last_undegraded":"2024-04-22T19:58:00.487729+0000","last_fullsized":"2024-04-22T19:58:00.487729+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":291,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.040781+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:28.040781+0000","last_peered":"2024-04-22T19:58:28.040781+0000","last_clean":"2024-04-22T19:58:28.040781+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:28.040781+0000","last_undegraded":"2024-04-22T19:58:28.040781+0000","last_fullsized":"2024-04-22T19:58:28.040781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.641405+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:20.641405+0000","last_peered":"2024-04-22T19:58:20.641405+0000","last_clean":"2024-04-22T19:58:20.641405+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:20.641405+0000","last_undegraded":"2024-04-22T19:58:20.641405+0000","last_fullsized":"2024-04-22T19:58:20.641405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":253,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.427807+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:33.427807+0000","last_peered":"2024-04-22T19:58:33.427807+0000","last_clean":"2024-04-22T19:58:33.427807+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:33.427807+0000","last_undegraded":"2024-04-22T19:58:33.427807+0000","last_fullsized":"2024-04-22T19:58:33.427807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"128'144","reported_seq":389,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.109350+0000","last_change":"2024-04-22T19:57:52.333657+0000","last_active":"2024-04-22T19:58:12.109350+0000","last_peered":"2024-04-22T19:58:12.109350+0000","last_clean":"2024-04-22T19:58:12.109350+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:12.109350+0000","last_undegraded":"2024-04-22T19:58:12.109350+0000","last_fullsized":"2024-04-22T19:58:12.109350+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.654960+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:29.654960+0000","last_peered":"2024-04-22T19:58:29.654960+0000","last_clean":"2024-04-22T19:58:29.654960+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:29.654960+0000","last_undegraded":"2024-04-22T19:58:29.654960+0000","last_fullsized":"2024-04-22T19:58:29.654960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":271,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.041990+0000","last_change":"2024-04-22T19:54:09.357522+0000","last_active":"2024-04-22T19:58:12.041990+0000","last_peered":"2024-04-22T19:58:12.041990+0000","last_clean":"2024-04-22T19:58:12.041990+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:12.041990+0000","last_undegraded":"2024-04-22T19:58:12.041990+0000","last_fullsized":"2024-04-22T19:58:12.041990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.512955+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:23.512955+0000","last_peered":"2024-04-22T19:58:23.512955+0000","last_clean":"2024-04-22T19:58:23.512955+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:23.512955+0000","last_undegraded":"2024-04-22T19:58:23.512955+0000","last_fullsized":"2024-04-22T19:58:23.512955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.646966+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:32.646966+0000","last_peered":"2024-04-22T19:58:32.646966+0000","last_clean":"2024-04-22T19:58:32.646966+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:32.646966+0000","last_undegraded":"2024-04-22T19:58:32.646966+0000","last_fullsized":"2024-04-22T19:58:32.646966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.400035+0000","last_change":"2024-04-22T19:54:17.380599+0000","last_active":"2024-04-22T19:58:00.400035+0000","last_peered":"2024-04-22T19:58:00.400035+0000","last_clean":"2024-04-22T19:58:00.400035+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:00.400035+0000","last_undegraded":"2024-04-22T19:58:00.400035+0000","last_fullsized":"2024-04-22T19:58:00.400035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.398673+0000","last_change":"2024-04-22T19:54:19.391674+0000","last_active":"2024-04-22T19:58:17.398673+0000","last_peered":"2024-04-22T19:58:17.398673+0000","last_clean":"2024-04-22T19:58:17.398673+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:17.398673+0000","last_undegraded":"2024-04-22T19:58:17.398673+0000","last_fullsized":"2024-04-22T19:58:17.398673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.293061+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:22.293061+0000","last_peered":"2024-04-22T19:58:22.293061+0000","last_clean":"2024-04-22T19:58:22.293061+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:22.293061+0000","last_undegraded":"2024-04-22T19:58:22.293061+0000","last_fullsized":"2024-04-22T19:58:22.293061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":281,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.053333+0000","last_change":"2024-04-22T19:54:09.358117+0000","last_active":"2024-04-22T19:58:12.053333+0000","last_peered":"2024-04-22T19:58:12.053333+0000","last_clean":"2024-04-22T19:58:12.053333+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:12.053333+0000","last_undegraded":"2024-04-22T19:58:12.053333+0000","last_fullsized":"2024-04-22T19:58:12.053333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.550146+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:25.550146+0000","last_peered":"2024-04-22T19:58:25.550146+0000","last_clean":"2024-04-22T19:58:25.550146+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:25.550146+0000","last_undegraded":"2024-04-22T19:58:25.550146+0000","last_fullsized":"2024-04-22T19:58:25.550146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'20","reported_seq":56,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.096656+0000","last_change":"2024-04-22T19:57:47.665234+0000","last_active":"2024-04-22T19:58:12.096656+0000","last_peered":"2024-04-22T19:58:12.096656+0000","last_clean":"2024-04-22T19:58:12.096656+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:12.096656+0000","last_undegraded":"2024-04-22T19:58:12.096656+0000","last_fullsized":"2024-04-22T19:58:12.096656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486705+0000","last_change":"2024-04-22T19:57:45.761756+0000","last_active":"2024-04-22T19:58:00.486705+0000","last_peered":"2024-04-22T19:58:00.486705+0000","last_clean":"2024-04-22T19:58:00.486705+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:00.486705+0000","last_undegraded":"2024-04-22T19:58:00.486705+0000","last_fullsized":"2024-04-22T19:58:00.486705+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.875171+0000","last_change":"2024-04-22T19:54:19.393333+0000","last_active":"2024-04-22T19:58:17.875171+0000","last_peered":"2024-04-22T19:58:17.875171+0000","last_clean":"2024-04-22T19:58:17.875171+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:17.875171+0000","last_undegraded":"2024-04-22T19:58:17.875171+0000","last_fullsized":"2024-04-22T19:58:17.875171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":254,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.110266+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:24.110266+0000","last_peered":"2024-04-22T19:58:24.110266+0000","last_clean":"2024-04-22T19:58:24.110266+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:24.110266+0000","last_undegraded":"2024-04-22T19:58:24.110266+0000","last_fullsized":"2024-04-22T19:58:24.110266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.359344+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:30.359344+0000","last_peered":"2024-04-22T19:58:30.359344+0000","last_clean":"2024-04-22T19:58:30.359344+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:30.359344+0000","last_undegraded":"2024-04-22T19:58:30.359344+0000","last_fullsized":"2024-04-22T19:58:30.359344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.523947+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:26.523947+0000","last_peered":"2024-04-22T19:58:26.523947+0000","last_clean":"2024-04-22T19:58:26.523947+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:26.523947+0000","last_undegraded":"2024-04-22T19:58:26.523947+0000","last_fullsized":"2024-04-22T19:58:26.523947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":265,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.427862+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:27.427862+0000","last_peered":"2024-04-22T19:58:27.427862+0000","last_clean":"2024-04-22T19:58:27.427862+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:27.427862+0000","last_undegraded":"2024-04-22T19:58:27.427862+0000","last_fullsized":"2024-04-22T19:58:27.427862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":394,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.110320+0000","last_change":"2024-04-22T19:54:17.368108+0000","last_active":"2024-04-22T19:58:12.110320+0000","last_peered":"2024-04-22T19:58:12.110320+0000","last_clean":"2024-04-22T19:58:12.110320+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:12.110320+0000","last_undegraded":"2024-04-22T19:58:12.110320+0000","last_fullsized":"2024-04-22T19:58:12.110320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.730578+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:16.730578+0000","last_peered":"2024-04-22T19:58:16.730578+0000","last_clean":"2024-04-22T19:58:16.730578+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:16.730578+0000","last_undegraded":"2024-04-22T19:58:16.730578+0000","last_fullsized":"2024-04-22T19:58:16.730578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404290+0000","last_change":"2024-04-22T19:54:11.351426+0000","last_active":"2024-04-22T19:58:00.404290+0000","last_peered":"2024-04-22T19:58:00.404290+0000","last_clean":"2024-04-22T19:58:00.404290+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:00.404290+0000","last_undegraded":"2024-04-22T19:58:00.404290+0000","last_fullsized":"2024-04-22T19:58:00.404290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":344,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.062312+0000","last_change":"2024-04-22T19:57:49.776213+0000","last_active":"2024-04-22T19:58:12.062312+0000","last_peered":"2024-04-22T19:58:12.062312+0000","last_clean":"2024-04-22T19:58:12.062312+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:12.062312+0000","last_undegraded":"2024-04-22T19:58:12.062312+0000","last_fullsized":"2024-04-22T19:58:12.062312+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.484410+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:23.484410+0000","last_peered":"2024-04-22T19:58:23.484410+0000","last_clean":"2024-04-22T19:58:23.484410+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:23.484410+0000","last_undegraded":"2024-04-22T19:58:23.484410+0000","last_fullsized":"2024-04-22T19:58:23.484410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.761011+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:27.761011+0000","last_peered":"2024-04-22T19:58:27.761011+0000","last_clean":"2024-04-22T19:58:27.761011+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:27.761011+0000","last_undegraded":"2024-04-22T19:58:27.761011+0000","last_fullsized":"2024-04-22T19:58:27.761011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.518223+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:17.518223+0000","last_peered":"2024-04-22T19:58:17.518223+0000","last_clean":"2024-04-22T19:58:17.518223+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:17.518223+0000","last_undegraded":"2024-04-22T19:58:17.518223+0000","last_fullsized":"2024-04-22T19:58:17.518223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'11","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404063+0000","last_change":"2024-04-22T19:57:49.016556+0000","last_active":"2024-04-22T19:58:00.404063+0000","last_peered":"2024-04-22T19:58:00.404063+0000","last_clean":"2024-04-22T19:58:00.404063+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:00.404063+0000","last_undegraded":"2024-04-22T19:58:00.404063+0000","last_fullsized":"2024-04-22T19:58:00.404063+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":283,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402580+0000","last_change":"2024-04-22T19:57:49.030291+0000","last_active":"2024-04-22T19:58:00.402580+0000","last_peered":"2024-04-22T19:58:00.402580+0000","last_clean":"2024-04-22T19:58:00.402580+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:00.402580+0000","last_undegraded":"2024-04-22T19:58:00.402580+0000","last_fullsized":"2024-04-22T19:58:00.402580+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":121,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.744976+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:34.744976+0000","last_peered":"2024-04-22T19:58:34.744976+0000","last_clean":"2024-04-22T19:58:34.744976+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:34.744976+0000","last_undegraded":"2024-04-22T19:58:34.744976+0000","last_fullsized":"2024-04-22T19:58:34.744976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.533883+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:24.533883+0000","last_peered":"2024-04-22T19:58:24.533883+0000","last_clean":"2024-04-22T19:58:24.533883+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:24.533883+0000","last_undegraded":"2024-04-22T19:58:24.533883+0000","last_fullsized":"2024-04-22T19:58:24.533883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.337857+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:30.337857+0000","last_peered":"2024-04-22T19:58:30.337857+0000","last_clean":"2024-04-22T19:58:30.337857+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:30.337857+0000","last_undegraded":"2024-04-22T19:58:30.337857+0000","last_fullsized":"2024-04-22T19:58:30.337857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405155+0000","last_change":"2024-04-22T19:57:45.783500+0000","last_active":"2024-04-22T19:58:00.405155+0000","last_peered":"2024-04-22T19:58:00.405155+0000","last_clean":"2024-04-22T19:58:00.405155+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:00.405155+0000","last_undegraded":"2024-04-22T19:58:00.405155+0000","last_fullsized":"2024-04-22T19:58:00.405155+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":51,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.927677+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:20.927677+0000","last_peered":"2024-04-22T19:58:20.927677+0000","last_clean":"2024-04-22T19:58:20.927677+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:20.927677+0000","last_undegraded":"2024-04-22T19:58:20.927677+0000","last_fullsized":"2024-04-22T19:58:20.927677+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.332979+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:31.332979+0000","last_peered":"2024-04-22T19:58:31.332979+0000","last_clean":"2024-04-22T19:58:31.332979+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:31.332979+0000","last_undegraded":"2024-04-22T19:58:31.332979+0000","last_fullsized":"2024-04-22T19:58:31.332979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.096451+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:32.096451+0000","last_peered":"2024-04-22T19:58:32.096451+0000","last_clean":"2024-04-22T19:58:32.096451+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:32.096451+0000","last_undegraded":"2024-04-22T19:58:32.096451+0000","last_fullsized":"2024-04-22T19:58:32.096451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.307543+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:18.307543+0000","last_peered":"2024-04-22T19:58:18.307543+0000","last_clean":"2024-04-22T19:58:18.307543+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:18.307543+0000","last_undegraded":"2024-04-22T19:58:18.307543+0000","last_fullsized":"2024-04-22T19:58:18.307543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":308,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.486388+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:32.486388+0000","last_peered":"2024-04-22T19:58:32.486388+0000","last_clean":"2024-04-22T19:58:32.486388+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:32.486388+0000","last_undegraded":"2024-04-22T19:58:32.486388+0000","last_fullsized":"2024-04-22T19:58:32.486388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":415,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.517325+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:27.517325+0000","last_peered":"2024-04-22T19:58:27.517325+0000","last_clean":"2024-04-22T19:58:27.517325+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:27.517325+0000","last_undegraded":"2024-04-22T19:58:27.517325+0000","last_fullsized":"2024-04-22T19:58:27.517325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624606+0000","last_change":"2024-04-22T19:54:19.369141+0000","last_active":"2024-04-22T19:58:15.624606+0000","last_peered":"2024-04-22T19:58:15.624606+0000","last_clean":"2024-04-22T19:58:15.624606+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:15.624606+0000","last_undegraded":"2024-04-22T19:58:15.624606+0000","last_fullsized":"2024-04-22T19:58:15.624606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":253,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.330524+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:25.330524+0000","last_peered":"2024-04-22T19:58:25.330524+0000","last_clean":"2024-04-22T19:58:25.330524+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:25.330524+0000","last_undegraded":"2024-04-22T19:58:25.330524+0000","last_fullsized":"2024-04-22T19:58:25.330524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":292,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.948630+0000","last_change":"2024-04-22T19:54:09.348291+0000","last_active":"2024-04-22T19:58:16.948630+0000","last_peered":"2024-04-22T19:58:16.948630+0000","last_clean":"2024-04-22T19:58:16.948630+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:16.948630+0000","last_undegraded":"2024-04-22T19:58:16.948630+0000","last_fullsized":"2024-04-22T19:58:16.948630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":411,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.683844+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:26.683844+0000","last_peered":"2024-04-22T19:58:26.683844+0000","last_clean":"2024-04-22T19:58:26.683844+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:26.683844+0000","last_undegraded":"2024-04-22T19:58:26.683844+0000","last_fullsized":"2024-04-22T19:58:26.683844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":64,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.869870+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:25.869870+0000","last_peered":"2024-04-22T19:58:25.869870+0000","last_clean":"2024-04-22T19:58:25.869870+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:25.869870+0000","last_undegraded":"2024-04-22T19:58:25.869870+0000","last_fullsized":"2024-04-22T19:58:25.869870+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":447,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:35.051496+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:35.051496+0000","last_peered":"2024-04-22T19:58:35.051496+0000","last_clean":"2024-04-22T19:58:35.051496+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:35.051496+0000","last_undegraded":"2024-04-22T19:58:35.051496+0000","last_fullsized":"2024-04-22T19:58:35.051496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.225650+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:18.225650+0000","last_peered":"2024-04-22T19:58:18.225650+0000","last_clean":"2024-04-22T19:58:18.225650+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:18.225650+0000","last_undegraded":"2024-04-22T19:58:18.225650+0000","last_fullsized":"2024-04-22T19:58:18.225650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.432552+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:33.432552+0000","last_peered":"2024-04-22T19:58:33.432552+0000","last_clean":"2024-04-22T19:58:33.432552+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:33.432552+0000","last_undegraded":"2024-04-22T19:58:33.432552+0000","last_fullsized":"2024-04-22T19:58:33.432552+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":118,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.997537+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:18.997537+0000","last_peered":"2024-04-22T19:58:18.997537+0000","last_clean":"2024-04-22T19:58:18.997537+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:18.997537+0000","last_undegraded":"2024-04-22T19:58:18.997537+0000","last_fullsized":"2024-04-22T19:58:18.997537+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.325673+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:26.325673+0000","last_peered":"2024-04-22T19:58:26.325673+0000","last_clean":"2024-04-22T19:58:26.325673+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:26.325673+0000","last_undegraded":"2024-04-22T19:58:26.325673+0000","last_fullsized":"2024-04-22T19:58:26.325673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.674588+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:30.674588+0000","last_peered":"2024-04-22T19:58:30.674588+0000","last_clean":"2024-04-22T19:58:30.674588+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:30.674588+0000","last_undegraded":"2024-04-22T19:58:30.674588+0000","last_fullsized":"2024-04-22T19:58:30.674588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490591+0000","last_change":"2024-04-22T19:57:45.780946+0000","last_active":"2024-04-22T19:58:00.490591+0000","last_peered":"2024-04-22T19:58:00.490591+0000","last_clean":"2024-04-22T19:58:00.490591+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:00.490591+0000","last_undegraded":"2024-04-22T19:58:00.490591+0000","last_fullsized":"2024-04-22T19:58:00.490591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624611+0000","last_change":"2024-04-22T19:54:19.389880+0000","last_active":"2024-04-22T19:58:15.624611+0000","last_peered":"2024-04-22T19:58:15.624611+0000","last_clean":"2024-04-22T19:58:15.624611+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:15.624611+0000","last_undegraded":"2024-04-22T19:58:15.624611+0000","last_fullsized":"2024-04-22T19:58:15.624611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.123066+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:18.123066+0000","last_peered":"2024-04-22T19:58:18.123066+0000","last_clean":"2024-04-22T19:58:18.123066+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:18.123066+0000","last_undegraded":"2024-04-22T19:58:18.123066+0000","last_fullsized":"2024-04-22T19:58:18.123066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":384,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.695443+0000","last_change":"2024-04-22T19:53:56.683829+0000","last_active":"2024-04-22T19:58:00.695443+0000","last_peered":"2024-04-22T19:58:00.695443+0000","last_clean":"2024-04-22T19:58:00.695443+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:00.695443+0000","last_undegraded":"2024-04-22T19:58:00.695443+0000","last_fullsized":"2024-04-22T19:58:00.695443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:53:55.656066+0000","last_clean_scrub_stamp":"2024-04-22T19:53:55.656066+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.719928+0000","last_change":"2024-04-22T19:54:03.273610+0000","last_active":"2024-04-22T19:58:15.719928+0000","last_peered":"2024-04-22T19:58:15.719928+0000","last_clean":"2024-04-22T19:58:15.719928+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:15.719928+0000","last_undegraded":"2024-04-22T19:58:15.719928+0000","last_fullsized":"2024-04-22T19:58:15.719928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":101,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.053671+0000","last_change":"2024-04-22T19:57:48.052692+0000","last_active":"2024-04-22T19:58:12.053671+0000","last_peered":"2024-04-22T19:58:12.053671+0000","last_clean":"2024-04-22T19:58:12.053671+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:12.053671+0000","last_undegraded":"2024-04-22T19:58:12.053671+0000","last_fullsized":"2024-04-22T19:58:12.053671+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":222,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.518764+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:21.518764+0000","last_peered":"2024-04-22T19:58:21.518764+0000","last_clean":"2024-04-22T19:58:21.518764+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:21.518764+0000","last_undegraded":"2024-04-22T19:58:21.518764+0000","last_fullsized":"2024-04-22T19:58:21.518764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"128'46","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.398632+0000","last_change":"2024-04-22T19:57:47.993413+0000","last_active":"2024-04-22T19:58:17.398632+0000","last_peered":"2024-04-22T19:58:17.398632+0000","last_clean":"2024-04-22T19:58:17.398632+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:17.398632+0000","last_undegraded":"2024-04-22T19:58:17.398632+0000","last_fullsized":"2024-04-22T19:58:17.398632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.881168+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:22.881168+0000","last_peered":"2024-04-22T19:58:22.881168+0000","last_clean":"2024-04-22T19:58:22.881168+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:22.881168+0000","last_undegraded":"2024-04-22T19:58:22.881168+0000","last_fullsized":"2024-04-22T19:58:22.881168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489931+0000","last_change":"2024-04-22T19:54:19.399185+0000","last_active":"2024-04-22T19:58:00.489931+0000","last_peered":"2024-04-22T19:58:00.489931+0000","last_clean":"2024-04-22T19:58:00.489931+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:00.489931+0000","last_undegraded":"2024-04-22T19:58:00.489931+0000","last_fullsized":"2024-04-22T19:58:00.489931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":239,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.719708+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:34.719708+0000","last_peered":"2024-04-22T19:58:34.719708+0000","last_clean":"2024-04-22T19:58:34.719708+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:34.719708+0000","last_undegraded":"2024-04-22T19:58:34.719708+0000","last_fullsized":"2024-04-22T19:58:34.719708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:05.696297+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:05.696297+0000","last_peered":"2024-04-22T19:58:05.696297+0000","last_clean":"2024-04-22T19:58:05.696297+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:05.696297+0000","last_undegraded":"2024-04-22T19:58:05.696297+0000","last_fullsized":"2024-04-22T19:58:05.696297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":266,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148093+0000","last_change":"2024-04-22T19:54:09.346668+0000","last_active":"2024-04-22T19:58:15.148093+0000","last_peered":"2024-04-22T19:58:15.148093+0000","last_clean":"2024-04-22T19:58:15.148093+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:15.148093+0000","last_undegraded":"2024-04-22T19:58:15.148093+0000","last_fullsized":"2024-04-22T19:58:15.148093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.702237+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:24.702237+0000","last_peered":"2024-04-22T19:58:24.702237+0000","last_clean":"2024-04-22T19:58:24.702237+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:24.702237+0000","last_undegraded":"2024-04-22T19:58:24.702237+0000","last_fullsized":"2024-04-22T19:58:24.702237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":498,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.357191+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:25.357191+0000","last_peered":"2024-04-22T19:58:25.357191+0000","last_clean":"2024-04-22T19:58:25.357191+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:25.357191+0000","last_undegraded":"2024-04-22T19:58:25.357191+0000","last_fullsized":"2024-04-22T19:58:25.357191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":214,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.447954+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:18.447954+0000","last_peered":"2024-04-22T19:58:18.447954+0000","last_clean":"2024-04-22T19:58:18.447954+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:18.447954+0000","last_undegraded":"2024-04-22T19:58:18.447954+0000","last_fullsized":"2024-04-22T19:58:18.447954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.399764+0000","last_change":"2024-04-22T19:54:19.959403+0000","last_active":"2024-04-22T19:58:00.399764+0000","last_peered":"2024-04-22T19:58:00.399764+0000","last_clean":"2024-04-22T19:58:00.399764+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:00.399764+0000","last_undegraded":"2024-04-22T19:58:00.399764+0000","last_fullsized":"2024-04-22T19:58:00.399764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":229,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624346+0000","last_change":"2024-04-22T19:54:11.356336+0000","last_active":"2024-04-22T19:58:15.624346+0000","last_peered":"2024-04-22T19:58:15.624346+0000","last_clean":"2024-04-22T19:58:15.624346+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:15.624346+0000","last_undegraded":"2024-04-22T19:58:15.624346+0000","last_fullsized":"2024-04-22T19:58:15.624346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.443640+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:30.443640+0000","last_peered":"2024-04-22T19:58:30.443640+0000","last_clean":"2024-04-22T19:58:30.443640+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:30.443640+0000","last_undegraded":"2024-04-22T19:58:30.443640+0000","last_fullsized":"2024-04-22T19:58:30.443640+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.394404+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:32.394404+0000","last_peered":"2024-04-22T19:58:32.394404+0000","last_clean":"2024-04-22T19:58:32.394404+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:32.394404+0000","last_undegraded":"2024-04-22T19:58:32.394404+0000","last_fullsized":"2024-04-22T19:58:32.394404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":320,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.530479+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:18.530479+0000","last_peered":"2024-04-22T19:58:18.530479+0000","last_clean":"2024-04-22T19:58:18.530479+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:18.530479+0000","last_undegraded":"2024-04-22T19:58:18.530479+0000","last_fullsized":"2024-04-22T19:58:18.530479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":294,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:35.476679+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:35.476679+0000","last_peered":"2024-04-22T19:58:35.476679+0000","last_clean":"2024-04-22T19:58:35.476679+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:35.476679+0000","last_undegraded":"2024-04-22T19:58:35.476679+0000","last_fullsized":"2024-04-22T19:58:35.476679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":219,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.758325+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:33.758325+0000","last_peered":"2024-04-22T19:58:33.758325+0000","last_clean":"2024-04-22T19:58:33.758325+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:33.758325+0000","last_undegraded":"2024-04-22T19:58:33.758325+0000","last_fullsized":"2024-04-22T19:58:33.758325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":51,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.987167+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:17.987167+0000","last_peered":"2024-04-22T19:58:17.987167+0000","last_clean":"2024-04-22T19:58:17.987167+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:17.987167+0000","last_undegraded":"2024-04-22T19:58:17.987167+0000","last_fullsized":"2024-04-22T19:58:17.987167+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.362253+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:22.362253+0000","last_peered":"2024-04-22T19:58:22.362253+0000","last_clean":"2024-04-22T19:58:22.362253+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:22.362253+0000","last_undegraded":"2024-04-22T19:58:22.362253+0000","last_fullsized":"2024-04-22T19:58:22.362253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":232,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.719867+0000","last_change":"2024-04-22T19:54:03.276465+0000","last_active":"2024-04-22T19:58:15.719867+0000","last_peered":"2024-04-22T19:58:15.719867+0000","last_clean":"2024-04-22T19:58:15.719867+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:15.719867+0000","last_undegraded":"2024-04-22T19:58:15.719867+0000","last_fullsized":"2024-04-22T19:58:15.719867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":272,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.948674+0000","last_change":"2024-04-22T19:54:09.349182+0000","last_active":"2024-04-22T19:58:16.948674+0000","last_peered":"2024-04-22T19:58:16.948674+0000","last_clean":"2024-04-22T19:58:16.948674+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:16.948674+0000","last_undegraded":"2024-04-22T19:58:16.948674+0000","last_fullsized":"2024-04-22T19:58:16.948674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.788502+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:26.788502+0000","last_peered":"2024-04-22T19:58:26.788502+0000","last_clean":"2024-04-22T19:58:26.788502+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:26.788502+0000","last_undegraded":"2024-04-22T19:58:26.788502+0000","last_fullsized":"2024-04-22T19:58:26.788502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":67,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.879005+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:23.879005+0000","last_peered":"2024-04-22T19:58:23.879005+0000","last_clean":"2024-04-22T19:58:23.879005+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:23.879005+0000","last_undegraded":"2024-04-22T19:58:23.879005+0000","last_fullsized":"2024-04-22T19:58:23.879005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.493807+0000","last_change":"2024-04-22T19:54:17.383482+0000","last_active":"2024-04-22T19:58:00.493807+0000","last_peered":"2024-04-22T19:58:00.493807+0000","last_clean":"2024-04-22T19:58:00.493807+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:00.493807+0000","last_undegraded":"2024-04-22T19:58:00.493807+0000","last_fullsized":"2024-04-22T19:58:00.493807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487742+0000","last_change":"2024-04-22T19:57:45.782647+0000","last_active":"2024-04-22T19:58:00.487742+0000","last_peered":"2024-04-22T19:58:00.487742+0000","last_clean":"2024-04-22T19:58:00.487742+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:00.487742+0000","last_undegraded":"2024-04-22T19:58:00.487742+0000","last_fullsized":"2024-04-22T19:58:00.487742+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.294158+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:20.294158+0000","last_peered":"2024-04-22T19:58:20.294158+0000","last_clean":"2024-04-22T19:58:20.294158+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:20.294158+0000","last_undegraded":"2024-04-22T19:58:20.294158+0000","last_fullsized":"2024-04-22T19:58:20.294158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":318,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.397427+0000","last_change":"2024-04-22T19:57:46.189080+0000","last_active":"2024-04-22T19:58:17.397427+0000","last_peered":"2024-04-22T19:58:17.397427+0000","last_clean":"2024-04-22T19:58:17.397427+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:17.397427+0000","last_undegraded":"2024-04-22T19:58:17.397427+0000","last_fullsized":"2024-04-22T19:58:17.397427+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":238,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.434858+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:30.434858+0000","last_peered":"2024-04-22T19:58:30.434858+0000","last_clean":"2024-04-22T19:58:30.434858+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:30.434858+0000","last_undegraded":"2024-04-22T19:58:30.434858+0000","last_fullsized":"2024-04-22T19:58:30.434858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.804084+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:24.804084+0000","last_peered":"2024-04-22T19:58:24.804084+0000","last_clean":"2024-04-22T19:58:24.804084+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:24.804084+0000","last_undegraded":"2024-04-22T19:58:24.804084+0000","last_fullsized":"2024-04-22T19:58:24.804084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"128'41","reported_seq":324,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148392+0000","last_change":"2024-04-22T19:57:48.653112+0000","last_active":"2024-04-22T19:58:15.148392+0000","last_peered":"2024-04-22T19:58:15.148392+0000","last_clean":"2024-04-22T19:58:15.148392+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:15.148392+0000","last_undegraded":"2024-04-22T19:58:15.148392+0000","last_fullsized":"2024-04-22T19:58:15.148392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.949792+0000","last_change":"2024-04-22T19:57:45.770792+0000","last_active":"2024-04-22T19:58:16.949792+0000","last_peered":"2024-04-22T19:58:16.949792+0000","last_clean":"2024-04-22T19:58:16.949792+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:16.949792+0000","last_undegraded":"2024-04-22T19:58:16.949792+0000","last_fullsized":"2024-04-22T19:58:16.949792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":230,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.741150+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:17.741150+0000","last_peered":"2024-04-22T19:58:17.741150+0000","last_clean":"2024-04-22T19:58:17.741150+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:17.741150+0000","last_undegraded":"2024-04-22T19:58:17.741150+0000","last_fullsized":"2024-04-22T19:58:17.741150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":279,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.727203+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:28.727203+0000","last_peered":"2024-04-22T19:58:28.727203+0000","last_clean":"2024-04-22T19:58:28.727203+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:28.727203+0000","last_undegraded":"2024-04-22T19:58:28.727203+0000","last_fullsized":"2024-04-22T19:58:28.727203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":284,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.411783+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:33.411783+0000","last_peered":"2024-04-22T19:58:33.411783+0000","last_clean":"2024-04-22T19:58:33.411783+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:33.411783+0000","last_undegraded":"2024-04-22T19:58:33.411783+0000","last_fullsized":"2024-04-22T19:58:33.411783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.698063+0000","last_change":"2024-04-22T19:54:03.276709+0000","last_active":"2024-04-22T19:58:15.698063+0000","last_peered":"2024-04-22T19:58:15.698063+0000","last_clean":"2024-04-22T19:58:15.698063+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:15.698063+0000","last_undegraded":"2024-04-22T19:58:15.698063+0000","last_fullsized":"2024-04-22T19:58:15.698063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:02.236495+0000","last_clean_scrub_stamp":"2024-04-22T19:54:02.236495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.104338+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:19.104338+0000","last_peered":"2024-04-22T19:58:19.104338+0000","last_clean":"2024-04-22T19:58:19.104338+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:19.104338+0000","last_undegraded":"2024-04-22T19:58:19.104338+0000","last_fullsized":"2024-04-22T19:58:19.104338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":249,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.341817+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:21.341817+0000","last_peered":"2024-04-22T19:58:21.341817+0000","last_clean":"2024-04-22T19:58:21.341817+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:21.341817+0000","last_undegraded":"2024-04-22T19:58:21.341817+0000","last_fullsized":"2024-04-22T19:58:21.341817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":402,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.589495+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:34.589495+0000","last_peered":"2024-04-22T19:58:34.589495+0000","last_clean":"2024-04-22T19:58:34.589495+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:34.589495+0000","last_undegraded":"2024-04-22T19:58:34.589495+0000","last_fullsized":"2024-04-22T19:58:34.589495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487787+0000","last_change":"2024-04-22T19:57:45.786129+0000","last_active":"2024-04-22T19:58:00.487787+0000","last_peered":"2024-04-22T19:58:00.487787+0000","last_clean":"2024-04-22T19:58:00.487787+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:00.487787+0000","last_undegraded":"2024-04-22T19:58:00.487787+0000","last_fullsized":"2024-04-22T19:58:00.487787+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":57,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.733270+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:33.733270+0000","last_peered":"2024-04-22T19:58:33.733270+0000","last_clean":"2024-04-22T19:58:33.733270+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:33.733270+0000","last_undegraded":"2024-04-22T19:58:33.733270+0000","last_fullsized":"2024-04-22T19:58:33.733270+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":89,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.031609+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:12.031609+0000","last_peered":"2024-04-22T19:58:12.031609+0000","last_clean":"2024-04-22T19:58:12.031609+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:12.031609+0000","last_undegraded":"2024-04-22T19:58:12.031609+0000","last_fullsized":"2024-04-22T19:58:12.031609+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":238,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.435751+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:29.435751+0000","last_peered":"2024-04-22T19:58:29.435751+0000","last_clean":"2024-04-22T19:58:29.435751+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:29.435751+0000","last_undegraded":"2024-04-22T19:58:29.435751+0000","last_fullsized":"2024-04-22T19:58:29.435751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.261029+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:20.261029+0000","last_peered":"2024-04-22T19:58:20.261029+0000","last_clean":"2024-04-22T19:58:20.261029+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:20.261029+0000","last_undegraded":"2024-04-22T19:58:20.261029+0000","last_fullsized":"2024-04-22T19:58:20.261029+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"72'11","reported_seq":262,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.949719+0000","last_change":"2024-04-22T19:57:49.813909+0000","last_active":"2024-04-22T19:58:16.949719+0000","last_peered":"2024-04-22T19:58:16.949719+0000","last_clean":"2024-04-22T19:58:16.949719+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:16.949719+0000","last_undegraded":"2024-04-22T19:58:16.949719+0000","last_fullsized":"2024-04-22T19:58:16.949719+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'144","reported_seq":469,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.108468+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:12.108468+0000","last_peered":"2024-04-22T19:58:12.108468+0000","last_clean":"2024-04-22T19:58:12.108468+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:12.108468+0000","last_undegraded":"2024-04-22T19:58:12.108468+0000","last_fullsized":"2024-04-22T19:58:12.108468+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":216,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.404671+0000","last_change":"2024-04-22T19:57:45.778250+0000","last_active":"2024-04-22T19:58:00.404671+0000","last_peered":"2024-04-22T19:58:00.404671+0000","last_clean":"2024-04-22T19:58:00.404671+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:00.404671+0000","last_undegraded":"2024-04-22T19:58:00.404671+0000","last_fullsized":"2024-04-22T19:58:00.404671+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:35.262501+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:35.262501+0000","last_peered":"2024-04-22T19:58:35.262501+0000","last_clean":"2024-04-22T19:58:35.262501+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:35.262501+0000","last_undegraded":"2024-04-22T19:58:35.262501+0000","last_fullsized":"2024-04-22T19:58:35.262501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":265,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148071+0000","last_change":"2024-04-22T19:54:09.315460+0000","last_active":"2024-04-22T19:58:15.148071+0000","last_peered":"2024-04-22T19:58:15.148071+0000","last_clean":"2024-04-22T19:58:15.148071+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:15.148071+0000","last_undegraded":"2024-04-22T19:58:15.148071+0000","last_fullsized":"2024-04-22T19:58:15.148071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":238,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.069374+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:27.069374+0000","last_peered":"2024-04-22T19:58:27.069374+0000","last_clean":"2024-04-22T19:58:27.069374+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:27.069374+0000","last_undegraded":"2024-04-22T19:58:27.069374+0000","last_fullsized":"2024-04-22T19:58:27.069374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486294+0000","last_change":"2024-04-22T19:57:45.774244+0000","last_active":"2024-04-22T19:58:00.486294+0000","last_peered":"2024-04-22T19:58:00.486294+0000","last_clean":"2024-04-22T19:58:00.486294+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:00.486294+0000","last_undegraded":"2024-04-22T19:58:00.486294+0000","last_fullsized":"2024-04-22T19:58:00.486294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.378649+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:31.378649+0000","last_peered":"2024-04-22T19:58:31.378649+0000","last_clean":"2024-04-22T19:58:31.378649+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:31.378649+0000","last_undegraded":"2024-04-22T19:58:31.378649+0000","last_fullsized":"2024-04-22T19:58:31.378649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486821+0000","last_change":"2024-04-22T19:57:45.771606+0000","last_active":"2024-04-22T19:58:00.486821+0000","last_peered":"2024-04-22T19:58:00.486821+0000","last_clean":"2024-04-22T19:58:00.486821+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:00.486821+0000","last_undegraded":"2024-04-22T19:58:00.486821+0000","last_fullsized":"2024-04-22T19:58:00.486821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.596064+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:18.596064+0000","last_peered":"2024-04-22T19:58:18.596064+0000","last_clean":"2024-04-22T19:58:18.596064+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:18.596064+0000","last_undegraded":"2024-04-22T19:58:18.596064+0000","last_fullsized":"2024-04-22T19:58:18.596064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.768820+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:15.768820+0000","last_peered":"2024-04-22T19:58:15.768820+0000","last_clean":"2024-04-22T19:58:15.768820+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:15.768820+0000","last_undegraded":"2024-04-22T19:58:15.768820+0000","last_fullsized":"2024-04-22T19:58:15.768820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.362365+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:27.362365+0000","last_peered":"2024-04-22T19:58:27.362365+0000","last_clean":"2024-04-22T19:58:27.362365+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:27.362365+0000","last_undegraded":"2024-04-22T19:58:27.362365+0000","last_fullsized":"2024-04-22T19:58:27.362365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":279,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.064175+0000","last_change":"2024-04-22T19:54:09.354682+0000","last_active":"2024-04-22T19:58:12.064175+0000","last_peered":"2024-04-22T19:58:12.064175+0000","last_clean":"2024-04-22T19:58:12.064175+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:12.064175+0000","last_undegraded":"2024-04-22T19:58:12.064175+0000","last_fullsized":"2024-04-22T19:58:12.064175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.329316+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:19.329316+0000","last_peered":"2024-04-22T19:58:19.329316+0000","last_clean":"2024-04-22T19:58:19.329316+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:19.329316+0000","last_undegraded":"2024-04-22T19:58:19.329316+0000","last_fullsized":"2024-04-22T19:58:19.329316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":70,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.785956+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:27.785956+0000","last_peered":"2024-04-22T19:58:27.785956+0000","last_clean":"2024-04-22T19:58:27.785956+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:27.785956+0000","last_undegraded":"2024-04-22T19:58:27.785956+0000","last_fullsized":"2024-04-22T19:58:27.785956+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485751+0000","last_change":"2024-04-22T19:57:45.772533+0000","last_active":"2024-04-22T19:58:00.485751+0000","last_peered":"2024-04-22T19:58:00.485751+0000","last_clean":"2024-04-22T19:58:00.485751+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:00.485751+0000","last_undegraded":"2024-04-22T19:58:00.485751+0000","last_fullsized":"2024-04-22T19:58:00.485751+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":56,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.775993+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:29.775993+0000","last_peered":"2024-04-22T19:58:29.775993+0000","last_clean":"2024-04-22T19:58:29.775993+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:29.775993+0000","last_undegraded":"2024-04-22T19:58:29.775993+0000","last_fullsized":"2024-04-22T19:58:29.775993+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:35.390956+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:35.390956+0000","last_peered":"2024-04-22T19:58:35.390956+0000","last_clean":"2024-04-22T19:58:35.390956+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:35.390956+0000","last_undegraded":"2024-04-22T19:58:35.390956+0000","last_fullsized":"2024-04-22T19:58:35.390956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":365,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.026022+0000","last_change":"2024-04-22T19:57:47.576401+0000","last_active":"2024-04-22T19:58:12.026022+0000","last_peered":"2024-04-22T19:58:12.026022+0000","last_clean":"2024-04-22T19:58:12.026022+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:12.026022+0000","last_undegraded":"2024-04-22T19:58:12.026022+0000","last_fullsized":"2024-04-22T19:58:12.026022+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486894+0000","last_change":"2024-04-22T19:57:45.775598+0000","last_active":"2024-04-22T19:58:00.486894+0000","last_peered":"2024-04-22T19:58:00.486894+0000","last_clean":"2024-04-22T19:58:00.486894+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:00.486894+0000","last_undegraded":"2024-04-22T19:58:00.486894+0000","last_fullsized":"2024-04-22T19:58:00.486894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.722229+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:31.722229+0000","last_peered":"2024-04-22T19:58:31.722229+0000","last_clean":"2024-04-22T19:58:31.722229+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:31.722229+0000","last_undegraded":"2024-04-22T19:58:31.722229+0000","last_fullsized":"2024-04-22T19:58:31.722229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.486427+0000","last_change":"2024-04-22T19:54:17.377179+0000","last_active":"2024-04-22T19:58:00.486427+0000","last_peered":"2024-04-22T19:58:00.486427+0000","last_clean":"2024-04-22T19:58:00.486427+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:00.486427+0000","last_undegraded":"2024-04-22T19:58:00.486427+0000","last_fullsized":"2024-04-22T19:58:00.486427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.809244+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:19.809244+0000","last_peered":"2024-04-22T19:58:19.809244+0000","last_clean":"2024-04-22T19:58:19.809244+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:19.809244+0000","last_undegraded":"2024-04-22T19:58:19.809244+0000","last_fullsized":"2024-04-22T19:58:19.809244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":59,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.826779+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:26.826779+0000","last_peered":"2024-04-22T19:58:26.826779+0000","last_clean":"2024-04-22T19:58:26.826779+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:26.826779+0000","last_undegraded":"2024-04-22T19:58:26.826779+0000","last_fullsized":"2024-04-22T19:58:26.826779+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.059102+0000","last_change":"2024-04-22T19:54:09.351409+0000","last_active":"2024-04-22T19:58:12.059102+0000","last_peered":"2024-04-22T19:58:12.059102+0000","last_clean":"2024-04-22T19:58:12.059102+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:12.059102+0000","last_undegraded":"2024-04-22T19:58:12.059102+0000","last_fullsized":"2024-04-22T19:58:12.059102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.467261+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:24.467261+0000","last_peered":"2024-04-22T19:58:24.467261+0000","last_clean":"2024-04-22T19:58:24.467261+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:24.467261+0000","last_undegraded":"2024-04-22T19:58:24.467261+0000","last_fullsized":"2024-04-22T19:58:24.467261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'22","reported_seq":58,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.430946+0000","last_change":"2024-04-22T19:57:47.688084+0000","last_active":"2024-04-22T19:58:11.430946+0000","last_peered":"2024-04-22T19:58:11.430946+0000","last_clean":"2024-04-22T19:58:11.430946+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:11.430946+0000","last_undegraded":"2024-04-22T19:58:11.430946+0000","last_fullsized":"2024-04-22T19:58:11.430946+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.133843+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:25.133843+0000","last_peered":"2024-04-22T19:58:25.133843+0000","last_clean":"2024-04-22T19:58:25.133843+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:25.133843+0000","last_undegraded":"2024-04-22T19:58:25.133843+0000","last_fullsized":"2024-04-22T19:58:25.133843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.685107+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:21.685107+0000","last_peered":"2024-04-22T19:58:21.685107+0000","last_clean":"2024-04-22T19:58:21.685107+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:21.685107+0000","last_undegraded":"2024-04-22T19:58:21.685107+0000","last_fullsized":"2024-04-22T19:58:21.685107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485305+0000","last_change":"2024-04-22T19:57:45.776810+0000","last_active":"2024-04-22T19:58:00.485305+0000","last_peered":"2024-04-22T19:58:00.485305+0000","last_clean":"2024-04-22T19:58:00.485305+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:00.485305+0000","last_undegraded":"2024-04-22T19:58:00.485305+0000","last_fullsized":"2024-04-22T19:58:00.485305+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":260,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.031439+0000","last_change":"2024-04-22T19:54:09.310827+0000","last_active":"2024-04-22T19:58:12.031439+0000","last_peered":"2024-04-22T19:58:12.031439+0000","last_clean":"2024-04-22T19:58:12.031439+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:12.031439+0000","last_undegraded":"2024-04-22T19:58:12.031439+0000","last_fullsized":"2024-04-22T19:58:12.031439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.068926+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:23.068926+0000","last_peered":"2024-04-22T19:58:23.068926+0000","last_clean":"2024-04-22T19:58:23.068926+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:23.068926+0000","last_undegraded":"2024-04-22T19:58:23.068926+0000","last_fullsized":"2024-04-22T19:58:23.068926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":251,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.436912+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:25.436912+0000","last_peered":"2024-04-22T19:58:25.436912+0000","last_clean":"2024-04-22T19:58:25.436912+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:25.436912+0000","last_undegraded":"2024-04-22T19:58:25.436912+0000","last_fullsized":"2024-04-22T19:58:25.436912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.810228+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:20.810228+0000","last_peered":"2024-04-22T19:58:20.810228+0000","last_clean":"2024-04-22T19:58:20.810228+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:20.810228+0000","last_undegraded":"2024-04-22T19:58:20.810228+0000","last_fullsized":"2024-04-22T19:58:20.810228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.097005+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:26.097005+0000","last_peered":"2024-04-22T19:58:26.097005+0000","last_clean":"2024-04-22T19:58:26.097005+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:26.097005+0000","last_undegraded":"2024-04-22T19:58:26.097005+0000","last_fullsized":"2024-04-22T19:58:26.097005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":118,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:31.734187+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:31.734187+0000","last_peered":"2024-04-22T19:58:31.734187+0000","last_clean":"2024-04-22T19:58:31.734187+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:31.734187+0000","last_undegraded":"2024-04-22T19:58:31.734187+0000","last_fullsized":"2024-04-22T19:58:31.734187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.839118+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:23.839118+0000","last_peered":"2024-04-22T19:58:23.839118+0000","last_clean":"2024-04-22T19:58:23.839118+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:23.839118+0000","last_undegraded":"2024-04-22T19:58:23.839118+0000","last_fullsized":"2024-04-22T19:58:23.839118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.377363+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:23.377363+0000","last_peered":"2024-04-22T19:58:23.377363+0000","last_clean":"2024-04-22T19:58:23.377363+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:23.377363+0000","last_undegraded":"2024-04-22T19:58:23.377363+0000","last_fullsized":"2024-04-22T19:58:23.377363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.626374+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:17.626374+0000","last_peered":"2024-04-22T19:58:17.626374+0000","last_clean":"2024-04-22T19:58:17.626374+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:17.626374+0000","last_undegraded":"2024-04-22T19:58:17.626374+0000","last_fullsized":"2024-04-22T19:58:17.626374+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487047+0000","last_change":"2024-04-22T19:57:45.779165+0000","last_active":"2024-04-22T19:58:00.487047+0000","last_peered":"2024-04-22T19:58:00.487047+0000","last_clean":"2024-04-22T19:58:00.487047+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:00.487047+0000","last_undegraded":"2024-04-22T19:58:00.487047+0000","last_fullsized":"2024-04-22T19:58:00.487047+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":240,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.734909+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:30.734909+0000","last_peered":"2024-04-22T19:58:30.734909+0000","last_clean":"2024-04-22T19:58:30.734909+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:30.734909+0000","last_undegraded":"2024-04-22T19:58:30.734909+0000","last_fullsized":"2024-04-22T19:58:30.734909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":328,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.019953+0000","last_change":"2024-04-22T19:57:48.611232+0000","last_active":"2024-04-22T19:58:12.019953+0000","last_peered":"2024-04-22T19:58:12.019953+0000","last_clean":"2024-04-22T19:58:12.019953+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:12.019953+0000","last_undegraded":"2024-04-22T19:58:12.019953+0000","last_fullsized":"2024-04-22T19:58:12.019953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.025798+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:21.025798+0000","last_peered":"2024-04-22T19:58:21.025798+0000","last_clean":"2024-04-22T19:58:21.025798+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:21.025798+0000","last_undegraded":"2024-04-22T19:58:21.025798+0000","last_fullsized":"2024-04-22T19:58:21.025798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":263,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.365026+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:29.365026+0000","last_peered":"2024-04-22T19:58:29.365026+0000","last_clean":"2024-04-22T19:58:29.365026+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:29.365026+0000","last_undegraded":"2024-04-22T19:58:29.365026+0000","last_fullsized":"2024-04-22T19:58:29.365026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.371677+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:27.371677+0000","last_peered":"2024-04-22T19:58:27.371677+0000","last_clean":"2024-04-22T19:58:27.371677+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:27.371677+0000","last_undegraded":"2024-04-22T19:58:27.371677+0000","last_fullsized":"2024-04-22T19:58:27.371677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":209,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490281+0000","last_change":"2024-04-22T19:54:19.379989+0000","last_active":"2024-04-22T19:58:00.490281+0000","last_peered":"2024-04-22T19:58:00.490281+0000","last_clean":"2024-04-22T19:58:00.490281+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:00.490281+0000","last_undegraded":"2024-04-22T19:58:00.490281+0000","last_fullsized":"2024-04-22T19:58:00.490281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":51,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:30.768284+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:30.768284+0000","last_peered":"2024-04-22T19:58:30.768284+0000","last_clean":"2024-04-22T19:58:30.768284+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:30.768284+0000","last_undegraded":"2024-04-22T19:58:30.768284+0000","last_fullsized":"2024-04-22T19:58:30.768284+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":263,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.041770+0000","last_change":"2024-04-22T19:54:09.341030+0000","last_active":"2024-04-22T19:58:12.041770+0000","last_peered":"2024-04-22T19:58:12.041770+0000","last_clean":"2024-04-22T19:58:12.041770+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:12.041770+0000","last_undegraded":"2024-04-22T19:58:12.041770+0000","last_fullsized":"2024-04-22T19:58:12.041770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402959+0000","last_change":"2024-04-22T19:57:45.773101+0000","last_active":"2024-04-22T19:58:00.402959+0000","last_peered":"2024-04-22T19:58:00.402959+0000","last_clean":"2024-04-22T19:58:00.402959+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:00.402959+0000","last_undegraded":"2024-04-22T19:58:00.402959+0000","last_fullsized":"2024-04-22T19:58:00.402959+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:12.323733+0000","last_clean_scrub_stamp":"2024-04-22T19:54:12.323733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"128'23","reported_seq":58,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:11.771591+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:11.771591+0000","last_peered":"2024-04-22T19:58:11.771591+0000","last_clean":"2024-04-22T19:58:11.771591+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:11.771591+0000","last_undegraded":"2024-04-22T19:58:11.771591+0000","last_fullsized":"2024-04-22T19:58:11.771591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624489+0000","last_change":"2024-04-22T19:57:45.768112+0000","last_active":"2024-04-22T19:58:15.624489+0000","last_peered":"2024-04-22T19:58:15.624489+0000","last_clean":"2024-04-22T19:58:15.624489+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:15.624489+0000","last_undegraded":"2024-04-22T19:58:15.624489+0000","last_fullsized":"2024-04-22T19:58:15.624489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":213,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.642093+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:19.642093+0000","last_peered":"2024-04-22T19:58:19.642093+0000","last_clean":"2024-04-22T19:58:19.642093+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:19.642093+0000","last_undegraded":"2024-04-22T19:58:19.642093+0000","last_fullsized":"2024-04-22T19:58:19.642093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.477614+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:22.477614+0000","last_peered":"2024-04-22T19:58:22.477614+0000","last_clean":"2024-04-22T19:58:22.477614+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:22.477614+0000","last_undegraded":"2024-04-22T19:58:22.477614+0000","last_fullsized":"2024-04-22T19:58:22.477614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":264,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.034040+0000","last_change":"2024-04-22T19:54:09.346567+0000","last_active":"2024-04-22T19:58:12.034040+0000","last_peered":"2024-04-22T19:58:12.034040+0000","last_clean":"2024-04-22T19:58:12.034040+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:12.034040+0000","last_undegraded":"2024-04-22T19:58:12.034040+0000","last_fullsized":"2024-04-22T19:58:12.034040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.251287+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:16.251287+0000","last_peered":"2024-04-22T19:58:16.251287+0000","last_clean":"2024-04-22T19:58:16.251287+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:16.251287+0000","last_undegraded":"2024-04-22T19:58:16.251287+0000","last_fullsized":"2024-04-22T19:58:16.251287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'11","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.697160+0000","last_change":"2024-04-22T19:54:15.377429+0000","last_active":"2024-04-22T19:58:15.697160+0000","last_peered":"2024-04-22T19:58:15.697160+0000","last_clean":"2024-04-22T19:58:15.697160+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:15.697160+0000","last_undegraded":"2024-04-22T19:58:15.697160+0000","last_fullsized":"2024-04-22T19:58:15.697160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":422,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.875148+0000","last_change":"2024-04-22T19:54:17.376154+0000","last_active":"2024-04-22T19:58:17.875148+0000","last_peered":"2024-04-22T19:58:17.875148+0000","last_clean":"2024-04-22T19:58:17.875148+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:17.875148+0000","last_undegraded":"2024-04-22T19:58:17.875148+0000","last_fullsized":"2024-04-22T19:58:17.875148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":201,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485660+0000","last_change":"2024-04-22T19:54:19.397080+0000","last_active":"2024-04-22T19:58:00.485660+0000","last_peered":"2024-04-22T19:58:00.485660+0000","last_clean":"2024-04-22T19:58:00.485660+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:00.485660+0000","last_undegraded":"2024-04-22T19:58:00.485660+0000","last_fullsized":"2024-04-22T19:58:00.485660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403010+0000","last_change":"2024-04-22T19:57:47.977373+0000","last_active":"2024-04-22T19:58:00.403010+0000","last_peered":"2024-04-22T19:58:00.403010+0000","last_clean":"2024-04-22T19:58:00.403010+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:00.403010+0000","last_undegraded":"2024-04-22T19:58:00.403010+0000","last_fullsized":"2024-04-22T19:58:00.403010+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":281,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.059077+0000","last_change":"2024-04-22T19:54:09.356159+0000","last_active":"2024-04-22T19:58:12.059077+0000","last_peered":"2024-04-22T19:58:12.059077+0000","last_clean":"2024-04-22T19:58:12.059077+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:12.059077+0000","last_undegraded":"2024-04-22T19:58:12.059077+0000","last_fullsized":"2024-04-22T19:58:12.059077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":221,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.480803+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:22.480803+0000","last_peered":"2024-04-22T19:58:22.480803+0000","last_clean":"2024-04-22T19:58:22.480803+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:22.480803+0000","last_undegraded":"2024-04-22T19:58:22.480803+0000","last_fullsized":"2024-04-22T19:58:22.480803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":269,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.660119+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:28.660119+0000","last_peered":"2024-04-22T19:58:28.660119+0000","last_clean":"2024-04-22T19:58:28.660119+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:28.660119+0000","last_undegraded":"2024-04-22T19:58:28.660119+0000","last_fullsized":"2024-04-22T19:58:28.660119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.398598+0000","last_change":"2024-04-22T19:54:17.377999+0000","last_active":"2024-04-22T19:58:00.398598+0000","last_peered":"2024-04-22T19:58:00.398598+0000","last_clean":"2024-04-22T19:58:00.398598+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:00.398598+0000","last_undegraded":"2024-04-22T19:58:00.398598+0000","last_fullsized":"2024-04-22T19:58:00.398598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":211,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488485+0000","last_change":"2024-04-22T19:54:19.388660+0000","last_active":"2024-04-22T19:58:00.488485+0000","last_peered":"2024-04-22T19:58:00.488485+0000","last_clean":"2024-04-22T19:58:00.488485+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:00.488485+0000","last_undegraded":"2024-04-22T19:58:00.488485+0000","last_fullsized":"2024-04-22T19:58:00.488485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":241,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.402468+0000","last_change":"2024-04-22T19:57:48.658532+0000","last_active":"2024-04-22T19:58:00.402468+0000","last_peered":"2024-04-22T19:58:00.402468+0000","last_clean":"2024-04-22T19:58:00.402468+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:00.402468+0000","last_undegraded":"2024-04-22T19:58:00.402468+0000","last_fullsized":"2024-04-22T19:58:00.402468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":267,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.041913+0000","last_change":"2024-04-22T19:54:09.342004+0000","last_active":"2024-04-22T19:58:12.041913+0000","last_peered":"2024-04-22T19:58:12.041913+0000","last_clean":"2024-04-22T19:58:12.041913+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:12.041913+0000","last_undegraded":"2024-04-22T19:58:12.041913+0000","last_fullsized":"2024-04-22T19:58:12.041913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.674740+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:23.674740+0000","last_peered":"2024-04-22T19:58:23.674740+0000","last_clean":"2024-04-22T19:58:23.674740+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:23.674740+0000","last_undegraded":"2024-04-22T19:58:23.674740+0000","last_fullsized":"2024-04-22T19:58:23.674740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":256,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.822036+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:25.822036+0000","last_peered":"2024-04-22T19:58:25.822036+0000","last_clean":"2024-04-22T19:58:25.822036+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:25.822036+0000","last_undegraded":"2024-04-22T19:58:25.822036+0000","last_fullsized":"2024-04-22T19:58:25.822036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.490078+0000","last_change":"2024-04-22T19:54:17.379797+0000","last_active":"2024-04-22T19:58:00.490078+0000","last_peered":"2024-04-22T19:58:00.490078+0000","last_clean":"2024-04-22T19:58:00.490078+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:00.490078+0000","last_undegraded":"2024-04-22T19:58:00.490078+0000","last_fullsized":"2024-04-22T19:58:00.490078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487807+0000","last_change":"2024-04-22T19:57:45.770779+0000","last_active":"2024-04-22T19:58:00.487807+0000","last_peered":"2024-04-22T19:58:00.487807+0000","last_clean":"2024-04-22T19:58:00.487807+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:00.487807+0000","last_undegraded":"2024-04-22T19:58:00.487807+0000","last_fullsized":"2024-04-22T19:58:00.487807+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":55,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485963+0000","last_change":"2024-04-22T19:57:45.796828+0000","last_active":"2024-04-22T19:58:00.485963+0000","last_peered":"2024-04-22T19:58:00.485963+0000","last_clean":"2024-04-22T19:58:00.485963+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:00.485963+0000","last_undegraded":"2024-04-22T19:58:00.485963+0000","last_fullsized":"2024-04-22T19:58:00.485963+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":121,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.743622+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:28.743622+0000","last_peered":"2024-04-22T19:58:28.743622+0000","last_clean":"2024-04-22T19:58:28.743622+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:28.743622+0000","last_undegraded":"2024-04-22T19:58:28.743622+0000","last_fullsized":"2024-04-22T19:58:28.743622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":223,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.353664+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:28.353664+0000","last_peered":"2024-04-22T19:58:28.353664+0000","last_clean":"2024-04-22T19:58:28.353664+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:28.353664+0000","last_undegraded":"2024-04-22T19:58:28.353664+0000","last_fullsized":"2024-04-22T19:58:28.353664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":61,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.030258+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:17.030258+0000","last_peered":"2024-04-22T19:58:17.030258+0000","last_clean":"2024-04-22T19:58:17.030258+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:17.030258+0000","last_undegraded":"2024-04-22T19:58:17.030258+0000","last_fullsized":"2024-04-22T19:58:17.030258+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":207,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.401800+0000","last_change":"2024-04-22T19:54:17.370333+0000","last_active":"2024-04-22T19:58:00.401800+0000","last_peered":"2024-04-22T19:58:00.401800+0000","last_clean":"2024-04-22T19:58:00.401800+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:00.401800+0000","last_undegraded":"2024-04-22T19:58:00.401800+0000","last_fullsized":"2024-04-22T19:58:00.401800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":201,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.488102+0000","last_change":"2024-04-22T19:54:19.391749+0000","last_active":"2024-04-22T19:58:00.488102+0000","last_peered":"2024-04-22T19:58:00.488102+0000","last_clean":"2024-04-22T19:58:00.488102+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:00.488102+0000","last_undegraded":"2024-04-22T19:58:00.488102+0000","last_fullsized":"2024-04-22T19:58:00.488102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:18.341378+0000","last_clean_scrub_stamp":"2024-04-22T19:54:18.341378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":244,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:23.272425+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:23.272425+0000","last_peered":"2024-04-22T19:58:23.272425+0000","last_clean":"2024-04-22T19:58:23.272425+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:23.272425+0000","last_undegraded":"2024-04-22T19:58:23.272425+0000","last_fullsized":"2024-04-22T19:58:23.272425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":273,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148137+0000","last_change":"2024-04-22T19:54:09.310086+0000","last_active":"2024-04-22T19:58:15.148137+0000","last_peered":"2024-04-22T19:58:15.148137+0000","last_clean":"2024-04-22T19:58:15.148137+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:15.148137+0000","last_undegraded":"2024-04-22T19:58:15.148137+0000","last_fullsized":"2024-04-22T19:58:15.148137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":225,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.276168+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:17.276168+0000","last_peered":"2024-04-22T19:58:17.276168+0000","last_clean":"2024-04-22T19:58:17.276168+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:17.276168+0000","last_undegraded":"2024-04-22T19:58:17.276168+0000","last_fullsized":"2024-04-22T19:58:17.276168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":255,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.235006+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:34.235006+0000","last_peered":"2024-04-22T19:58:34.235006+0000","last_clean":"2024-04-22T19:58:34.235006+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:34.235006+0000","last_undegraded":"2024-04-22T19:58:34.235006+0000","last_fullsized":"2024-04-22T19:58:34.235006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.403143+0000","last_change":"2024-04-22T19:54:17.371917+0000","last_active":"2024-04-22T19:58:00.403143+0000","last_peered":"2024-04-22T19:58:00.403143+0000","last_clean":"2024-04-22T19:58:00.403143+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:00.403143+0000","last_undegraded":"2024-04-22T19:58:00.403143+0000","last_fullsized":"2024-04-22T19:58:00.403143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.211725+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:19.211725+0000","last_peered":"2024-04-22T19:58:19.211725+0000","last_clean":"2024-04-22T19:58:19.211725+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:19.211725+0000","last_undegraded":"2024-04-22T19:58:19.211725+0000","last_fullsized":"2024-04-22T19:58:19.211725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":236,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:26.356910+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:26.356910+0000","last_peered":"2024-04-22T19:58:26.356910+0000","last_clean":"2024-04-22T19:58:26.356910+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:26.356910+0000","last_undegraded":"2024-04-22T19:58:26.356910+0000","last_fullsized":"2024-04-22T19:58:26.356910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":280,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.052614+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:29.052614+0000","last_peered":"2024-04-22T19:58:29.052614+0000","last_clean":"2024-04-22T19:58:29.052614+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:29.052614+0000","last_undegraded":"2024-04-22T19:58:29.052614+0000","last_fullsized":"2024-04-22T19:58:29.052614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":246,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.395324+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:28.395324+0000","last_peered":"2024-04-22T19:58:28.395324+0000","last_clean":"2024-04-22T19:58:28.395324+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:28.395324+0000","last_undegraded":"2024-04-22T19:58:28.395324+0000","last_fullsized":"2024-04-22T19:58:28.395324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":282,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:28.479891+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:28.479891+0000","last_peered":"2024-04-22T19:58:28.479891+0000","last_clean":"2024-04-22T19:58:28.479891+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:28.479891+0000","last_undegraded":"2024-04-22T19:58:28.479891+0000","last_fullsized":"2024-04-22T19:58:28.479891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":247,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:27.649913+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:27.649913+0000","last_peered":"2024-04-22T19:58:27.649913+0000","last_clean":"2024-04-22T19:58:27.649913+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:27.649913+0000","last_undegraded":"2024-04-22T19:58:27.649913+0000","last_fullsized":"2024-04-22T19:58:27.649913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":343,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.397589+0000","last_change":"2024-04-22T19:57:49.009850+0000","last_active":"2024-04-22T19:58:17.397589+0000","last_peered":"2024-04-22T19:58:17.397589+0000","last_clean":"2024-04-22T19:58:17.397589+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:17.397589+0000","last_undegraded":"2024-04-22T19:58:17.397589+0000","last_fullsized":"2024-04-22T19:58:17.397589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:24.357656+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:24.357656+0000","last_peered":"2024-04-22T19:58:24.357656+0000","last_clean":"2024-04-22T19:58:24.357656+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:24.357656+0000","last_undegraded":"2024-04-22T19:58:24.357656+0000","last_fullsized":"2024-04-22T19:58:24.357656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":309,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.148076+0000","last_change":"2024-04-22T19:57:47.968311+0000","last_active":"2024-04-22T19:58:15.148076+0000","last_peered":"2024-04-22T19:58:15.148076+0000","last_clean":"2024-04-22T19:58:15.148076+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:15.148076+0000","last_undegraded":"2024-04-22T19:58:15.148076+0000","last_fullsized":"2024-04-22T19:58:15.148076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":45,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.487245+0000","last_change":"2024-04-22T19:57:47.694412+0000","last_active":"2024-04-22T19:58:00.487245+0000","last_peered":"2024-04-22T19:58:00.487245+0000","last_clean":"2024-04-22T19:58:00.487245+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:00.487245+0000","last_undegraded":"2024-04-22T19:58:00.487245+0000","last_fullsized":"2024-04-22T19:58:00.487245+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":134,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.023397+0000","last_change":"2024-04-22T19:57:51.937743+0000","last_active":"2024-04-22T19:58:12.023397+0000","last_peered":"2024-04-22T19:58:12.023397+0000","last_clean":"2024-04-22T19:58:12.023397+0000","last_became_active":"2024-04-22T19:57:45.779227+0000","last_became_peered":"2024-04-22T19:57:45.779227+0000","last_unstale":"2024-04-22T19:58:12.023397+0000","last_undegraded":"2024-04-22T19:58:12.023397+0000","last_fullsized":"2024-04-22T19:58:12.023397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":220,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:16.949324+0000","last_change":"2024-04-22T19:54:11.356169+0000","last_active":"2024-04-22T19:58:16.949324+0000","last_peered":"2024-04-22T19:58:16.949324+0000","last_clean":"2024-04-22T19:58:16.949324+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:16.949324+0000","last_undegraded":"2024-04-22T19:58:16.949324+0000","last_fullsized":"2024-04-22T19:58:16.949324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":322,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:15.624122+0000","last_change":"2024-04-22T19:57:46.765328+0000","last_active":"2024-04-22T19:58:15.624122+0000","last_peered":"2024-04-22T19:58:15.624122+0000","last_clean":"2024-04-22T19:58:15.624122+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:15.624122+0000","last_undegraded":"2024-04-22T19:58:15.624122+0000","last_fullsized":"2024-04-22T19:58:15.624122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":51,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.687850+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:32.687850+0000","last_peered":"2024-04-22T19:58:32.687850+0000","last_clean":"2024-04-22T19:58:32.687850+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:32.687850+0000","last_undegraded":"2024-04-22T19:58:32.687850+0000","last_fullsized":"2024-04-22T19:58:32.687850+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":288,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.081451+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:34.081451+0000","last_peered":"2024-04-22T19:58:34.081451+0000","last_clean":"2024-04-22T19:58:34.081451+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:34.081451+0000","last_undegraded":"2024-04-22T19:58:34.081451+0000","last_fullsized":"2024-04-22T19:58:34.081451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:22.053775+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:22.053775+0000","last_peered":"2024-04-22T19:58:22.053775+0000","last_clean":"2024-04-22T19:58:22.053775+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:22.053775+0000","last_undegraded":"2024-04-22T19:58:22.053775+0000","last_fullsized":"2024-04-22T19:58:22.053775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":95,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.045107+0000","last_change":"2024-04-22T19:57:52.384742+0000","last_active":"2024-04-22T19:58:12.045107+0000","last_peered":"2024-04-22T19:58:12.045107+0000","last_clean":"2024-04-22T19:58:12.045107+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:12.045107+0000","last_undegraded":"2024-04-22T19:58:12.045107+0000","last_fullsized":"2024-04-22T19:58:12.045107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405265+0000","last_change":"2024-04-22T19:57:49.021502+0000","last_active":"2024-04-22T19:58:00.405265+0000","last_peered":"2024-04-22T19:58:00.405265+0000","last_clean":"2024-04-22T19:58:00.405265+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:00.405265+0000","last_undegraded":"2024-04-22T19:58:00.405265+0000","last_fullsized":"2024-04-22T19:58:00.405265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":354,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:17.397716+0000","last_change":"2024-04-22T19:57:51.906037+0000","last_active":"2024-04-22T19:58:17.397716+0000","last_peered":"2024-04-22T19:58:17.397716+0000","last_clean":"2024-04-22T19:58:17.397716+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:17.397716+0000","last_undegraded":"2024-04-22T19:58:17.397716+0000","last_fullsized":"2024-04-22T19:58:17.397716+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":252,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.251513+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:33.251513+0000","last_peered":"2024-04-22T19:58:33.251513+0000","last_clean":"2024-04-22T19:58:33.251513+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:33.251513+0000","last_undegraded":"2024-04-22T19:58:33.251513+0000","last_fullsized":"2024-04-22T19:58:33.251513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":151,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:21.913037+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:21.913037+0000","last_peered":"2024-04-22T19:58:21.913037+0000","last_clean":"2024-04-22T19:58:21.913037+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:21.913037+0000","last_undegraded":"2024-04-22T19:58:21.913037+0000","last_fullsized":"2024-04-22T19:58:21.913037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":237,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:20.522054+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:20.522054+0000","last_peered":"2024-04-22T19:58:20.522054+0000","last_clean":"2024-04-22T19:58:20.522054+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:20.522054+0000","last_undegraded":"2024-04-22T19:58:20.522054+0000","last_fullsized":"2024-04-22T19:58:20.522054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":297,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066982+0000","last_change":"2024-04-22T19:54:09.342586+0000","last_active":"2024-04-22T19:58:12.066982+0000","last_peered":"2024-04-22T19:58:12.066982+0000","last_clean":"2024-04-22T19:58:12.066982+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:12.066982+0000","last_undegraded":"2024-04-22T19:58:12.066982+0000","last_fullsized":"2024-04-22T19:58:12.066982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":275,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.369720+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:29.369720+0000","last_peered":"2024-04-22T19:58:29.369720+0000","last_clean":"2024-04-22T19:58:29.369720+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:29.369720+0000","last_undegraded":"2024-04-22T19:58:29.369720+0000","last_fullsized":"2024-04-22T19:58:29.369720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":288,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.066941+0000","last_change":"2024-04-22T19:54:09.335204+0000","last_active":"2024-04-22T19:58:12.066941+0000","last_peered":"2024-04-22T19:58:12.066941+0000","last_clean":"2024-04-22T19:58:12.066941+0000","last_became_active":"2024-04-22T19:54:09.334921+0000","last_became_peered":"2024-04-22T19:54:09.334921+0000","last_unstale":"2024-04-22T19:58:12.066941+0000","last_undegraded":"2024-04-22T19:58:12.066941+0000","last_fullsized":"2024-04-22T19:58:12.066941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.489156+0000","last_change":"2024-04-22T19:57:45.782461+0000","last_active":"2024-04-22T19:58:00.489156+0000","last_peered":"2024-04-22T19:58:00.489156+0000","last_clean":"2024-04-22T19:58:00.489156+0000","last_became_active":"2024-04-22T19:57:45.781685+0000","last_became_peered":"2024-04-22T19:57:45.781685+0000","last_unstale":"2024-04-22T19:58:00.489156+0000","last_undegraded":"2024-04-22T19:58:00.489156+0000","last_fullsized":"2024-04-22T19:58:00.489156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":288,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:33.085793+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:33.085793+0000","last_peered":"2024-04-22T19:58:33.085793+0000","last_clean":"2024-04-22T19:58:33.085793+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:33.085793+0000","last_undegraded":"2024-04-22T19:58:33.085793+0000","last_fullsized":"2024-04-22T19:58:33.085793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":257,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.758721+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:32.758721+0000","last_peered":"2024-04-22T19:58:32.758721+0000","last_clean":"2024-04-22T19:58:32.758721+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:32.758721+0000","last_undegraded":"2024-04-22T19:58:32.758721+0000","last_fullsized":"2024-04-22T19:58:32.758721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":273,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:32.406308+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:32.406308+0000","last_peered":"2024-04-22T19:58:32.406308+0000","last_clean":"2024-04-22T19:58:32.406308+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:32.406308+0000","last_undegraded":"2024-04-22T19:58:32.406308+0000","last_fullsized":"2024-04-22T19:58:32.406308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":39,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.485353+0000","last_change":"2024-04-22T19:57:45.765388+0000","last_active":"2024-04-22T19:58:00.485353+0000","last_peered":"2024-04-22T19:58:00.485353+0000","last_clean":"2024-04-22T19:58:00.485353+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:00.485353+0000","last_undegraded":"2024-04-22T19:58:00.485353+0000","last_fullsized":"2024-04-22T19:58:00.485353+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":276,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:19.562267+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:19.562267+0000","last_peered":"2024-04-22T19:58:19.562267+0000","last_clean":"2024-04-22T19:58:19.562267+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:19.562267+0000","last_undegraded":"2024-04-22T19:58:19.562267+0000","last_fullsized":"2024-04-22T19:58:19.562267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":295,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:18.346975+0000","last_change":"2024-04-22T19:57:48.626013+0000","last_active":"2024-04-22T19:58:18.346975+0000","last_peered":"2024-04-22T19:58:18.346975+0000","last_clean":"2024-04-22T19:58:18.346975+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:18.346975+0000","last_undegraded":"2024-04-22T19:58:18.346975+0000","last_fullsized":"2024-04-22T19:58:18.346975+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":250,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:29.463448+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:29.463448+0000","last_peered":"2024-04-22T19:58:29.463448+0000","last_clean":"2024-04-22T19:58:29.463448+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:29.463448+0000","last_undegraded":"2024-04-22T19:58:29.463448+0000","last_fullsized":"2024-04-22T19:58:29.463448+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":279,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:12.036835+0000","last_change":"2024-04-22T19:54:09.313270+0000","last_active":"2024-04-22T19:58:12.036835+0000","last_peered":"2024-04-22T19:58:12.036835+0000","last_clean":"2024-04-22T19:58:12.036835+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:12.036835+0000","last_undegraded":"2024-04-22T19:58:12.036835+0000","last_fullsized":"2024-04-22T19:58:12.036835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":248,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:00.405248+0000","last_change":"2024-04-22T19:57:49.792534+0000","last_active":"2024-04-22T19:58:00.405248+0000","last_peered":"2024-04-22T19:58:00.405248+0000","last_clean":"2024-04-22T19:58:00.405248+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:00.405248+0000","last_undegraded":"2024-04-22T19:58:00.405248+0000","last_fullsized":"2024-04-22T19:58:00.405248+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:10.311638+0000","last_clean_scrub_stamp":"2024-04-22T19:54:10.311638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":277,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:34.442319+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:34.442319+0000","last_peered":"2024-04-22T19:58:34.442319+0000","last_clean":"2024-04-22T19:58:34.442319+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:34.442319+0000","last_undegraded":"2024-04-22T19:58:34.442319+0000","last_fullsized":"2024-04-22T19:58:34.442319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":281,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-22T19:58:25.724496+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:25.724496+0000","last_peered":"2024-04-22T19:58:25.724496+0000","last_clean":"2024-04-22T19:58:25.724496+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:25.724496+0000","last_undegraded":"2024-04-22T19:58:25.724496+0000","last_fullsized":"2024-04-22T19:58:25.724496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1116,"ondisk_log_size":1116,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":981,"ondisk_log_size":981,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":545,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37472,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334368,"statfs":{"total":96636764160,"available":96598392832,"internally_reserved":0,"allocated":2187264,"data_stored":1499954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36860,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334980,"statfs":{"total":96636764160,"available":96599019520,"internally_reserved":0,"allocated":1560576,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1609728,"data_stored":910300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1548288,"data_stored":907977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45208,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326632,"statfs":{"total":96636764160,"available":96590471168,"internally_reserved":0,"allocated":1589248,"data_stored":909714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1552384,"data_stored":909034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1581056,"data_stored":909121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2158592,"data_stored":1498913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:39.179 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.179 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.179 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.180 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.181 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.182 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.183 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-22T19:53:55.656066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=53, tm_sec=55, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.184 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.185 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-22T19:54:02.236495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=2, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.186 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.187 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.188 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-22T19:54:12.323733+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=12, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.189 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.190 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-22T19:54:18.341378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=18, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.191 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.192 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-22T19:54:10.311638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=10, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:39.193 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T19:58:59.195 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:58:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:58:59.559 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:58:59.577 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-04-22T19:58:59.452557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5704,"ondisk_log_size":5704,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304680,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670040,"statfs":{"total":773094113280,"available":772782120960,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.005326"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731541+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731541+0000","last_peered":"2024-04-22T19:58:49.731541+0000","last_clean":"2024-04-22T19:58:49.731541+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731541+0000","last_undegraded":"2024-04-22T19:58:49.731541+0000","last_fullsized":"2024-04-22T19:58:49.731541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778912+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.778912+0000","last_peered":"2024-04-22T19:58:49.778912+0000","last_clean":"2024-04-22T19:58:49.778912+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.778912+0000","last_undegraded":"2024-04-22T19:58:49.778912+0000","last_fullsized":"2024-04-22T19:58:49.778912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723496+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723496+0000","last_peered":"2024-04-22T19:58:49.723496+0000","last_clean":"2024-04-22T19:58:49.723496+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723496+0000","last_undegraded":"2024-04-22T19:58:49.723496+0000","last_fullsized":"2024-04-22T19:58:49.723496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729118+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729118+0000","last_peered":"2024-04-22T19:58:49.729118+0000","last_clean":"2024-04-22T19:58:49.729118+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729118+0000","last_undegraded":"2024-04-22T19:58:49.729118+0000","last_fullsized":"2024-04-22T19:58:49.729118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724878+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.724878+0000","last_peered":"2024-04-22T19:58:49.724878+0000","last_clean":"2024-04-22T19:58:49.724878+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.724878+0000","last_undegraded":"2024-04-22T19:58:49.724878+0000","last_fullsized":"2024-04-22T19:58:49.724878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719368+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719368+0000","last_peered":"2024-04-22T19:58:49.719368+0000","last_clean":"2024-04-22T19:58:49.719368+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719368+0000","last_undegraded":"2024-04-22T19:58:49.719368+0000","last_fullsized":"2024-04-22T19:58:49.719368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":346,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601548+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601548+0000","last_peered":"2024-04-22T19:58:52.601548+0000","last_clean":"2024-04-22T19:58:52.601548+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601548+0000","last_undegraded":"2024-04-22T19:58:52.601548+0000","last_fullsized":"2024-04-22T19:58:52.601548+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848024+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848024+0000","last_peered":"2024-04-22T19:58:50.848024+0000","last_clean":"2024-04-22T19:58:50.848024+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848024+0000","last_undegraded":"2024-04-22T19:58:50.848024+0000","last_fullsized":"2024-04-22T19:58:50.848024+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730627+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730627+0000","last_peered":"2024-04-22T19:58:49.730627+0000","last_clean":"2024-04-22T19:58:49.730627+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730627+0000","last_undegraded":"2024-04-22T19:58:49.730627+0000","last_fullsized":"2024-04-22T19:58:49.730627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780835+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780835+0000","last_peered":"2024-04-22T19:58:49.780835+0000","last_clean":"2024-04-22T19:58:49.780835+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780835+0000","last_undegraded":"2024-04-22T19:58:49.780835+0000","last_fullsized":"2024-04-22T19:58:49.780835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780256+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780256+0000","last_peered":"2024-04-22T19:58:49.780256+0000","last_clean":"2024-04-22T19:58:49.780256+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780256+0000","last_undegraded":"2024-04-22T19:58:49.780256+0000","last_fullsized":"2024-04-22T19:58:49.780256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719945+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.719945+0000","last_peered":"2024-04-22T19:58:49.719945+0000","last_clean":"2024-04-22T19:58:49.719945+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.719945+0000","last_undegraded":"2024-04-22T19:58:49.719945+0000","last_fullsized":"2024-04-22T19:58:49.719945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729451+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729451+0000","last_peered":"2024-04-22T19:58:49.729451+0000","last_clean":"2024-04-22T19:58:49.729451+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729451+0000","last_undegraded":"2024-04-22T19:58:49.729451+0000","last_fullsized":"2024-04-22T19:58:49.729451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783599+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783599+0000","last_peered":"2024-04-22T19:58:49.783599+0000","last_clean":"2024-04-22T19:58:49.783599+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783599+0000","last_undegraded":"2024-04-22T19:58:49.783599+0000","last_fullsized":"2024-04-22T19:58:49.783599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729758+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729758+0000","last_peered":"2024-04-22T19:58:49.729758+0000","last_clean":"2024-04-22T19:58:49.729758+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729758+0000","last_undegraded":"2024-04-22T19:58:49.729758+0000","last_fullsized":"2024-04-22T19:58:49.729758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785564+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785564+0000","last_peered":"2024-04-22T19:58:49.785564+0000","last_clean":"2024-04-22T19:58:49.785564+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785564+0000","last_undegraded":"2024-04-22T19:58:49.785564+0000","last_fullsized":"2024-04-22T19:58:49.785564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785035+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785035+0000","last_peered":"2024-04-22T19:58:49.785035+0000","last_clean":"2024-04-22T19:58:49.785035+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785035+0000","last_undegraded":"2024-04-22T19:58:49.785035+0000","last_fullsized":"2024-04-22T19:58:49.785035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728312+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728312+0000","last_peered":"2024-04-22T19:58:49.728312+0000","last_clean":"2024-04-22T19:58:49.728312+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728312+0000","last_undegraded":"2024-04-22T19:58:49.728312+0000","last_fullsized":"2024-04-22T19:58:49.728312+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719444+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719444+0000","last_peered":"2024-04-22T19:58:49.719444+0000","last_clean":"2024-04-22T19:58:49.719444+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719444+0000","last_undegraded":"2024-04-22T19:58:49.719444+0000","last_fullsized":"2024-04-22T19:58:49.719444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729350+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729350+0000","last_peered":"2024-04-22T19:58:49.729350+0000","last_clean":"2024-04-22T19:58:49.729350+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729350+0000","last_undegraded":"2024-04-22T19:58:49.729350+0000","last_fullsized":"2024-04-22T19:58:49.729350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781037+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781037+0000","last_peered":"2024-04-22T19:58:49.781037+0000","last_clean":"2024-04-22T19:58:49.781037+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781037+0000","last_undegraded":"2024-04-22T19:58:49.781037+0000","last_fullsized":"2024-04-22T19:58:49.781037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720042+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720042+0000","last_peered":"2024-04-22T19:58:49.720042+0000","last_clean":"2024-04-22T19:58:49.720042+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720042+0000","last_undegraded":"2024-04-22T19:58:49.720042+0000","last_fullsized":"2024-04-22T19:58:49.720042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718022+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718022+0000","last_peered":"2024-04-22T19:58:49.718022+0000","last_clean":"2024-04-22T19:58:49.718022+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718022+0000","last_undegraded":"2024-04-22T19:58:49.718022+0000","last_fullsized":"2024-04-22T19:58:49.718022+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780534+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780534+0000","last_peered":"2024-04-22T19:58:49.780534+0000","last_clean":"2024-04-22T19:58:49.780534+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780534+0000","last_undegraded":"2024-04-22T19:58:49.780534+0000","last_fullsized":"2024-04-22T19:58:49.780534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781551+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781551+0000","last_peered":"2024-04-22T19:58:49.781551+0000","last_clean":"2024-04-22T19:58:49.781551+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781551+0000","last_undegraded":"2024-04-22T19:58:49.781551+0000","last_fullsized":"2024-04-22T19:58:49.781551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724737+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724737+0000","last_peered":"2024-04-22T19:58:49.724737+0000","last_clean":"2024-04-22T19:58:49.724737+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724737+0000","last_undegraded":"2024-04-22T19:58:49.724737+0000","last_fullsized":"2024-04-22T19:58:49.724737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731120+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731120+0000","last_peered":"2024-04-22T19:58:49.731120+0000","last_clean":"2024-04-22T19:58:49.731120+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731120+0000","last_undegraded":"2024-04-22T19:58:49.731120+0000","last_fullsized":"2024-04-22T19:58:49.731120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778611+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778611+0000","last_peered":"2024-04-22T19:58:49.778611+0000","last_clean":"2024-04-22T19:58:49.778611+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778611+0000","last_undegraded":"2024-04-22T19:58:49.778611+0000","last_fullsized":"2024-04-22T19:58:49.778611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782296+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.782296+0000","last_peered":"2024-04-22T19:58:49.782296+0000","last_clean":"2024-04-22T19:58:49.782296+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.782296+0000","last_undegraded":"2024-04-22T19:58:49.782296+0000","last_fullsized":"2024-04-22T19:58:49.782296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780804+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780804+0000","last_peered":"2024-04-22T19:58:49.780804+0000","last_clean":"2024-04-22T19:58:49.780804+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780804+0000","last_undegraded":"2024-04-22T19:58:49.780804+0000","last_fullsized":"2024-04-22T19:58:49.780804+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720158+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720158+0000","last_peered":"2024-04-22T19:58:49.720158+0000","last_clean":"2024-04-22T19:58:49.720158+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720158+0000","last_undegraded":"2024-04-22T19:58:49.720158+0000","last_fullsized":"2024-04-22T19:58:49.720158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719672+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719672+0000","last_peered":"2024-04-22T19:58:49.719672+0000","last_clean":"2024-04-22T19:58:49.719672+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719672+0000","last_undegraded":"2024-04-22T19:58:49.719672+0000","last_fullsized":"2024-04-22T19:58:49.719672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719152+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719152+0000","last_peered":"2024-04-22T19:58:49.719152+0000","last_clean":"2024-04-22T19:58:49.719152+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719152+0000","last_undegraded":"2024-04-22T19:58:49.719152+0000","last_fullsized":"2024-04-22T19:58:49.719152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725765+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725765+0000","last_peered":"2024-04-22T19:58:49.725765+0000","last_clean":"2024-04-22T19:58:49.725765+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725765+0000","last_undegraded":"2024-04-22T19:58:49.725765+0000","last_fullsized":"2024-04-22T19:58:49.725765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787663+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787663+0000","last_peered":"2024-04-22T19:58:49.787663+0000","last_clean":"2024-04-22T19:58:49.787663+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787663+0000","last_undegraded":"2024-04-22T19:58:49.787663+0000","last_fullsized":"2024-04-22T19:58:49.787663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730330+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730330+0000","last_peered":"2024-04-22T19:58:49.730330+0000","last_clean":"2024-04-22T19:58:49.730330+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730330+0000","last_undegraded":"2024-04-22T19:58:49.730330+0000","last_fullsized":"2024-04-22T19:58:49.730330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718805+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718805+0000","last_peered":"2024-04-22T19:58:49.718805+0000","last_clean":"2024-04-22T19:58:49.718805+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718805+0000","last_undegraded":"2024-04-22T19:58:49.718805+0000","last_fullsized":"2024-04-22T19:58:49.718805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823685+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823685+0000","last_peered":"2024-04-22T19:58:54.823685+0000","last_clean":"2024-04-22T19:58:54.823685+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823685+0000","last_undegraded":"2024-04-22T19:58:54.823685+0000","last_fullsized":"2024-04-22T19:58:54.823685+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782532+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782532+0000","last_peered":"2024-04-22T19:58:49.782532+0000","last_clean":"2024-04-22T19:58:49.782532+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782532+0000","last_undegraded":"2024-04-22T19:58:49.782532+0000","last_fullsized":"2024-04-22T19:58:49.782532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730623+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.730623+0000","last_peered":"2024-04-22T19:58:49.730623+0000","last_clean":"2024-04-22T19:58:49.730623+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.730623+0000","last_undegraded":"2024-04-22T19:58:49.730623+0000","last_fullsized":"2024-04-22T19:58:49.730623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872313+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872313+0000","last_peered":"2024-04-22T19:58:52.872313+0000","last_clean":"2024-04-22T19:58:52.872313+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872313+0000","last_undegraded":"2024-04-22T19:58:52.872313+0000","last_fullsized":"2024-04-22T19:58:52.872313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781853+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781853+0000","last_peered":"2024-04-22T19:58:49.781853+0000","last_clean":"2024-04-22T19:58:49.781853+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781853+0000","last_undegraded":"2024-04-22T19:58:49.781853+0000","last_fullsized":"2024-04-22T19:58:49.781853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780377+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780377+0000","last_peered":"2024-04-22T19:58:49.780377+0000","last_clean":"2024-04-22T19:58:49.780377+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780377+0000","last_undegraded":"2024-04-22T19:58:49.780377+0000","last_fullsized":"2024-04-22T19:58:49.780377+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778231+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778231+0000","last_peered":"2024-04-22T19:58:49.778231+0000","last_clean":"2024-04-22T19:58:49.778231+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778231+0000","last_undegraded":"2024-04-22T19:58:49.778231+0000","last_fullsized":"2024-04-22T19:58:49.778231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780682+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780682+0000","last_peered":"2024-04-22T19:58:49.780682+0000","last_clean":"2024-04-22T19:58:49.780682+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780682+0000","last_undegraded":"2024-04-22T19:58:49.780682+0000","last_fullsized":"2024-04-22T19:58:49.780682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779291+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779291+0000","last_peered":"2024-04-22T19:58:49.779291+0000","last_clean":"2024-04-22T19:58:49.779291+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779291+0000","last_undegraded":"2024-04-22T19:58:49.779291+0000","last_fullsized":"2024-04-22T19:58:49.779291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781090+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781090+0000","last_peered":"2024-04-22T19:58:49.781090+0000","last_clean":"2024-04-22T19:58:49.781090+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781090+0000","last_undegraded":"2024-04-22T19:58:49.781090+0000","last_fullsized":"2024-04-22T19:58:49.781090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721118+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721118+0000","last_peered":"2024-04-22T19:58:49.721118+0000","last_clean":"2024-04-22T19:58:49.721118+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721118+0000","last_undegraded":"2024-04-22T19:58:49.721118+0000","last_fullsized":"2024-04-22T19:58:49.721118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781338+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781338+0000","last_peered":"2024-04-22T19:58:49.781338+0000","last_clean":"2024-04-22T19:58:49.781338+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781338+0000","last_undegraded":"2024-04-22T19:58:49.781338+0000","last_fullsized":"2024-04-22T19:58:49.781338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719088+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719088+0000","last_peered":"2024-04-22T19:58:49.719088+0000","last_clean":"2024-04-22T19:58:49.719088+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719088+0000","last_undegraded":"2024-04-22T19:58:49.719088+0000","last_fullsized":"2024-04-22T19:58:49.719088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729385+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729385+0000","last_peered":"2024-04-22T19:58:49.729385+0000","last_clean":"2024-04-22T19:58:49.729385+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729385+0000","last_undegraded":"2024-04-22T19:58:49.729385+0000","last_fullsized":"2024-04-22T19:58:49.729385+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782159+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782159+0000","last_peered":"2024-04-22T19:58:49.782159+0000","last_clean":"2024-04-22T19:58:49.782159+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782159+0000","last_undegraded":"2024-04-22T19:58:49.782159+0000","last_fullsized":"2024-04-22T19:58:49.782159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720449+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720449+0000","last_peered":"2024-04-22T19:58:49.720449+0000","last_clean":"2024-04-22T19:58:49.720449+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720449+0000","last_undegraded":"2024-04-22T19:58:49.720449+0000","last_fullsized":"2024-04-22T19:58:49.720449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784604+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784604+0000","last_peered":"2024-04-22T19:58:49.784604+0000","last_clean":"2024-04-22T19:58:49.784604+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784604+0000","last_undegraded":"2024-04-22T19:58:49.784604+0000","last_fullsized":"2024-04-22T19:58:49.784604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729417+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729417+0000","last_peered":"2024-04-22T19:58:49.729417+0000","last_clean":"2024-04-22T19:58:49.729417+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729417+0000","last_undegraded":"2024-04-22T19:58:49.729417+0000","last_fullsized":"2024-04-22T19:58:49.729417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781330+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781330+0000","last_peered":"2024-04-22T19:58:49.781330+0000","last_clean":"2024-04-22T19:58:49.781330+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781330+0000","last_undegraded":"2024-04-22T19:58:49.781330+0000","last_fullsized":"2024-04-22T19:58:49.781330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":113,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838236+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838236+0000","last_peered":"2024-04-22T19:58:51.838236+0000","last_clean":"2024-04-22T19:58:51.838236+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838236+0000","last_undegraded":"2024-04-22T19:58:51.838236+0000","last_fullsized":"2024-04-22T19:58:51.838236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730754+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730754+0000","last_peered":"2024-04-22T19:58:49.730754+0000","last_clean":"2024-04-22T19:58:49.730754+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730754+0000","last_undegraded":"2024-04-22T19:58:49.730754+0000","last_fullsized":"2024-04-22T19:58:49.730754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729191+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729191+0000","last_peered":"2024-04-22T19:58:49.729191+0000","last_clean":"2024-04-22T19:58:49.729191+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729191+0000","last_undegraded":"2024-04-22T19:58:49.729191+0000","last_fullsized":"2024-04-22T19:58:49.729191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718683+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718683+0000","last_peered":"2024-04-22T19:58:49.718683+0000","last_clean":"2024-04-22T19:58:49.718683+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718683+0000","last_undegraded":"2024-04-22T19:58:49.718683+0000","last_fullsized":"2024-04-22T19:58:49.718683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":502,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721010+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721010+0000","last_peered":"2024-04-22T19:58:49.721010+0000","last_clean":"2024-04-22T19:58:49.721010+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721010+0000","last_undegraded":"2024-04-22T19:58:49.721010+0000","last_fullsized":"2024-04-22T19:58:49.721010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730730+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730730+0000","last_peered":"2024-04-22T19:58:49.730730+0000","last_clean":"2024-04-22T19:58:49.730730+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730730+0000","last_undegraded":"2024-04-22T19:58:49.730730+0000","last_fullsized":"2024-04-22T19:58:49.730730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727602+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727602+0000","last_peered":"2024-04-22T19:58:49.727602+0000","last_clean":"2024-04-22T19:58:49.727602+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727602+0000","last_undegraded":"2024-04-22T19:58:49.727602+0000","last_fullsized":"2024-04-22T19:58:49.727602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720312+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720312+0000","last_peered":"2024-04-22T19:58:49.720312+0000","last_clean":"2024-04-22T19:58:49.720312+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720312+0000","last_undegraded":"2024-04-22T19:58:49.720312+0000","last_fullsized":"2024-04-22T19:58:49.720312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731405+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731405+0000","last_peered":"2024-04-22T19:58:49.731405+0000","last_clean":"2024-04-22T19:58:49.731405+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731405+0000","last_undegraded":"2024-04-22T19:58:49.731405+0000","last_fullsized":"2024-04-22T19:58:49.731405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723224+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723224+0000","last_peered":"2024-04-22T19:58:49.723224+0000","last_clean":"2024-04-22T19:58:49.723224+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723224+0000","last_undegraded":"2024-04-22T19:58:49.723224+0000","last_fullsized":"2024-04-22T19:58:49.723224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783588+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783588+0000","last_peered":"2024-04-22T19:58:49.783588+0000","last_clean":"2024-04-22T19:58:49.783588+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783588+0000","last_undegraded":"2024-04-22T19:58:49.783588+0000","last_fullsized":"2024-04-22T19:58:49.783588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721496+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721496+0000","last_peered":"2024-04-22T19:58:49.721496+0000","last_clean":"2024-04-22T19:58:49.721496+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721496+0000","last_undegraded":"2024-04-22T19:58:49.721496+0000","last_fullsized":"2024-04-22T19:58:49.721496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781432+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781432+0000","last_peered":"2024-04-22T19:58:49.781432+0000","last_clean":"2024-04-22T19:58:49.781432+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781432+0000","last_undegraded":"2024-04-22T19:58:49.781432+0000","last_fullsized":"2024-04-22T19:58:49.781432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719583+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719583+0000","last_peered":"2024-04-22T19:58:49.719583+0000","last_clean":"2024-04-22T19:58:49.719583+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719583+0000","last_undegraded":"2024-04-22T19:58:49.719583+0000","last_fullsized":"2024-04-22T19:58:49.719583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724455+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724455+0000","last_peered":"2024-04-22T19:58:49.724455+0000","last_clean":"2024-04-22T19:58:49.724455+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724455+0000","last_undegraded":"2024-04-22T19:58:49.724455+0000","last_fullsized":"2024-04-22T19:58:49.724455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779811+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779811+0000","last_peered":"2024-04-22T19:58:49.779811+0000","last_clean":"2024-04-22T19:58:49.779811+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779811+0000","last_undegraded":"2024-04-22T19:58:49.779811+0000","last_fullsized":"2024-04-22T19:58:49.779811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720782+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720782+0000","last_peered":"2024-04-22T19:58:49.720782+0000","last_clean":"2024-04-22T19:58:49.720782+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720782+0000","last_undegraded":"2024-04-22T19:58:49.720782+0000","last_fullsized":"2024-04-22T19:58:49.720782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":330,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783618+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.783618+0000","last_peered":"2024-04-22T19:58:49.783618+0000","last_clean":"2024-04-22T19:58:49.783618+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.783618+0000","last_undegraded":"2024-04-22T19:58:49.783618+0000","last_fullsized":"2024-04-22T19:58:49.783618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721832+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721832+0000","last_peered":"2024-04-22T19:58:49.721832+0000","last_clean":"2024-04-22T19:58:49.721832+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721832+0000","last_undegraded":"2024-04-22T19:58:49.721832+0000","last_fullsized":"2024-04-22T19:58:49.721832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720710+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720710+0000","last_peered":"2024-04-22T19:58:49.720710+0000","last_clean":"2024-04-22T19:58:49.720710+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720710+0000","last_undegraded":"2024-04-22T19:58:49.720710+0000","last_fullsized":"2024-04-22T19:58:49.720710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":344,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839417+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839417+0000","last_peered":"2024-04-22T19:58:52.839417+0000","last_clean":"2024-04-22T19:58:52.839417+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839417+0000","last_undegraded":"2024-04-22T19:58:52.839417+0000","last_fullsized":"2024-04-22T19:58:52.839417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718286+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718286+0000","last_peered":"2024-04-22T19:58:49.718286+0000","last_clean":"2024-04-22T19:58:49.718286+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718286+0000","last_undegraded":"2024-04-22T19:58:49.718286+0000","last_fullsized":"2024-04-22T19:58:49.718286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721932+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.721932+0000","last_peered":"2024-04-22T19:58:49.721932+0000","last_clean":"2024-04-22T19:58:49.721932+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.721932+0000","last_undegraded":"2024-04-22T19:58:49.721932+0000","last_fullsized":"2024-04-22T19:58:49.721932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721550+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721550+0000","last_peered":"2024-04-22T19:58:49.721550+0000","last_clean":"2024-04-22T19:58:49.721550+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721550+0000","last_undegraded":"2024-04-22T19:58:49.721550+0000","last_fullsized":"2024-04-22T19:58:49.721550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732345+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732345+0000","last_peered":"2024-04-22T19:58:49.732345+0000","last_clean":"2024-04-22T19:58:49.732345+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732345+0000","last_undegraded":"2024-04-22T19:58:49.732345+0000","last_fullsized":"2024-04-22T19:58:49.732345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778555+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778555+0000","last_peered":"2024-04-22T19:58:49.778555+0000","last_clean":"2024-04-22T19:58:49.778555+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778555+0000","last_undegraded":"2024-04-22T19:58:49.778555+0000","last_fullsized":"2024-04-22T19:58:49.778555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720604+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720604+0000","last_peered":"2024-04-22T19:58:49.720604+0000","last_clean":"2024-04-22T19:58:49.720604+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720604+0000","last_undegraded":"2024-04-22T19:58:49.720604+0000","last_fullsized":"2024-04-22T19:58:49.720604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779173+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779173+0000","last_peered":"2024-04-22T19:58:49.779173+0000","last_clean":"2024-04-22T19:58:49.779173+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779173+0000","last_undegraded":"2024-04-22T19:58:49.779173+0000","last_fullsized":"2024-04-22T19:58:49.779173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787784+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787784+0000","last_peered":"2024-04-22T19:58:49.787784+0000","last_clean":"2024-04-22T19:58:49.787784+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787784+0000","last_undegraded":"2024-04-22T19:58:49.787784+0000","last_fullsized":"2024-04-22T19:58:49.787784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778426+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778426+0000","last_peered":"2024-04-22T19:58:49.778426+0000","last_clean":"2024-04-22T19:58:49.778426+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778426+0000","last_undegraded":"2024-04-22T19:58:49.778426+0000","last_fullsized":"2024-04-22T19:58:49.778426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":93,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786304+0000","last_change":"2024-04-22T19:57:52.779062+0000","last_active":"2024-04-22T19:58:49.786304+0000","last_peered":"2024-04-22T19:58:49.786304+0000","last_clean":"2024-04-22T19:58:49.786304+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:49.786304+0000","last_undegraded":"2024-04-22T19:58:49.786304+0000","last_fullsized":"2024-04-22T19:58:49.786304+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723749+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723749+0000","last_peered":"2024-04-22T19:58:49.723749+0000","last_clean":"2024-04-22T19:58:49.723749+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723749+0000","last_undegraded":"2024-04-22T19:58:49.723749+0000","last_fullsized":"2024-04-22T19:58:49.723749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718541+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718541+0000","last_peered":"2024-04-22T19:58:49.718541+0000","last_clean":"2024-04-22T19:58:49.718541+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718541+0000","last_undegraded":"2024-04-22T19:58:49.718541+0000","last_fullsized":"2024-04-22T19:58:49.718541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121450+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121450+0000","last_peered":"2024-04-22T19:58:53.121450+0000","last_clean":"2024-04-22T19:58:53.121450+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121450+0000","last_undegraded":"2024-04-22T19:58:53.121450+0000","last_fullsized":"2024-04-22T19:58:53.121450+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"128'144","reported_seq":473,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785391+0000","last_change":"2024-04-22T19:57:53.333959+0000","last_active":"2024-04-22T19:58:49.785391+0000","last_peered":"2024-04-22T19:58:49.785391+0000","last_clean":"2024-04-22T19:58:49.785391+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:49.785391+0000","last_undegraded":"2024-04-22T19:58:49.785391+0000","last_fullsized":"2024-04-22T19:58:49.785391+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:16.335622+0000","last_clean_scrub_stamp":"2024-04-22T19:54:16.335622+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718933+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.718933+0000","last_peered":"2024-04-22T19:58:49.718933+0000","last_clean":"2024-04-22T19:58:49.718933+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.718933+0000","last_undegraded":"2024-04-22T19:58:49.718933+0000","last_fullsized":"2024-04-22T19:58:49.718933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786532+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786532+0000","last_peered":"2024-04-22T19:58:49.786532+0000","last_clean":"2024-04-22T19:58:49.786532+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786532+0000","last_undegraded":"2024-04-22T19:58:49.786532+0000","last_fullsized":"2024-04-22T19:58:49.786532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778078+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778078+0000","last_peered":"2024-04-22T19:58:49.778078+0000","last_clean":"2024-04-22T19:58:49.778078+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778078+0000","last_undegraded":"2024-04-22T19:58:49.778078+0000","last_fullsized":"2024-04-22T19:58:49.778078+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729934+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.729934+0000","last_peered":"2024-04-22T19:58:49.729934+0000","last_clean":"2024-04-22T19:58:49.729934+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.729934+0000","last_undegraded":"2024-04-22T19:58:49.729934+0000","last_fullsized":"2024-04-22T19:58:49.729934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779494+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779494+0000","last_peered":"2024-04-22T19:58:49.779494+0000","last_clean":"2024-04-22T19:58:49.779494+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779494+0000","last_undegraded":"2024-04-22T19:58:49.779494+0000","last_fullsized":"2024-04-22T19:58:49.779494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724558+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724558+0000","last_peered":"2024-04-22T19:58:49.724558+0000","last_clean":"2024-04-22T19:58:49.724558+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724558+0000","last_undegraded":"2024-04-22T19:58:49.724558+0000","last_fullsized":"2024-04-22T19:58:49.724558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778645+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778645+0000","last_peered":"2024-04-22T19:58:49.778645+0000","last_clean":"2024-04-22T19:58:49.778645+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778645+0000","last_undegraded":"2024-04-22T19:58:49.778645+0000","last_fullsized":"2024-04-22T19:58:49.778645+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778759+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.778759+0000","last_peered":"2024-04-22T19:58:49.778759+0000","last_clean":"2024-04-22T19:58:49.778759+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.778759+0000","last_undegraded":"2024-04-22T19:58:49.778759+0000","last_fullsized":"2024-04-22T19:58:49.778759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":60,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779404+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779404+0000","last_peered":"2024-04-22T19:58:49.779404+0000","last_clean":"2024-04-22T19:58:49.779404+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779404+0000","last_undegraded":"2024-04-22T19:58:49.779404+0000","last_fullsized":"2024-04-22T19:58:49.779404+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":377,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386725+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386725+0000","last_peered":"2024-04-22T19:58:50.386725+0000","last_clean":"2024-04-22T19:58:50.386725+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386725+0000","last_undegraded":"2024-04-22T19:58:50.386725+0000","last_fullsized":"2024-04-22T19:58:50.386725+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821923+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821923+0000","last_peered":"2024-04-22T19:58:49.821923+0000","last_clean":"2024-04-22T19:58:49.821923+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821923+0000","last_undegraded":"2024-04-22T19:58:49.821923+0000","last_fullsized":"2024-04-22T19:58:49.821923+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729204+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729204+0000","last_peered":"2024-04-22T19:58:49.729204+0000","last_clean":"2024-04-22T19:58:49.729204+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729204+0000","last_undegraded":"2024-04-22T19:58:49.729204+0000","last_fullsized":"2024-04-22T19:58:49.729204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724142+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724142+0000","last_peered":"2024-04-22T19:58:49.724142+0000","last_clean":"2024-04-22T19:58:49.724142+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724142+0000","last_undegraded":"2024-04-22T19:58:49.724142+0000","last_fullsized":"2024-04-22T19:58:49.724142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":63,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779928+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.779928+0000","last_peered":"2024-04-22T19:58:49.779928+0000","last_clean":"2024-04-22T19:58:49.779928+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.779928+0000","last_undegraded":"2024-04-22T19:58:49.779928+0000","last_fullsized":"2024-04-22T19:58:49.779928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783688+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.783688+0000","last_peered":"2024-04-22T19:58:49.783688+0000","last_clean":"2024-04-22T19:58:49.783688+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.783688+0000","last_undegraded":"2024-04-22T19:58:49.783688+0000","last_fullsized":"2024-04-22T19:58:49.783688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780038+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780038+0000","last_peered":"2024-04-22T19:58:49.780038+0000","last_clean":"2024-04-22T19:58:49.780038+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780038+0000","last_undegraded":"2024-04-22T19:58:49.780038+0000","last_fullsized":"2024-04-22T19:58:49.780038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778394+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778394+0000","last_peered":"2024-04-22T19:58:49.778394+0000","last_clean":"2024-04-22T19:58:49.778394+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778394+0000","last_undegraded":"2024-04-22T19:58:49.778394+0000","last_fullsized":"2024-04-22T19:58:49.778394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781660+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781660+0000","last_peered":"2024-04-22T19:58:49.781660+0000","last_clean":"2024-04-22T19:58:49.781660+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781660+0000","last_undegraded":"2024-04-22T19:58:49.781660+0000","last_fullsized":"2024-04-22T19:58:49.781660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871288+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871288+0000","last_peered":"2024-04-22T19:58:50.871288+0000","last_clean":"2024-04-22T19:58:50.871288+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871288+0000","last_undegraded":"2024-04-22T19:58:50.871288+0000","last_fullsized":"2024-04-22T19:58:50.871288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725315+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725315+0000","last_peered":"2024-04-22T19:58:49.725315+0000","last_clean":"2024-04-22T19:58:49.725315+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725315+0000","last_undegraded":"2024-04-22T19:58:49.725315+0000","last_fullsized":"2024-04-22T19:58:49.725315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719677+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719677+0000","last_peered":"2024-04-22T19:58:49.719677+0000","last_clean":"2024-04-22T19:58:49.719677+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719677+0000","last_undegraded":"2024-04-22T19:58:49.719677+0000","last_fullsized":"2024-04-22T19:58:49.719677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786110+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786110+0000","last_peered":"2024-04-22T19:58:49.786110+0000","last_clean":"2024-04-22T19:58:49.786110+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786110+0000","last_undegraded":"2024-04-22T19:58:49.786110+0000","last_fullsized":"2024-04-22T19:58:49.786110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778754+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778754+0000","last_peered":"2024-04-22T19:58:49.778754+0000","last_clean":"2024-04-22T19:58:49.778754+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778754+0000","last_undegraded":"2024-04-22T19:58:49.778754+0000","last_fullsized":"2024-04-22T19:58:49.778754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725097+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725097+0000","last_peered":"2024-04-22T19:58:49.725097+0000","last_clean":"2024-04-22T19:58:49.725097+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725097+0000","last_undegraded":"2024-04-22T19:58:49.725097+0000","last_fullsized":"2024-04-22T19:58:49.725097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721625+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721625+0000","last_peered":"2024-04-22T19:58:49.721625+0000","last_clean":"2024-04-22T19:58:49.721625+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721625+0000","last_undegraded":"2024-04-22T19:58:49.721625+0000","last_fullsized":"2024-04-22T19:58:49.721625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779087+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779087+0000","last_peered":"2024-04-22T19:58:49.779087+0000","last_clean":"2024-04-22T19:58:49.779087+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779087+0000","last_undegraded":"2024-04-22T19:58:49.779087+0000","last_fullsized":"2024-04-22T19:58:49.779087+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781288+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781288+0000","last_peered":"2024-04-22T19:58:49.781288+0000","last_clean":"2024-04-22T19:58:49.781288+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781288+0000","last_undegraded":"2024-04-22T19:58:49.781288+0000","last_fullsized":"2024-04-22T19:58:49.781288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725322+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725322+0000","last_peered":"2024-04-22T19:58:49.725322+0000","last_clean":"2024-04-22T19:58:49.725322+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725322+0000","last_undegraded":"2024-04-22T19:58:49.725322+0000","last_fullsized":"2024-04-22T19:58:49.725322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":340,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723764+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723764+0000","last_peered":"2024-04-22T19:58:49.723764+0000","last_clean":"2024-04-22T19:58:49.723764+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723764+0000","last_undegraded":"2024-04-22T19:58:49.723764+0000","last_fullsized":"2024-04-22T19:58:49.723764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785674+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785674+0000","last_peered":"2024-04-22T19:58:49.785674+0000","last_clean":"2024-04-22T19:58:49.785674+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785674+0000","last_undegraded":"2024-04-22T19:58:49.785674+0000","last_fullsized":"2024-04-22T19:58:49.785674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730256+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730256+0000","last_peered":"2024-04-22T19:58:49.730256+0000","last_clean":"2024-04-22T19:58:49.730256+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730256+0000","last_undegraded":"2024-04-22T19:58:49.730256+0000","last_fullsized":"2024-04-22T19:58:49.730256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722220+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722220+0000","last_peered":"2024-04-22T19:58:49.722220+0000","last_clean":"2024-04-22T19:58:49.722220+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722220+0000","last_undegraded":"2024-04-22T19:58:49.722220+0000","last_fullsized":"2024-04-22T19:58:49.722220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778036+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778036+0000","last_peered":"2024-04-22T19:58:49.778036+0000","last_clean":"2024-04-22T19:58:49.778036+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778036+0000","last_undegraded":"2024-04-22T19:58:49.778036+0000","last_fullsized":"2024-04-22T19:58:49.778036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779798+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779798+0000","last_peered":"2024-04-22T19:58:49.779798+0000","last_clean":"2024-04-22T19:58:49.779798+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779798+0000","last_undegraded":"2024-04-22T19:58:49.779798+0000","last_fullsized":"2024-04-22T19:58:49.779798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720585+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720585+0000","last_peered":"2024-04-22T19:58:49.720585+0000","last_clean":"2024-04-22T19:58:49.720585+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720585+0000","last_undegraded":"2024-04-22T19:58:49.720585+0000","last_fullsized":"2024-04-22T19:58:49.720585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721475+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721475+0000","last_peered":"2024-04-22T19:58:49.721475+0000","last_clean":"2024-04-22T19:58:49.721475+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721475+0000","last_undegraded":"2024-04-22T19:58:49.721475+0000","last_fullsized":"2024-04-22T19:58:49.721475+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"128'23","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787393+0000","last_change":"2024-04-22T19:57:52.799198+0000","last_active":"2024-04-22T19:58:49.787393+0000","last_peered":"2024-04-22T19:58:49.787393+0000","last_clean":"2024-04-22T19:58:49.787393+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:49.787393+0000","last_undegraded":"2024-04-22T19:58:49.787393+0000","last_fullsized":"2024-04-22T19:58:49.787393+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:14.329723+0000","last_clean_scrub_stamp":"2024-04-22T19:54:14.329723+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722388+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722388+0000","last_peered":"2024-04-22T19:58:49.722388+0000","last_clean":"2024-04-22T19:58:49.722388+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722388+0000","last_undegraded":"2024-04-22T19:58:49.722388+0000","last_fullsized":"2024-04-22T19:58:49.722388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778907+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.778907+0000","last_peered":"2024-04-22T19:58:49.778907+0000","last_clean":"2024-04-22T19:58:49.778907+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.778907+0000","last_undegraded":"2024-04-22T19:58:49.778907+0000","last_fullsized":"2024-04-22T19:58:49.778907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729043+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729043+0000","last_peered":"2024-04-22T19:58:49.729043+0000","last_clean":"2024-04-22T19:58:49.729043+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729043+0000","last_undegraded":"2024-04-22T19:58:49.729043+0000","last_fullsized":"2024-04-22T19:58:49.729043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719923+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.719923+0000","last_peered":"2024-04-22T19:58:49.719923+0000","last_clean":"2024-04-22T19:58:49.719923+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.719923+0000","last_undegraded":"2024-04-22T19:58:49.719923+0000","last_fullsized":"2024-04-22T19:58:49.719923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722469+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722469+0000","last_peered":"2024-04-22T19:58:49.722469+0000","last_clean":"2024-04-22T19:58:49.722469+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722469+0000","last_undegraded":"2024-04-22T19:58:49.722469+0000","last_fullsized":"2024-04-22T19:58:49.722469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719954+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.719954+0000","last_peered":"2024-04-22T19:58:49.719954+0000","last_clean":"2024-04-22T19:58:49.719954+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.719954+0000","last_undegraded":"2024-04-22T19:58:49.719954+0000","last_fullsized":"2024-04-22T19:58:49.719954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":434,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784959+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.784959+0000","last_peered":"2024-04-22T19:58:49.784959+0000","last_clean":"2024-04-22T19:58:49.784959+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.784959+0000","last_undegraded":"2024-04-22T19:58:49.784959+0000","last_fullsized":"2024-04-22T19:58:49.784959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728383+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728383+0000","last_peered":"2024-04-22T19:58:49.728383+0000","last_clean":"2024-04-22T19:58:49.728383+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728383+0000","last_undegraded":"2024-04-22T19:58:49.728383+0000","last_fullsized":"2024-04-22T19:58:49.728383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097874+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097874+0000","last_peered":"2024-04-22T19:58:50.097874+0000","last_clean":"2024-04-22T19:58:50.097874+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097874+0000","last_undegraded":"2024-04-22T19:58:50.097874+0000","last_fullsized":"2024-04-22T19:58:50.097874+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782146+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782146+0000","last_peered":"2024-04-22T19:58:49.782146+0000","last_clean":"2024-04-22T19:58:49.782146+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782146+0000","last_undegraded":"2024-04-22T19:58:49.782146+0000","last_fullsized":"2024-04-22T19:58:49.782146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729526+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729526+0000","last_peered":"2024-04-22T19:58:49.729526+0000","last_clean":"2024-04-22T19:58:49.729526+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729526+0000","last_undegraded":"2024-04-22T19:58:49.729526+0000","last_fullsized":"2024-04-22T19:58:49.729526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779201+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779201+0000","last_peered":"2024-04-22T19:58:49.779201+0000","last_clean":"2024-04-22T19:58:49.779201+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779201+0000","last_undegraded":"2024-04-22T19:58:49.779201+0000","last_fullsized":"2024-04-22T19:58:49.779201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717668+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717668+0000","last_peered":"2024-04-22T19:58:49.717668+0000","last_clean":"2024-04-22T19:58:49.717668+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717668+0000","last_undegraded":"2024-04-22T19:58:49.717668+0000","last_fullsized":"2024-04-22T19:58:49.717668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731803+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731803+0000","last_peered":"2024-04-22T19:58:49.731803+0000","last_clean":"2024-04-22T19:58:49.731803+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731803+0000","last_undegraded":"2024-04-22T19:58:49.731803+0000","last_fullsized":"2024-04-22T19:58:49.731803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131149+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131149+0000","last_peered":"2024-04-22T19:58:51.131149+0000","last_clean":"2024-04-22T19:58:51.131149+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131149+0000","last_undegraded":"2024-04-22T19:58:51.131149+0000","last_fullsized":"2024-04-22T19:58:51.131149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783327+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783327+0000","last_peered":"2024-04-22T19:58:49.783327+0000","last_clean":"2024-04-22T19:58:49.783327+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783327+0000","last_undegraded":"2024-04-22T19:58:49.783327+0000","last_fullsized":"2024-04-22T19:58:49.783327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780916+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.780916+0000","last_peered":"2024-04-22T19:58:49.780916+0000","last_clean":"2024-04-22T19:58:49.780916+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.780916+0000","last_undegraded":"2024-04-22T19:58:49.780916+0000","last_fullsized":"2024-04-22T19:58:49.780916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717659+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717659+0000","last_peered":"2024-04-22T19:58:49.717659+0000","last_clean":"2024-04-22T19:58:49.717659+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717659+0000","last_undegraded":"2024-04-22T19:58:49.717659+0000","last_fullsized":"2024-04-22T19:58:49.717659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777754+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.777754+0000","last_peered":"2024-04-22T19:58:49.777754+0000","last_clean":"2024-04-22T19:58:49.777754+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.777754+0000","last_undegraded":"2024-04-22T19:58:49.777754+0000","last_fullsized":"2024-04-22T19:58:49.777754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":67,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778294+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778294+0000","last_peered":"2024-04-22T19:58:49.778294+0000","last_clean":"2024-04-22T19:58:49.778294+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778294+0000","last_undegraded":"2024-04-22T19:58:49.778294+0000","last_fullsized":"2024-04-22T19:58:49.778294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786068+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786068+0000","last_peered":"2024-04-22T19:58:49.786068+0000","last_clean":"2024-04-22T19:58:49.786068+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786068+0000","last_undegraded":"2024-04-22T19:58:49.786068+0000","last_fullsized":"2024-04-22T19:58:49.786068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718092+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718092+0000","last_peered":"2024-04-22T19:58:49.718092+0000","last_clean":"2024-04-22T19:58:49.718092+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718092+0000","last_undegraded":"2024-04-22T19:58:49.718092+0000","last_fullsized":"2024-04-22T19:58:49.718092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":65,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783412+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783412+0000","last_peered":"2024-04-22T19:58:49.783412+0000","last_clean":"2024-04-22T19:58:49.783412+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783412+0000","last_undegraded":"2024-04-22T19:58:49.783412+0000","last_fullsized":"2024-04-22T19:58:49.783412+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718466+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718466+0000","last_peered":"2024-04-22T19:58:49.718466+0000","last_clean":"2024-04-22T19:58:49.718466+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718466+0000","last_undegraded":"2024-04-22T19:58:49.718466+0000","last_fullsized":"2024-04-22T19:58:49.718466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731006+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731006+0000","last_peered":"2024-04-22T19:58:49.731006+0000","last_clean":"2024-04-22T19:58:49.731006+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731006+0000","last_undegraded":"2024-04-22T19:58:49.731006+0000","last_fullsized":"2024-04-22T19:58:49.731006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718549+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718549+0000","last_peered":"2024-04-22T19:58:49.718549+0000","last_clean":"2024-04-22T19:58:49.718549+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718549+0000","last_undegraded":"2024-04-22T19:58:49.718549+0000","last_fullsized":"2024-04-22T19:58:49.718549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725567+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725567+0000","last_peered":"2024-04-22T19:58:49.725567+0000","last_clean":"2024-04-22T19:58:49.725567+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725567+0000","last_undegraded":"2024-04-22T19:58:49.725567+0000","last_fullsized":"2024-04-22T19:58:49.725567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720607+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720607+0000","last_peered":"2024-04-22T19:58:49.720607+0000","last_clean":"2024-04-22T19:58:49.720607+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720607+0000","last_undegraded":"2024-04-22T19:58:49.720607+0000","last_fullsized":"2024-04-22T19:58:49.720607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720406+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720406+0000","last_peered":"2024-04-22T19:58:49.720406+0000","last_clean":"2024-04-22T19:58:49.720406+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720406+0000","last_undegraded":"2024-04-22T19:58:49.720406+0000","last_fullsized":"2024-04-22T19:58:49.720406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719353+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719353+0000","last_peered":"2024-04-22T19:58:49.719353+0000","last_clean":"2024-04-22T19:58:49.719353+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719353+0000","last_undegraded":"2024-04-22T19:58:49.719353+0000","last_fullsized":"2024-04-22T19:58:49.719353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721599+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721599+0000","last_peered":"2024-04-22T19:58:49.721599+0000","last_clean":"2024-04-22T19:58:49.721599+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721599+0000","last_undegraded":"2024-04-22T19:58:49.721599+0000","last_fullsized":"2024-04-22T19:58:49.721599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777636+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777636+0000","last_peered":"2024-04-22T19:58:49.777636+0000","last_clean":"2024-04-22T19:58:49.777636+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777636+0000","last_undegraded":"2024-04-22T19:58:49.777636+0000","last_fullsized":"2024-04-22T19:58:49.777636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727174+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727174+0000","last_peered":"2024-04-22T19:58:49.727174+0000","last_clean":"2024-04-22T19:58:49.727174+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727174+0000","last_undegraded":"2024-04-22T19:58:49.727174+0000","last_fullsized":"2024-04-22T19:58:49.727174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":355,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617798+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617798+0000","last_peered":"2024-04-22T19:58:50.617798+0000","last_clean":"2024-04-22T19:58:50.617798+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617798+0000","last_undegraded":"2024-04-22T19:58:50.617798+0000","last_fullsized":"2024-04-22T19:58:50.617798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":321,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869764+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869764+0000","last_peered":"2024-04-22T19:58:51.869764+0000","last_clean":"2024-04-22T19:58:51.869764+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869764+0000","last_undegraded":"2024-04-22T19:58:51.869764+0000","last_fullsized":"2024-04-22T19:58:51.869764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780689+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780689+0000","last_peered":"2024-04-22T19:58:49.780689+0000","last_clean":"2024-04-22T19:58:49.780689+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780689+0000","last_undegraded":"2024-04-22T19:58:49.780689+0000","last_fullsized":"2024-04-22T19:58:49.780689+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720534+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720534+0000","last_peered":"2024-04-22T19:58:49.720534+0000","last_clean":"2024-04-22T19:58:49.720534+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720534+0000","last_undegraded":"2024-04-22T19:58:49.720534+0000","last_fullsized":"2024-04-22T19:58:49.720534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779059+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779059+0000","last_peered":"2024-04-22T19:58:49.779059+0000","last_clean":"2024-04-22T19:58:49.779059+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779059+0000","last_undegraded":"2024-04-22T19:58:49.779059+0000","last_fullsized":"2024-04-22T19:58:49.779059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777547+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777547+0000","last_peered":"2024-04-22T19:58:49.777547+0000","last_clean":"2024-04-22T19:58:49.777547+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777547+0000","last_undegraded":"2024-04-22T19:58:49.777547+0000","last_fullsized":"2024-04-22T19:58:49.777547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830214+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830214+0000","last_peered":"2024-04-22T19:58:53.830214+0000","last_clean":"2024-04-22T19:58:53.830214+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830214+0000","last_undegraded":"2024-04-22T19:58:53.830214+0000","last_fullsized":"2024-04-22T19:58:53.830214+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782025+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782025+0000","last_peered":"2024-04-22T19:58:49.782025+0000","last_clean":"2024-04-22T19:58:49.782025+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782025+0000","last_undegraded":"2024-04-22T19:58:49.782025+0000","last_fullsized":"2024-04-22T19:58:49.782025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779347+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779347+0000","last_peered":"2024-04-22T19:58:49.779347+0000","last_clean":"2024-04-22T19:58:49.779347+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779347+0000","last_undegraded":"2024-04-22T19:58:49.779347+0000","last_fullsized":"2024-04-22T19:58:49.779347+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729079+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729079+0000","last_peered":"2024-04-22T19:58:49.729079+0000","last_clean":"2024-04-22T19:58:49.729079+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729079+0000","last_undegraded":"2024-04-22T19:58:49.729079+0000","last_fullsized":"2024-04-22T19:58:49.729079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886544+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886544+0000","last_peered":"2024-04-22T19:58:54.886544+0000","last_clean":"2024-04-22T19:58:54.886544+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886544+0000","last_undegraded":"2024-04-22T19:58:54.886544+0000","last_fullsized":"2024-04-22T19:58:54.886544+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1117,"ondisk_log_size":1117,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:58:59.590 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:59.590 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-22T19:54:16.335622+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=16, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:59.591 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-22T19:54:14.329723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=14, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:59.592 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:58:59.592 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T19:59:19.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:59:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:59:19.952 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:59:19.963 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-22T19:59:19.463413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006842"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731541+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731541+0000","last_peered":"2024-04-22T19:58:49.731541+0000","last_clean":"2024-04-22T19:58:49.731541+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731541+0000","last_undegraded":"2024-04-22T19:58:49.731541+0000","last_fullsized":"2024-04-22T19:58:49.731541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723496+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723496+0000","last_peered":"2024-04-22T19:58:49.723496+0000","last_clean":"2024-04-22T19:58:49.723496+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723496+0000","last_undegraded":"2024-04-22T19:58:49.723496+0000","last_fullsized":"2024-04-22T19:58:49.723496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724878+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.724878+0000","last_peered":"2024-04-22T19:58:49.724878+0000","last_clean":"2024-04-22T19:58:49.724878+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.724878+0000","last_undegraded":"2024-04-22T19:58:49.724878+0000","last_fullsized":"2024-04-22T19:58:49.724878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":346,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601548+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601548+0000","last_peered":"2024-04-22T19:58:52.601548+0000","last_clean":"2024-04-22T19:58:52.601548+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601548+0000","last_undegraded":"2024-04-22T19:58:52.601548+0000","last_fullsized":"2024-04-22T19:58:52.601548+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780835+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780835+0000","last_peered":"2024-04-22T19:58:49.780835+0000","last_clean":"2024-04-22T19:58:49.780835+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780835+0000","last_undegraded":"2024-04-22T19:58:49.780835+0000","last_fullsized":"2024-04-22T19:58:49.780835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719945+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.719945+0000","last_peered":"2024-04-22T19:58:49.719945+0000","last_clean":"2024-04-22T19:58:49.719945+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.719945+0000","last_undegraded":"2024-04-22T19:58:49.719945+0000","last_fullsized":"2024-04-22T19:58:49.719945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783599+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783599+0000","last_peered":"2024-04-22T19:58:49.783599+0000","last_clean":"2024-04-22T19:58:49.783599+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783599+0000","last_undegraded":"2024-04-22T19:58:49.783599+0000","last_fullsized":"2024-04-22T19:58:49.783599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729758+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729758+0000","last_peered":"2024-04-22T19:58:49.729758+0000","last_clean":"2024-04-22T19:58:49.729758+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729758+0000","last_undegraded":"2024-04-22T19:58:49.729758+0000","last_fullsized":"2024-04-22T19:58:49.729758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781037+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781037+0000","last_peered":"2024-04-22T19:58:49.781037+0000","last_clean":"2024-04-22T19:58:49.781037+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781037+0000","last_undegraded":"2024-04-22T19:58:49.781037+0000","last_fullsized":"2024-04-22T19:58:49.781037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780534+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780534+0000","last_peered":"2024-04-22T19:58:49.780534+0000","last_clean":"2024-04-22T19:58:49.780534+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780534+0000","last_undegraded":"2024-04-22T19:58:49.780534+0000","last_fullsized":"2024-04-22T19:58:49.780534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780804+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780804+0000","last_peered":"2024-04-22T19:58:49.780804+0000","last_clean":"2024-04-22T19:58:49.780804+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780804+0000","last_undegraded":"2024-04-22T19:58:49.780804+0000","last_fullsized":"2024-04-22T19:58:49.780804+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719152+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719152+0000","last_peered":"2024-04-22T19:58:49.719152+0000","last_clean":"2024-04-22T19:58:49.719152+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719152+0000","last_undegraded":"2024-04-22T19:58:49.719152+0000","last_fullsized":"2024-04-22T19:58:49.719152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787663+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787663+0000","last_peered":"2024-04-22T19:58:49.787663+0000","last_clean":"2024-04-22T19:58:49.787663+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787663+0000","last_undegraded":"2024-04-22T19:58:49.787663+0000","last_fullsized":"2024-04-22T19:58:49.787663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718805+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718805+0000","last_peered":"2024-04-22T19:58:49.718805+0000","last_clean":"2024-04-22T19:58:49.718805+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718805+0000","last_undegraded":"2024-04-22T19:58:49.718805+0000","last_fullsized":"2024-04-22T19:58:49.718805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823685+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823685+0000","last_peered":"2024-04-22T19:58:54.823685+0000","last_clean":"2024-04-22T19:58:54.823685+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823685+0000","last_undegraded":"2024-04-22T19:58:54.823685+0000","last_fullsized":"2024-04-22T19:58:54.823685+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872313+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872313+0000","last_peered":"2024-04-22T19:58:52.872313+0000","last_clean":"2024-04-22T19:58:52.872313+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872313+0000","last_undegraded":"2024-04-22T19:58:52.872313+0000","last_fullsized":"2024-04-22T19:58:52.872313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781853+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781853+0000","last_peered":"2024-04-22T19:58:49.781853+0000","last_clean":"2024-04-22T19:58:49.781853+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781853+0000","last_undegraded":"2024-04-22T19:58:49.781853+0000","last_fullsized":"2024-04-22T19:58:49.781853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780377+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780377+0000","last_peered":"2024-04-22T19:58:49.780377+0000","last_clean":"2024-04-22T19:58:49.780377+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780377+0000","last_undegraded":"2024-04-22T19:58:49.780377+0000","last_fullsized":"2024-04-22T19:58:49.780377+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778231+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778231+0000","last_peered":"2024-04-22T19:58:49.778231+0000","last_clean":"2024-04-22T19:58:49.778231+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778231+0000","last_undegraded":"2024-04-22T19:58:49.778231+0000","last_fullsized":"2024-04-22T19:58:49.778231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780682+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780682+0000","last_peered":"2024-04-22T19:58:49.780682+0000","last_clean":"2024-04-22T19:58:49.780682+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780682+0000","last_undegraded":"2024-04-22T19:58:49.780682+0000","last_fullsized":"2024-04-22T19:58:49.780682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779291+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779291+0000","last_peered":"2024-04-22T19:58:49.779291+0000","last_clean":"2024-04-22T19:58:49.779291+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779291+0000","last_undegraded":"2024-04-22T19:58:49.779291+0000","last_fullsized":"2024-04-22T19:58:49.779291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781090+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781090+0000","last_peered":"2024-04-22T19:58:49.781090+0000","last_clean":"2024-04-22T19:58:49.781090+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781090+0000","last_undegraded":"2024-04-22T19:58:49.781090+0000","last_fullsized":"2024-04-22T19:58:49.781090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721118+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721118+0000","last_peered":"2024-04-22T19:58:49.721118+0000","last_clean":"2024-04-22T19:58:49.721118+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721118+0000","last_undegraded":"2024-04-22T19:58:49.721118+0000","last_fullsized":"2024-04-22T19:58:49.721118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781338+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781338+0000","last_peered":"2024-04-22T19:58:49.781338+0000","last_clean":"2024-04-22T19:58:49.781338+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781338+0000","last_undegraded":"2024-04-22T19:58:49.781338+0000","last_fullsized":"2024-04-22T19:58:49.781338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719088+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719088+0000","last_peered":"2024-04-22T19:58:49.719088+0000","last_clean":"2024-04-22T19:58:49.719088+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719088+0000","last_undegraded":"2024-04-22T19:58:49.719088+0000","last_fullsized":"2024-04-22T19:58:49.719088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729385+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729385+0000","last_peered":"2024-04-22T19:58:49.729385+0000","last_clean":"2024-04-22T19:58:49.729385+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729385+0000","last_undegraded":"2024-04-22T19:58:49.729385+0000","last_fullsized":"2024-04-22T19:58:49.729385+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782159+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782159+0000","last_peered":"2024-04-22T19:58:49.782159+0000","last_clean":"2024-04-22T19:58:49.782159+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782159+0000","last_undegraded":"2024-04-22T19:58:49.782159+0000","last_fullsized":"2024-04-22T19:58:49.782159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720449+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720449+0000","last_peered":"2024-04-22T19:58:49.720449+0000","last_clean":"2024-04-22T19:58:49.720449+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720449+0000","last_undegraded":"2024-04-22T19:58:49.720449+0000","last_fullsized":"2024-04-22T19:58:49.720449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784604+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784604+0000","last_peered":"2024-04-22T19:58:49.784604+0000","last_clean":"2024-04-22T19:58:49.784604+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784604+0000","last_undegraded":"2024-04-22T19:58:49.784604+0000","last_fullsized":"2024-04-22T19:58:49.784604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729417+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729417+0000","last_peered":"2024-04-22T19:58:49.729417+0000","last_clean":"2024-04-22T19:58:49.729417+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729417+0000","last_undegraded":"2024-04-22T19:58:49.729417+0000","last_fullsized":"2024-04-22T19:58:49.729417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781330+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781330+0000","last_peered":"2024-04-22T19:58:49.781330+0000","last_clean":"2024-04-22T19:58:49.781330+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781330+0000","last_undegraded":"2024-04-22T19:58:49.781330+0000","last_fullsized":"2024-04-22T19:58:49.781330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":113,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838236+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838236+0000","last_peered":"2024-04-22T19:58:51.838236+0000","last_clean":"2024-04-22T19:58:51.838236+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838236+0000","last_undegraded":"2024-04-22T19:58:51.838236+0000","last_fullsized":"2024-04-22T19:58:51.838236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730754+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730754+0000","last_peered":"2024-04-22T19:58:49.730754+0000","last_clean":"2024-04-22T19:58:49.730754+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730754+0000","last_undegraded":"2024-04-22T19:58:49.730754+0000","last_fullsized":"2024-04-22T19:58:49.730754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729191+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729191+0000","last_peered":"2024-04-22T19:58:49.729191+0000","last_clean":"2024-04-22T19:58:49.729191+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729191+0000","last_undegraded":"2024-04-22T19:58:49.729191+0000","last_fullsized":"2024-04-22T19:58:49.729191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718683+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718683+0000","last_peered":"2024-04-22T19:58:49.718683+0000","last_clean":"2024-04-22T19:58:49.718683+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718683+0000","last_undegraded":"2024-04-22T19:58:49.718683+0000","last_fullsized":"2024-04-22T19:58:49.718683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":502,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721010+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721010+0000","last_peered":"2024-04-22T19:58:49.721010+0000","last_clean":"2024-04-22T19:58:49.721010+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721010+0000","last_undegraded":"2024-04-22T19:58:49.721010+0000","last_fullsized":"2024-04-22T19:58:49.721010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730730+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730730+0000","last_peered":"2024-04-22T19:58:49.730730+0000","last_clean":"2024-04-22T19:58:49.730730+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730730+0000","last_undegraded":"2024-04-22T19:58:49.730730+0000","last_fullsized":"2024-04-22T19:58:49.730730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727602+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727602+0000","last_peered":"2024-04-22T19:58:49.727602+0000","last_clean":"2024-04-22T19:58:49.727602+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727602+0000","last_undegraded":"2024-04-22T19:58:49.727602+0000","last_fullsized":"2024-04-22T19:58:49.727602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720312+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720312+0000","last_peered":"2024-04-22T19:58:49.720312+0000","last_clean":"2024-04-22T19:58:49.720312+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720312+0000","last_undegraded":"2024-04-22T19:58:49.720312+0000","last_fullsized":"2024-04-22T19:58:49.720312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731405+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731405+0000","last_peered":"2024-04-22T19:58:49.731405+0000","last_clean":"2024-04-22T19:58:49.731405+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731405+0000","last_undegraded":"2024-04-22T19:58:49.731405+0000","last_fullsized":"2024-04-22T19:58:49.731405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723224+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723224+0000","last_peered":"2024-04-22T19:58:49.723224+0000","last_clean":"2024-04-22T19:58:49.723224+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723224+0000","last_undegraded":"2024-04-22T19:58:49.723224+0000","last_fullsized":"2024-04-22T19:58:49.723224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783588+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783588+0000","last_peered":"2024-04-22T19:58:49.783588+0000","last_clean":"2024-04-22T19:58:49.783588+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783588+0000","last_undegraded":"2024-04-22T19:58:49.783588+0000","last_fullsized":"2024-04-22T19:58:49.783588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721496+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721496+0000","last_peered":"2024-04-22T19:58:49.721496+0000","last_clean":"2024-04-22T19:58:49.721496+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721496+0000","last_undegraded":"2024-04-22T19:58:49.721496+0000","last_fullsized":"2024-04-22T19:58:49.721496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781432+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781432+0000","last_peered":"2024-04-22T19:58:49.781432+0000","last_clean":"2024-04-22T19:58:49.781432+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781432+0000","last_undegraded":"2024-04-22T19:58:49.781432+0000","last_fullsized":"2024-04-22T19:58:49.781432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719583+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719583+0000","last_peered":"2024-04-22T19:58:49.719583+0000","last_clean":"2024-04-22T19:58:49.719583+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719583+0000","last_undegraded":"2024-04-22T19:58:49.719583+0000","last_fullsized":"2024-04-22T19:58:49.719583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724455+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724455+0000","last_peered":"2024-04-22T19:58:49.724455+0000","last_clean":"2024-04-22T19:58:49.724455+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724455+0000","last_undegraded":"2024-04-22T19:58:49.724455+0000","last_fullsized":"2024-04-22T19:58:49.724455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779811+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779811+0000","last_peered":"2024-04-22T19:58:49.779811+0000","last_clean":"2024-04-22T19:58:49.779811+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779811+0000","last_undegraded":"2024-04-22T19:58:49.779811+0000","last_fullsized":"2024-04-22T19:58:49.779811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720782+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720782+0000","last_peered":"2024-04-22T19:58:49.720782+0000","last_clean":"2024-04-22T19:58:49.720782+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720782+0000","last_undegraded":"2024-04-22T19:58:49.720782+0000","last_fullsized":"2024-04-22T19:58:49.720782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":330,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783618+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.783618+0000","last_peered":"2024-04-22T19:58:49.783618+0000","last_clean":"2024-04-22T19:58:49.783618+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.783618+0000","last_undegraded":"2024-04-22T19:58:49.783618+0000","last_fullsized":"2024-04-22T19:58:49.783618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721832+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721832+0000","last_peered":"2024-04-22T19:58:49.721832+0000","last_clean":"2024-04-22T19:58:49.721832+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721832+0000","last_undegraded":"2024-04-22T19:58:49.721832+0000","last_fullsized":"2024-04-22T19:58:49.721832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720710+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720710+0000","last_peered":"2024-04-22T19:58:49.720710+0000","last_clean":"2024-04-22T19:58:49.720710+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720710+0000","last_undegraded":"2024-04-22T19:58:49.720710+0000","last_fullsized":"2024-04-22T19:58:49.720710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":344,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839417+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839417+0000","last_peered":"2024-04-22T19:58:52.839417+0000","last_clean":"2024-04-22T19:58:52.839417+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839417+0000","last_undegraded":"2024-04-22T19:58:52.839417+0000","last_fullsized":"2024-04-22T19:58:52.839417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718286+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718286+0000","last_peered":"2024-04-22T19:58:49.718286+0000","last_clean":"2024-04-22T19:58:49.718286+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718286+0000","last_undegraded":"2024-04-22T19:58:49.718286+0000","last_fullsized":"2024-04-22T19:58:49.718286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721932+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.721932+0000","last_peered":"2024-04-22T19:58:49.721932+0000","last_clean":"2024-04-22T19:58:49.721932+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.721932+0000","last_undegraded":"2024-04-22T19:58:49.721932+0000","last_fullsized":"2024-04-22T19:58:49.721932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721550+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721550+0000","last_peered":"2024-04-22T19:58:49.721550+0000","last_clean":"2024-04-22T19:58:49.721550+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721550+0000","last_undegraded":"2024-04-22T19:58:49.721550+0000","last_fullsized":"2024-04-22T19:58:49.721550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732345+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732345+0000","last_peered":"2024-04-22T19:58:49.732345+0000","last_clean":"2024-04-22T19:58:49.732345+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732345+0000","last_undegraded":"2024-04-22T19:58:49.732345+0000","last_fullsized":"2024-04-22T19:58:49.732345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778555+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778555+0000","last_peered":"2024-04-22T19:58:49.778555+0000","last_clean":"2024-04-22T19:58:49.778555+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778555+0000","last_undegraded":"2024-04-22T19:58:49.778555+0000","last_fullsized":"2024-04-22T19:58:49.778555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720604+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720604+0000","last_peered":"2024-04-22T19:58:49.720604+0000","last_clean":"2024-04-22T19:58:49.720604+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720604+0000","last_undegraded":"2024-04-22T19:58:49.720604+0000","last_fullsized":"2024-04-22T19:58:49.720604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779173+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779173+0000","last_peered":"2024-04-22T19:58:49.779173+0000","last_clean":"2024-04-22T19:58:49.779173+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779173+0000","last_undegraded":"2024-04-22T19:58:49.779173+0000","last_fullsized":"2024-04-22T19:58:49.779173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787784+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787784+0000","last_peered":"2024-04-22T19:58:49.787784+0000","last_clean":"2024-04-22T19:58:49.787784+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787784+0000","last_undegraded":"2024-04-22T19:58:49.787784+0000","last_fullsized":"2024-04-22T19:58:49.787784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778426+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778426+0000","last_peered":"2024-04-22T19:58:49.778426+0000","last_clean":"2024-04-22T19:58:49.778426+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778426+0000","last_undegraded":"2024-04-22T19:58:49.778426+0000","last_fullsized":"2024-04-22T19:58:49.778426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":101,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849019+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849019+0000","last_peered":"2024-04-22T19:58:55.849019+0000","last_clean":"2024-04-22T19:58:55.849019+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849019+0000","last_undegraded":"2024-04-22T19:58:55.849019+0000","last_fullsized":"2024-04-22T19:58:55.849019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723749+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723749+0000","last_peered":"2024-04-22T19:58:49.723749+0000","last_clean":"2024-04-22T19:58:49.723749+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723749+0000","last_undegraded":"2024-04-22T19:58:49.723749+0000","last_fullsized":"2024-04-22T19:58:49.723749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718541+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718541+0000","last_peered":"2024-04-22T19:58:49.718541+0000","last_clean":"2024-04-22T19:58:49.718541+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718541+0000","last_undegraded":"2024-04-22T19:58:49.718541+0000","last_fullsized":"2024-04-22T19:58:49.718541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121450+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121450+0000","last_peered":"2024-04-22T19:58:53.121450+0000","last_clean":"2024-04-22T19:58:53.121450+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121450+0000","last_undegraded":"2024-04-22T19:58:53.121450+0000","last_fullsized":"2024-04-22T19:58:53.121450+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":482,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857784+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857784+0000","last_peered":"2024-04-22T19:58:57.857784+0000","last_clean":"2024-04-22T19:58:57.857784+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857784+0000","last_undegraded":"2024-04-22T19:58:57.857784+0000","last_fullsized":"2024-04-22T19:58:57.857784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718933+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.718933+0000","last_peered":"2024-04-22T19:58:49.718933+0000","last_clean":"2024-04-22T19:58:49.718933+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.718933+0000","last_undegraded":"2024-04-22T19:58:49.718933+0000","last_fullsized":"2024-04-22T19:58:49.718933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786532+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786532+0000","last_peered":"2024-04-22T19:58:49.786532+0000","last_clean":"2024-04-22T19:58:49.786532+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786532+0000","last_undegraded":"2024-04-22T19:58:49.786532+0000","last_fullsized":"2024-04-22T19:58:49.786532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778078+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778078+0000","last_peered":"2024-04-22T19:58:49.778078+0000","last_clean":"2024-04-22T19:58:49.778078+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778078+0000","last_undegraded":"2024-04-22T19:58:49.778078+0000","last_fullsized":"2024-04-22T19:58:49.778078+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729934+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.729934+0000","last_peered":"2024-04-22T19:58:49.729934+0000","last_clean":"2024-04-22T19:58:49.729934+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.729934+0000","last_undegraded":"2024-04-22T19:58:49.729934+0000","last_fullsized":"2024-04-22T19:58:49.729934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779494+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779494+0000","last_peered":"2024-04-22T19:58:49.779494+0000","last_clean":"2024-04-22T19:58:49.779494+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779494+0000","last_undegraded":"2024-04-22T19:58:49.779494+0000","last_fullsized":"2024-04-22T19:58:49.779494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724558+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724558+0000","last_peered":"2024-04-22T19:58:49.724558+0000","last_clean":"2024-04-22T19:58:49.724558+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724558+0000","last_undegraded":"2024-04-22T19:58:49.724558+0000","last_fullsized":"2024-04-22T19:58:49.724558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778645+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778645+0000","last_peered":"2024-04-22T19:58:49.778645+0000","last_clean":"2024-04-22T19:58:49.778645+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778645+0000","last_undegraded":"2024-04-22T19:58:49.778645+0000","last_fullsized":"2024-04-22T19:58:49.778645+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778759+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.778759+0000","last_peered":"2024-04-22T19:58:49.778759+0000","last_clean":"2024-04-22T19:58:49.778759+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.778759+0000","last_undegraded":"2024-04-22T19:58:49.778759+0000","last_fullsized":"2024-04-22T19:58:49.778759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":60,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779404+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779404+0000","last_peered":"2024-04-22T19:58:49.779404+0000","last_clean":"2024-04-22T19:58:49.779404+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779404+0000","last_undegraded":"2024-04-22T19:58:49.779404+0000","last_fullsized":"2024-04-22T19:58:49.779404+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821923+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821923+0000","last_peered":"2024-04-22T19:58:49.821923+0000","last_clean":"2024-04-22T19:58:49.821923+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821923+0000","last_undegraded":"2024-04-22T19:58:49.821923+0000","last_fullsized":"2024-04-22T19:58:49.821923+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724142+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724142+0000","last_peered":"2024-04-22T19:58:49.724142+0000","last_clean":"2024-04-22T19:58:49.724142+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724142+0000","last_undegraded":"2024-04-22T19:58:49.724142+0000","last_fullsized":"2024-04-22T19:58:49.724142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":63,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779928+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.779928+0000","last_peered":"2024-04-22T19:58:49.779928+0000","last_clean":"2024-04-22T19:58:49.779928+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.779928+0000","last_undegraded":"2024-04-22T19:58:49.779928+0000","last_fullsized":"2024-04-22T19:58:49.779928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780038+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780038+0000","last_peered":"2024-04-22T19:58:49.780038+0000","last_clean":"2024-04-22T19:58:49.780038+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780038+0000","last_undegraded":"2024-04-22T19:58:49.780038+0000","last_fullsized":"2024-04-22T19:58:49.780038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781660+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781660+0000","last_peered":"2024-04-22T19:58:49.781660+0000","last_clean":"2024-04-22T19:58:49.781660+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781660+0000","last_undegraded":"2024-04-22T19:58:49.781660+0000","last_fullsized":"2024-04-22T19:58:49.781660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871288+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871288+0000","last_peered":"2024-04-22T19:58:50.871288+0000","last_clean":"2024-04-22T19:58:50.871288+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871288+0000","last_undegraded":"2024-04-22T19:58:50.871288+0000","last_fullsized":"2024-04-22T19:58:50.871288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786110+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786110+0000","last_peered":"2024-04-22T19:58:49.786110+0000","last_clean":"2024-04-22T19:58:49.786110+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786110+0000","last_undegraded":"2024-04-22T19:58:49.786110+0000","last_fullsized":"2024-04-22T19:58:49.786110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778754+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778754+0000","last_peered":"2024-04-22T19:58:49.778754+0000","last_clean":"2024-04-22T19:58:49.778754+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778754+0000","last_undegraded":"2024-04-22T19:58:49.778754+0000","last_fullsized":"2024-04-22T19:58:49.778754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725097+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725097+0000","last_peered":"2024-04-22T19:58:49.725097+0000","last_clean":"2024-04-22T19:58:49.725097+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725097+0000","last_undegraded":"2024-04-22T19:58:49.725097+0000","last_fullsized":"2024-04-22T19:58:49.725097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779087+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779087+0000","last_peered":"2024-04-22T19:58:49.779087+0000","last_clean":"2024-04-22T19:58:49.779087+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779087+0000","last_undegraded":"2024-04-22T19:58:49.779087+0000","last_fullsized":"2024-04-22T19:58:49.779087+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781288+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781288+0000","last_peered":"2024-04-22T19:58:49.781288+0000","last_clean":"2024-04-22T19:58:49.781288+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781288+0000","last_undegraded":"2024-04-22T19:58:49.781288+0000","last_fullsized":"2024-04-22T19:58:49.781288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725322+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725322+0000","last_peered":"2024-04-22T19:58:49.725322+0000","last_clean":"2024-04-22T19:58:49.725322+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725322+0000","last_undegraded":"2024-04-22T19:58:49.725322+0000","last_fullsized":"2024-04-22T19:58:49.725322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785674+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785674+0000","last_peered":"2024-04-22T19:58:49.785674+0000","last_clean":"2024-04-22T19:58:49.785674+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785674+0000","last_undegraded":"2024-04-22T19:58:49.785674+0000","last_fullsized":"2024-04-22T19:58:49.785674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722220+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722220+0000","last_peered":"2024-04-22T19:58:49.722220+0000","last_clean":"2024-04-22T19:58:49.722220+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722220+0000","last_undegraded":"2024-04-22T19:58:49.722220+0000","last_fullsized":"2024-04-22T19:58:49.722220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779798+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779798+0000","last_peered":"2024-04-22T19:58:49.779798+0000","last_clean":"2024-04-22T19:58:49.779798+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779798+0000","last_undegraded":"2024-04-22T19:58:49.779798+0000","last_fullsized":"2024-04-22T19:58:49.779798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850426+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850426+0000","last_peered":"2024-04-22T19:58:56.850426+0000","last_clean":"2024-04-22T19:58:56.850426+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850426+0000","last_undegraded":"2024-04-22T19:58:56.850426+0000","last_fullsized":"2024-04-22T19:58:56.850426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722388+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722388+0000","last_peered":"2024-04-22T19:58:49.722388+0000","last_clean":"2024-04-22T19:58:49.722388+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722388+0000","last_undegraded":"2024-04-22T19:58:49.722388+0000","last_fullsized":"2024-04-22T19:58:49.722388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719954+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.719954+0000","last_peered":"2024-04-22T19:58:49.719954+0000","last_clean":"2024-04-22T19:58:49.719954+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.719954+0000","last_undegraded":"2024-04-22T19:58:49.719954+0000","last_fullsized":"2024-04-22T19:58:49.719954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":434,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784959+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.784959+0000","last_peered":"2024-04-22T19:58:49.784959+0000","last_clean":"2024-04-22T19:58:49.784959+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.784959+0000","last_undegraded":"2024-04-22T19:58:49.784959+0000","last_fullsized":"2024-04-22T19:58:49.784959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":67,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778294+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778294+0000","last_peered":"2024-04-22T19:58:49.778294+0000","last_clean":"2024-04-22T19:58:49.778294+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778294+0000","last_undegraded":"2024-04-22T19:58:49.778294+0000","last_fullsized":"2024-04-22T19:58:49.778294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786068+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786068+0000","last_peered":"2024-04-22T19:58:49.786068+0000","last_clean":"2024-04-22T19:58:49.786068+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786068+0000","last_undegraded":"2024-04-22T19:58:49.786068+0000","last_fullsized":"2024-04-22T19:58:49.786068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":65,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783412+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783412+0000","last_peered":"2024-04-22T19:58:49.783412+0000","last_clean":"2024-04-22T19:58:49.783412+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783412+0000","last_undegraded":"2024-04-22T19:58:49.783412+0000","last_fullsized":"2024-04-22T19:58:49.783412+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718466+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718466+0000","last_peered":"2024-04-22T19:58:49.718466+0000","last_clean":"2024-04-22T19:58:49.718466+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718466+0000","last_undegraded":"2024-04-22T19:58:49.718466+0000","last_fullsized":"2024-04-22T19:58:49.718466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725567+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725567+0000","last_peered":"2024-04-22T19:58:49.725567+0000","last_clean":"2024-04-22T19:58:49.725567+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725567+0000","last_undegraded":"2024-04-22T19:58:49.725567+0000","last_fullsized":"2024-04-22T19:58:49.725567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719353+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719353+0000","last_peered":"2024-04-22T19:58:49.719353+0000","last_clean":"2024-04-22T19:58:49.719353+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719353+0000","last_undegraded":"2024-04-22T19:58:49.719353+0000","last_fullsized":"2024-04-22T19:58:49.719353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777636+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777636+0000","last_peered":"2024-04-22T19:58:49.777636+0000","last_clean":"2024-04-22T19:58:49.777636+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777636+0000","last_undegraded":"2024-04-22T19:58:49.777636+0000","last_fullsized":"2024-04-22T19:58:49.777636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727174+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727174+0000","last_peered":"2024-04-22T19:58:49.727174+0000","last_clean":"2024-04-22T19:58:49.727174+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727174+0000","last_undegraded":"2024-04-22T19:58:49.727174+0000","last_fullsized":"2024-04-22T19:58:49.727174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":355,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617798+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617798+0000","last_peered":"2024-04-22T19:58:50.617798+0000","last_clean":"2024-04-22T19:58:50.617798+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617798+0000","last_undegraded":"2024-04-22T19:58:50.617798+0000","last_fullsized":"2024-04-22T19:58:50.617798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":321,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869764+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869764+0000","last_peered":"2024-04-22T19:58:51.869764+0000","last_clean":"2024-04-22T19:58:51.869764+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869764+0000","last_undegraded":"2024-04-22T19:58:51.869764+0000","last_fullsized":"2024-04-22T19:58:51.869764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780689+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780689+0000","last_peered":"2024-04-22T19:58:49.780689+0000","last_clean":"2024-04-22T19:58:49.780689+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780689+0000","last_undegraded":"2024-04-22T19:58:49.780689+0000","last_fullsized":"2024-04-22T19:58:49.780689+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720534+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720534+0000","last_peered":"2024-04-22T19:58:49.720534+0000","last_clean":"2024-04-22T19:58:49.720534+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720534+0000","last_undegraded":"2024-04-22T19:58:49.720534+0000","last_fullsized":"2024-04-22T19:58:49.720534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779059+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779059+0000","last_peered":"2024-04-22T19:58:49.779059+0000","last_clean":"2024-04-22T19:58:49.779059+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779059+0000","last_undegraded":"2024-04-22T19:58:49.779059+0000","last_fullsized":"2024-04-22T19:58:49.779059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777547+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777547+0000","last_peered":"2024-04-22T19:58:49.777547+0000","last_clean":"2024-04-22T19:58:49.777547+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777547+0000","last_undegraded":"2024-04-22T19:58:49.777547+0000","last_fullsized":"2024-04-22T19:58:49.777547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830214+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830214+0000","last_peered":"2024-04-22T19:58:53.830214+0000","last_clean":"2024-04-22T19:58:53.830214+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830214+0000","last_undegraded":"2024-04-22T19:58:53.830214+0000","last_fullsized":"2024-04-22T19:58:53.830214+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782025+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782025+0000","last_peered":"2024-04-22T19:58:49.782025+0000","last_clean":"2024-04-22T19:58:49.782025+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782025+0000","last_undegraded":"2024-04-22T19:58:49.782025+0000","last_fullsized":"2024-04-22T19:58:49.782025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779347+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779347+0000","last_peered":"2024-04-22T19:58:49.779347+0000","last_clean":"2024-04-22T19:58:49.779347+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779347+0000","last_undegraded":"2024-04-22T19:58:49.779347+0000","last_fullsized":"2024-04-22T19:58:49.779347+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729079+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729079+0000","last_peered":"2024-04-22T19:58:49.729079+0000","last_clean":"2024-04-22T19:58:49.729079+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729079+0000","last_undegraded":"2024-04-22T19:58:49.729079+0000","last_fullsized":"2024-04-22T19:58:49.729079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:59:19.975 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:59:19.975 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T19:59:39.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T19:59:40.330 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T19:59:40.336 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T19:59:40.347 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-04-22T19:59:39.473944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006906"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731541+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731541+0000","last_peered":"2024-04-22T19:58:49.731541+0000","last_clean":"2024-04-22T19:58:49.731541+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731541+0000","last_undegraded":"2024-04-22T19:58:49.731541+0000","last_fullsized":"2024-04-22T19:58:49.731541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723496+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723496+0000","last_peered":"2024-04-22T19:58:49.723496+0000","last_clean":"2024-04-22T19:58:49.723496+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723496+0000","last_undegraded":"2024-04-22T19:58:49.723496+0000","last_fullsized":"2024-04-22T19:58:49.723496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724878+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.724878+0000","last_peered":"2024-04-22T19:58:49.724878+0000","last_clean":"2024-04-22T19:58:49.724878+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.724878+0000","last_undegraded":"2024-04-22T19:58:49.724878+0000","last_fullsized":"2024-04-22T19:58:49.724878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":346,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601548+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601548+0000","last_peered":"2024-04-22T19:58:52.601548+0000","last_clean":"2024-04-22T19:58:52.601548+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601548+0000","last_undegraded":"2024-04-22T19:58:52.601548+0000","last_fullsized":"2024-04-22T19:58:52.601548+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780835+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780835+0000","last_peered":"2024-04-22T19:58:49.780835+0000","last_clean":"2024-04-22T19:58:49.780835+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780835+0000","last_undegraded":"2024-04-22T19:58:49.780835+0000","last_fullsized":"2024-04-22T19:58:49.780835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719945+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.719945+0000","last_peered":"2024-04-22T19:58:49.719945+0000","last_clean":"2024-04-22T19:58:49.719945+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.719945+0000","last_undegraded":"2024-04-22T19:58:49.719945+0000","last_fullsized":"2024-04-22T19:58:49.719945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783599+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783599+0000","last_peered":"2024-04-22T19:58:49.783599+0000","last_clean":"2024-04-22T19:58:49.783599+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783599+0000","last_undegraded":"2024-04-22T19:58:49.783599+0000","last_fullsized":"2024-04-22T19:58:49.783599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729758+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729758+0000","last_peered":"2024-04-22T19:58:49.729758+0000","last_clean":"2024-04-22T19:58:49.729758+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729758+0000","last_undegraded":"2024-04-22T19:58:49.729758+0000","last_fullsized":"2024-04-22T19:58:49.729758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781037+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781037+0000","last_peered":"2024-04-22T19:58:49.781037+0000","last_clean":"2024-04-22T19:58:49.781037+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781037+0000","last_undegraded":"2024-04-22T19:58:49.781037+0000","last_fullsized":"2024-04-22T19:58:49.781037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780534+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780534+0000","last_peered":"2024-04-22T19:58:49.780534+0000","last_clean":"2024-04-22T19:58:49.780534+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780534+0000","last_undegraded":"2024-04-22T19:58:49.780534+0000","last_fullsized":"2024-04-22T19:58:49.780534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780804+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780804+0000","last_peered":"2024-04-22T19:58:49.780804+0000","last_clean":"2024-04-22T19:58:49.780804+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780804+0000","last_undegraded":"2024-04-22T19:58:49.780804+0000","last_fullsized":"2024-04-22T19:58:49.780804+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787663+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787663+0000","last_peered":"2024-04-22T19:58:49.787663+0000","last_clean":"2024-04-22T19:58:49.787663+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787663+0000","last_undegraded":"2024-04-22T19:58:49.787663+0000","last_fullsized":"2024-04-22T19:58:49.787663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823685+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823685+0000","last_peered":"2024-04-22T19:58:54.823685+0000","last_clean":"2024-04-22T19:58:54.823685+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823685+0000","last_undegraded":"2024-04-22T19:58:54.823685+0000","last_fullsized":"2024-04-22T19:58:54.823685+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872313+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872313+0000","last_peered":"2024-04-22T19:58:52.872313+0000","last_clean":"2024-04-22T19:58:52.872313+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872313+0000","last_undegraded":"2024-04-22T19:58:52.872313+0000","last_fullsized":"2024-04-22T19:58:52.872313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781853+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781853+0000","last_peered":"2024-04-22T19:58:49.781853+0000","last_clean":"2024-04-22T19:58:49.781853+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781853+0000","last_undegraded":"2024-04-22T19:58:49.781853+0000","last_fullsized":"2024-04-22T19:58:49.781853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780377+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780377+0000","last_peered":"2024-04-22T19:58:49.780377+0000","last_clean":"2024-04-22T19:58:49.780377+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780377+0000","last_undegraded":"2024-04-22T19:58:49.780377+0000","last_fullsized":"2024-04-22T19:58:49.780377+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778231+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778231+0000","last_peered":"2024-04-22T19:58:49.778231+0000","last_clean":"2024-04-22T19:58:49.778231+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778231+0000","last_undegraded":"2024-04-22T19:58:49.778231+0000","last_fullsized":"2024-04-22T19:58:49.778231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780682+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780682+0000","last_peered":"2024-04-22T19:58:49.780682+0000","last_clean":"2024-04-22T19:58:49.780682+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780682+0000","last_undegraded":"2024-04-22T19:58:49.780682+0000","last_fullsized":"2024-04-22T19:58:49.780682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779291+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779291+0000","last_peered":"2024-04-22T19:58:49.779291+0000","last_clean":"2024-04-22T19:58:49.779291+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779291+0000","last_undegraded":"2024-04-22T19:58:49.779291+0000","last_fullsized":"2024-04-22T19:58:49.779291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781090+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781090+0000","last_peered":"2024-04-22T19:58:49.781090+0000","last_clean":"2024-04-22T19:58:49.781090+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781090+0000","last_undegraded":"2024-04-22T19:58:49.781090+0000","last_fullsized":"2024-04-22T19:58:49.781090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721118+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721118+0000","last_peered":"2024-04-22T19:58:49.721118+0000","last_clean":"2024-04-22T19:58:49.721118+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721118+0000","last_undegraded":"2024-04-22T19:58:49.721118+0000","last_fullsized":"2024-04-22T19:58:49.721118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781338+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781338+0000","last_peered":"2024-04-22T19:58:49.781338+0000","last_clean":"2024-04-22T19:58:49.781338+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781338+0000","last_undegraded":"2024-04-22T19:58:49.781338+0000","last_fullsized":"2024-04-22T19:58:49.781338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719088+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719088+0000","last_peered":"2024-04-22T19:58:49.719088+0000","last_clean":"2024-04-22T19:58:49.719088+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719088+0000","last_undegraded":"2024-04-22T19:58:49.719088+0000","last_fullsized":"2024-04-22T19:58:49.719088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782159+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782159+0000","last_peered":"2024-04-22T19:58:49.782159+0000","last_clean":"2024-04-22T19:58:49.782159+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782159+0000","last_undegraded":"2024-04-22T19:58:49.782159+0000","last_fullsized":"2024-04-22T19:58:49.782159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720449+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720449+0000","last_peered":"2024-04-22T19:58:49.720449+0000","last_clean":"2024-04-22T19:58:49.720449+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720449+0000","last_undegraded":"2024-04-22T19:58:49.720449+0000","last_fullsized":"2024-04-22T19:58:49.720449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784604+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784604+0000","last_peered":"2024-04-22T19:58:49.784604+0000","last_clean":"2024-04-22T19:58:49.784604+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784604+0000","last_undegraded":"2024-04-22T19:58:49.784604+0000","last_fullsized":"2024-04-22T19:58:49.784604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729417+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729417+0000","last_peered":"2024-04-22T19:58:49.729417+0000","last_clean":"2024-04-22T19:58:49.729417+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729417+0000","last_undegraded":"2024-04-22T19:58:49.729417+0000","last_fullsized":"2024-04-22T19:58:49.729417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781330+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781330+0000","last_peered":"2024-04-22T19:58:49.781330+0000","last_clean":"2024-04-22T19:58:49.781330+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781330+0000","last_undegraded":"2024-04-22T19:58:49.781330+0000","last_fullsized":"2024-04-22T19:58:49.781330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":113,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838236+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838236+0000","last_peered":"2024-04-22T19:58:51.838236+0000","last_clean":"2024-04-22T19:58:51.838236+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838236+0000","last_undegraded":"2024-04-22T19:58:51.838236+0000","last_fullsized":"2024-04-22T19:58:51.838236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730754+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730754+0000","last_peered":"2024-04-22T19:58:49.730754+0000","last_clean":"2024-04-22T19:58:49.730754+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730754+0000","last_undegraded":"2024-04-22T19:58:49.730754+0000","last_fullsized":"2024-04-22T19:58:49.730754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729191+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729191+0000","last_peered":"2024-04-22T19:58:49.729191+0000","last_clean":"2024-04-22T19:58:49.729191+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729191+0000","last_undegraded":"2024-04-22T19:58:49.729191+0000","last_fullsized":"2024-04-22T19:58:49.729191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718683+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718683+0000","last_peered":"2024-04-22T19:58:49.718683+0000","last_clean":"2024-04-22T19:58:49.718683+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718683+0000","last_undegraded":"2024-04-22T19:58:49.718683+0000","last_fullsized":"2024-04-22T19:58:49.718683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":502,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721010+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721010+0000","last_peered":"2024-04-22T19:58:49.721010+0000","last_clean":"2024-04-22T19:58:49.721010+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721010+0000","last_undegraded":"2024-04-22T19:58:49.721010+0000","last_fullsized":"2024-04-22T19:58:49.721010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730730+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730730+0000","last_peered":"2024-04-22T19:58:49.730730+0000","last_clean":"2024-04-22T19:58:49.730730+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730730+0000","last_undegraded":"2024-04-22T19:58:49.730730+0000","last_fullsized":"2024-04-22T19:58:49.730730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727602+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727602+0000","last_peered":"2024-04-22T19:58:49.727602+0000","last_clean":"2024-04-22T19:58:49.727602+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727602+0000","last_undegraded":"2024-04-22T19:58:49.727602+0000","last_fullsized":"2024-04-22T19:58:49.727602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720312+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720312+0000","last_peered":"2024-04-22T19:58:49.720312+0000","last_clean":"2024-04-22T19:58:49.720312+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720312+0000","last_undegraded":"2024-04-22T19:58:49.720312+0000","last_fullsized":"2024-04-22T19:58:49.720312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731405+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731405+0000","last_peered":"2024-04-22T19:58:49.731405+0000","last_clean":"2024-04-22T19:58:49.731405+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731405+0000","last_undegraded":"2024-04-22T19:58:49.731405+0000","last_fullsized":"2024-04-22T19:58:49.731405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723224+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723224+0000","last_peered":"2024-04-22T19:58:49.723224+0000","last_clean":"2024-04-22T19:58:49.723224+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723224+0000","last_undegraded":"2024-04-22T19:58:49.723224+0000","last_fullsized":"2024-04-22T19:58:49.723224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783588+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783588+0000","last_peered":"2024-04-22T19:58:49.783588+0000","last_clean":"2024-04-22T19:58:49.783588+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783588+0000","last_undegraded":"2024-04-22T19:58:49.783588+0000","last_fullsized":"2024-04-22T19:58:49.783588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721496+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721496+0000","last_peered":"2024-04-22T19:58:49.721496+0000","last_clean":"2024-04-22T19:58:49.721496+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721496+0000","last_undegraded":"2024-04-22T19:58:49.721496+0000","last_fullsized":"2024-04-22T19:58:49.721496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781432+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781432+0000","last_peered":"2024-04-22T19:58:49.781432+0000","last_clean":"2024-04-22T19:58:49.781432+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781432+0000","last_undegraded":"2024-04-22T19:58:49.781432+0000","last_fullsized":"2024-04-22T19:58:49.781432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719583+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719583+0000","last_peered":"2024-04-22T19:58:49.719583+0000","last_clean":"2024-04-22T19:58:49.719583+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719583+0000","last_undegraded":"2024-04-22T19:58:49.719583+0000","last_fullsized":"2024-04-22T19:58:49.719583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724455+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724455+0000","last_peered":"2024-04-22T19:58:49.724455+0000","last_clean":"2024-04-22T19:58:49.724455+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724455+0000","last_undegraded":"2024-04-22T19:58:49.724455+0000","last_fullsized":"2024-04-22T19:58:49.724455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779811+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779811+0000","last_peered":"2024-04-22T19:58:49.779811+0000","last_clean":"2024-04-22T19:58:49.779811+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779811+0000","last_undegraded":"2024-04-22T19:58:49.779811+0000","last_fullsized":"2024-04-22T19:58:49.779811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720782+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720782+0000","last_peered":"2024-04-22T19:58:49.720782+0000","last_clean":"2024-04-22T19:58:49.720782+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720782+0000","last_undegraded":"2024-04-22T19:58:49.720782+0000","last_fullsized":"2024-04-22T19:58:49.720782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":330,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783618+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.783618+0000","last_peered":"2024-04-22T19:58:49.783618+0000","last_clean":"2024-04-22T19:58:49.783618+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.783618+0000","last_undegraded":"2024-04-22T19:58:49.783618+0000","last_fullsized":"2024-04-22T19:58:49.783618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721832+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721832+0000","last_peered":"2024-04-22T19:58:49.721832+0000","last_clean":"2024-04-22T19:58:49.721832+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721832+0000","last_undegraded":"2024-04-22T19:58:49.721832+0000","last_fullsized":"2024-04-22T19:58:49.721832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720710+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720710+0000","last_peered":"2024-04-22T19:58:49.720710+0000","last_clean":"2024-04-22T19:58:49.720710+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720710+0000","last_undegraded":"2024-04-22T19:58:49.720710+0000","last_fullsized":"2024-04-22T19:58:49.720710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":344,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839417+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839417+0000","last_peered":"2024-04-22T19:58:52.839417+0000","last_clean":"2024-04-22T19:58:52.839417+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839417+0000","last_undegraded":"2024-04-22T19:58:52.839417+0000","last_fullsized":"2024-04-22T19:58:52.839417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718286+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718286+0000","last_peered":"2024-04-22T19:58:49.718286+0000","last_clean":"2024-04-22T19:58:49.718286+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718286+0000","last_undegraded":"2024-04-22T19:58:49.718286+0000","last_fullsized":"2024-04-22T19:58:49.718286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721932+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.721932+0000","last_peered":"2024-04-22T19:58:49.721932+0000","last_clean":"2024-04-22T19:58:49.721932+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.721932+0000","last_undegraded":"2024-04-22T19:58:49.721932+0000","last_fullsized":"2024-04-22T19:58:49.721932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721550+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721550+0000","last_peered":"2024-04-22T19:58:49.721550+0000","last_clean":"2024-04-22T19:58:49.721550+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721550+0000","last_undegraded":"2024-04-22T19:58:49.721550+0000","last_fullsized":"2024-04-22T19:58:49.721550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732345+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732345+0000","last_peered":"2024-04-22T19:58:49.732345+0000","last_clean":"2024-04-22T19:58:49.732345+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732345+0000","last_undegraded":"2024-04-22T19:58:49.732345+0000","last_fullsized":"2024-04-22T19:58:49.732345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778555+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778555+0000","last_peered":"2024-04-22T19:58:49.778555+0000","last_clean":"2024-04-22T19:58:49.778555+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778555+0000","last_undegraded":"2024-04-22T19:58:49.778555+0000","last_fullsized":"2024-04-22T19:58:49.778555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720604+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720604+0000","last_peered":"2024-04-22T19:58:49.720604+0000","last_clean":"2024-04-22T19:58:49.720604+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720604+0000","last_undegraded":"2024-04-22T19:58:49.720604+0000","last_fullsized":"2024-04-22T19:58:49.720604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779173+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779173+0000","last_peered":"2024-04-22T19:58:49.779173+0000","last_clean":"2024-04-22T19:58:49.779173+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779173+0000","last_undegraded":"2024-04-22T19:58:49.779173+0000","last_fullsized":"2024-04-22T19:58:49.779173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787784+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787784+0000","last_peered":"2024-04-22T19:58:49.787784+0000","last_clean":"2024-04-22T19:58:49.787784+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787784+0000","last_undegraded":"2024-04-22T19:58:49.787784+0000","last_fullsized":"2024-04-22T19:58:49.787784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778426+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778426+0000","last_peered":"2024-04-22T19:58:49.778426+0000","last_clean":"2024-04-22T19:58:49.778426+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778426+0000","last_undegraded":"2024-04-22T19:58:49.778426+0000","last_fullsized":"2024-04-22T19:58:49.778426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":101,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849019+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849019+0000","last_peered":"2024-04-22T19:58:55.849019+0000","last_clean":"2024-04-22T19:58:55.849019+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849019+0000","last_undegraded":"2024-04-22T19:58:55.849019+0000","last_fullsized":"2024-04-22T19:58:55.849019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723749+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723749+0000","last_peered":"2024-04-22T19:58:49.723749+0000","last_clean":"2024-04-22T19:58:49.723749+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723749+0000","last_undegraded":"2024-04-22T19:58:49.723749+0000","last_fullsized":"2024-04-22T19:58:49.723749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718541+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718541+0000","last_peered":"2024-04-22T19:58:49.718541+0000","last_clean":"2024-04-22T19:58:49.718541+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718541+0000","last_undegraded":"2024-04-22T19:58:49.718541+0000","last_fullsized":"2024-04-22T19:58:49.718541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121450+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121450+0000","last_peered":"2024-04-22T19:58:53.121450+0000","last_clean":"2024-04-22T19:58:53.121450+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121450+0000","last_undegraded":"2024-04-22T19:58:53.121450+0000","last_fullsized":"2024-04-22T19:58:53.121450+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":482,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857784+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857784+0000","last_peered":"2024-04-22T19:58:57.857784+0000","last_clean":"2024-04-22T19:58:57.857784+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857784+0000","last_undegraded":"2024-04-22T19:58:57.857784+0000","last_fullsized":"2024-04-22T19:58:57.857784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718933+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.718933+0000","last_peered":"2024-04-22T19:58:49.718933+0000","last_clean":"2024-04-22T19:58:49.718933+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.718933+0000","last_undegraded":"2024-04-22T19:58:49.718933+0000","last_fullsized":"2024-04-22T19:58:49.718933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786532+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786532+0000","last_peered":"2024-04-22T19:58:49.786532+0000","last_clean":"2024-04-22T19:58:49.786532+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786532+0000","last_undegraded":"2024-04-22T19:58:49.786532+0000","last_fullsized":"2024-04-22T19:58:49.786532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778078+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778078+0000","last_peered":"2024-04-22T19:58:49.778078+0000","last_clean":"2024-04-22T19:58:49.778078+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778078+0000","last_undegraded":"2024-04-22T19:58:49.778078+0000","last_fullsized":"2024-04-22T19:58:49.778078+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729934+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.729934+0000","last_peered":"2024-04-22T19:58:49.729934+0000","last_clean":"2024-04-22T19:58:49.729934+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.729934+0000","last_undegraded":"2024-04-22T19:58:49.729934+0000","last_fullsized":"2024-04-22T19:58:49.729934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779494+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779494+0000","last_peered":"2024-04-22T19:58:49.779494+0000","last_clean":"2024-04-22T19:58:49.779494+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779494+0000","last_undegraded":"2024-04-22T19:58:49.779494+0000","last_fullsized":"2024-04-22T19:58:49.779494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724558+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724558+0000","last_peered":"2024-04-22T19:58:49.724558+0000","last_clean":"2024-04-22T19:58:49.724558+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724558+0000","last_undegraded":"2024-04-22T19:58:49.724558+0000","last_fullsized":"2024-04-22T19:58:49.724558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778645+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778645+0000","last_peered":"2024-04-22T19:58:49.778645+0000","last_clean":"2024-04-22T19:58:49.778645+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778645+0000","last_undegraded":"2024-04-22T19:58:49.778645+0000","last_fullsized":"2024-04-22T19:58:49.778645+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778759+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.778759+0000","last_peered":"2024-04-22T19:58:49.778759+0000","last_clean":"2024-04-22T19:58:49.778759+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.778759+0000","last_undegraded":"2024-04-22T19:58:49.778759+0000","last_fullsized":"2024-04-22T19:58:49.778759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":60,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779404+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779404+0000","last_peered":"2024-04-22T19:58:49.779404+0000","last_clean":"2024-04-22T19:58:49.779404+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779404+0000","last_undegraded":"2024-04-22T19:58:49.779404+0000","last_fullsized":"2024-04-22T19:58:49.779404+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821923+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821923+0000","last_peered":"2024-04-22T19:58:49.821923+0000","last_clean":"2024-04-22T19:58:49.821923+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821923+0000","last_undegraded":"2024-04-22T19:58:49.821923+0000","last_fullsized":"2024-04-22T19:58:49.821923+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":63,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779928+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.779928+0000","last_peered":"2024-04-22T19:58:49.779928+0000","last_clean":"2024-04-22T19:58:49.779928+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.779928+0000","last_undegraded":"2024-04-22T19:58:49.779928+0000","last_fullsized":"2024-04-22T19:58:49.779928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780038+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780038+0000","last_peered":"2024-04-22T19:58:49.780038+0000","last_clean":"2024-04-22T19:58:49.780038+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780038+0000","last_undegraded":"2024-04-22T19:58:49.780038+0000","last_fullsized":"2024-04-22T19:58:49.780038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871288+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871288+0000","last_peered":"2024-04-22T19:58:50.871288+0000","last_clean":"2024-04-22T19:58:50.871288+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871288+0000","last_undegraded":"2024-04-22T19:58:50.871288+0000","last_fullsized":"2024-04-22T19:58:50.871288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786110+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786110+0000","last_peered":"2024-04-22T19:58:49.786110+0000","last_clean":"2024-04-22T19:58:49.786110+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786110+0000","last_undegraded":"2024-04-22T19:58:49.786110+0000","last_fullsized":"2024-04-22T19:58:49.786110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778754+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778754+0000","last_peered":"2024-04-22T19:58:49.778754+0000","last_clean":"2024-04-22T19:58:49.778754+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778754+0000","last_undegraded":"2024-04-22T19:58:49.778754+0000","last_fullsized":"2024-04-22T19:58:49.778754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725097+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725097+0000","last_peered":"2024-04-22T19:58:49.725097+0000","last_clean":"2024-04-22T19:58:49.725097+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725097+0000","last_undegraded":"2024-04-22T19:58:49.725097+0000","last_fullsized":"2024-04-22T19:58:49.725097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781288+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781288+0000","last_peered":"2024-04-22T19:58:49.781288+0000","last_clean":"2024-04-22T19:58:49.781288+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781288+0000","last_undegraded":"2024-04-22T19:58:49.781288+0000","last_fullsized":"2024-04-22T19:58:49.781288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725322+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725322+0000","last_peered":"2024-04-22T19:58:49.725322+0000","last_clean":"2024-04-22T19:58:49.725322+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725322+0000","last_undegraded":"2024-04-22T19:58:49.725322+0000","last_fullsized":"2024-04-22T19:58:49.725322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785674+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785674+0000","last_peered":"2024-04-22T19:58:49.785674+0000","last_clean":"2024-04-22T19:58:49.785674+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785674+0000","last_undegraded":"2024-04-22T19:58:49.785674+0000","last_fullsized":"2024-04-22T19:58:49.785674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779798+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779798+0000","last_peered":"2024-04-22T19:58:49.779798+0000","last_clean":"2024-04-22T19:58:49.779798+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779798+0000","last_undegraded":"2024-04-22T19:58:49.779798+0000","last_fullsized":"2024-04-22T19:58:49.779798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850426+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850426+0000","last_peered":"2024-04-22T19:58:56.850426+0000","last_clean":"2024-04-22T19:58:56.850426+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850426+0000","last_undegraded":"2024-04-22T19:58:56.850426+0000","last_fullsized":"2024-04-22T19:58:56.850426+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722388+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722388+0000","last_peered":"2024-04-22T19:58:49.722388+0000","last_clean":"2024-04-22T19:58:49.722388+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722388+0000","last_undegraded":"2024-04-22T19:58:49.722388+0000","last_fullsized":"2024-04-22T19:58:49.722388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719954+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.719954+0000","last_peered":"2024-04-22T19:58:49.719954+0000","last_clean":"2024-04-22T19:58:49.719954+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.719954+0000","last_undegraded":"2024-04-22T19:58:49.719954+0000","last_fullsized":"2024-04-22T19:58:49.719954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":434,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784959+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.784959+0000","last_peered":"2024-04-22T19:58:49.784959+0000","last_clean":"2024-04-22T19:58:49.784959+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.784959+0000","last_undegraded":"2024-04-22T19:58:49.784959+0000","last_fullsized":"2024-04-22T19:58:49.784959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":67,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778294+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778294+0000","last_peered":"2024-04-22T19:58:49.778294+0000","last_clean":"2024-04-22T19:58:49.778294+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778294+0000","last_undegraded":"2024-04-22T19:58:49.778294+0000","last_fullsized":"2024-04-22T19:58:49.778294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786068+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786068+0000","last_peered":"2024-04-22T19:58:49.786068+0000","last_clean":"2024-04-22T19:58:49.786068+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786068+0000","last_undegraded":"2024-04-22T19:58:49.786068+0000","last_fullsized":"2024-04-22T19:58:49.786068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":65,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783412+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783412+0000","last_peered":"2024-04-22T19:58:49.783412+0000","last_clean":"2024-04-22T19:58:49.783412+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783412+0000","last_undegraded":"2024-04-22T19:58:49.783412+0000","last_fullsized":"2024-04-22T19:58:49.783412+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725567+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725567+0000","last_peered":"2024-04-22T19:58:49.725567+0000","last_clean":"2024-04-22T19:58:49.725567+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725567+0000","last_undegraded":"2024-04-22T19:58:49.725567+0000","last_fullsized":"2024-04-22T19:58:49.725567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777636+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777636+0000","last_peered":"2024-04-22T19:58:49.777636+0000","last_clean":"2024-04-22T19:58:49.777636+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777636+0000","last_undegraded":"2024-04-22T19:58:49.777636+0000","last_fullsized":"2024-04-22T19:58:49.777636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727174+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727174+0000","last_peered":"2024-04-22T19:58:49.727174+0000","last_clean":"2024-04-22T19:58:49.727174+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727174+0000","last_undegraded":"2024-04-22T19:58:49.727174+0000","last_fullsized":"2024-04-22T19:58:49.727174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":355,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617798+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617798+0000","last_peered":"2024-04-22T19:58:50.617798+0000","last_clean":"2024-04-22T19:58:50.617798+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617798+0000","last_undegraded":"2024-04-22T19:58:50.617798+0000","last_fullsized":"2024-04-22T19:58:50.617798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":321,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869764+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869764+0000","last_peered":"2024-04-22T19:58:51.869764+0000","last_clean":"2024-04-22T19:58:51.869764+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869764+0000","last_undegraded":"2024-04-22T19:58:51.869764+0000","last_fullsized":"2024-04-22T19:58:51.869764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780689+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780689+0000","last_peered":"2024-04-22T19:58:49.780689+0000","last_clean":"2024-04-22T19:58:49.780689+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780689+0000","last_undegraded":"2024-04-22T19:58:49.780689+0000","last_fullsized":"2024-04-22T19:58:49.780689+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720534+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720534+0000","last_peered":"2024-04-22T19:58:49.720534+0000","last_clean":"2024-04-22T19:58:49.720534+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720534+0000","last_undegraded":"2024-04-22T19:58:49.720534+0000","last_fullsized":"2024-04-22T19:58:49.720534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779059+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779059+0000","last_peered":"2024-04-22T19:58:49.779059+0000","last_clean":"2024-04-22T19:58:49.779059+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779059+0000","last_undegraded":"2024-04-22T19:58:49.779059+0000","last_fullsized":"2024-04-22T19:58:49.779059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777547+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777547+0000","last_peered":"2024-04-22T19:58:49.777547+0000","last_clean":"2024-04-22T19:58:49.777547+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777547+0000","last_undegraded":"2024-04-22T19:58:49.777547+0000","last_fullsized":"2024-04-22T19:58:49.777547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830214+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830214+0000","last_peered":"2024-04-22T19:58:53.830214+0000","last_clean":"2024-04-22T19:58:53.830214+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830214+0000","last_undegraded":"2024-04-22T19:58:53.830214+0000","last_fullsized":"2024-04-22T19:58:53.830214+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782025+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782025+0000","last_peered":"2024-04-22T19:58:49.782025+0000","last_clean":"2024-04-22T19:58:49.782025+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782025+0000","last_undegraded":"2024-04-22T19:58:49.782025+0000","last_fullsized":"2024-04-22T19:58:49.782025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779347+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779347+0000","last_peered":"2024-04-22T19:58:49.779347+0000","last_clean":"2024-04-22T19:58:49.779347+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779347+0000","last_undegraded":"2024-04-22T19:58:49.779347+0000","last_fullsized":"2024-04-22T19:58:49.779347+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T19:59:40.360 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T19:59:40.360 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:00:00.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:00:00.722 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:00:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:00:00.748 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-22T19:59:59.485309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007496"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731541+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731541+0000","last_peered":"2024-04-22T19:58:49.731541+0000","last_clean":"2024-04-22T19:58:49.731541+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731541+0000","last_undegraded":"2024-04-22T19:58:49.731541+0000","last_fullsized":"2024-04-22T19:58:49.731541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723496+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723496+0000","last_peered":"2024-04-22T19:58:49.723496+0000","last_clean":"2024-04-22T19:58:49.723496+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723496+0000","last_undegraded":"2024-04-22T19:58:49.723496+0000","last_fullsized":"2024-04-22T19:58:49.723496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724878+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.724878+0000","last_peered":"2024-04-22T19:58:49.724878+0000","last_clean":"2024-04-22T19:58:49.724878+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.724878+0000","last_undegraded":"2024-04-22T19:58:49.724878+0000","last_fullsized":"2024-04-22T19:58:49.724878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":346,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601548+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601548+0000","last_peered":"2024-04-22T19:58:52.601548+0000","last_clean":"2024-04-22T19:58:52.601548+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601548+0000","last_undegraded":"2024-04-22T19:58:52.601548+0000","last_fullsized":"2024-04-22T19:58:52.601548+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780835+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780835+0000","last_peered":"2024-04-22T19:58:49.780835+0000","last_clean":"2024-04-22T19:58:49.780835+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780835+0000","last_undegraded":"2024-04-22T19:58:49.780835+0000","last_fullsized":"2024-04-22T19:58:49.780835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719945+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.719945+0000","last_peered":"2024-04-22T19:58:49.719945+0000","last_clean":"2024-04-22T19:58:49.719945+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.719945+0000","last_undegraded":"2024-04-22T19:58:49.719945+0000","last_fullsized":"2024-04-22T19:58:49.719945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783599+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783599+0000","last_peered":"2024-04-22T19:58:49.783599+0000","last_clean":"2024-04-22T19:58:49.783599+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783599+0000","last_undegraded":"2024-04-22T19:58:49.783599+0000","last_fullsized":"2024-04-22T19:58:49.783599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729758+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729758+0000","last_peered":"2024-04-22T19:58:49.729758+0000","last_clean":"2024-04-22T19:58:49.729758+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729758+0000","last_undegraded":"2024-04-22T19:58:49.729758+0000","last_fullsized":"2024-04-22T19:58:49.729758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":119,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781037+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781037+0000","last_peered":"2024-04-22T19:58:49.781037+0000","last_clean":"2024-04-22T19:58:49.781037+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781037+0000","last_undegraded":"2024-04-22T19:58:49.781037+0000","last_fullsized":"2024-04-22T19:58:49.781037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":57,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780534+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780534+0000","last_peered":"2024-04-22T19:58:49.780534+0000","last_clean":"2024-04-22T19:58:49.780534+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780534+0000","last_undegraded":"2024-04-22T19:58:49.780534+0000","last_fullsized":"2024-04-22T19:58:49.780534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780804+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780804+0000","last_peered":"2024-04-22T19:58:49.780804+0000","last_clean":"2024-04-22T19:58:49.780804+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780804+0000","last_undegraded":"2024-04-22T19:58:49.780804+0000","last_fullsized":"2024-04-22T19:58:49.780804+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787663+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787663+0000","last_peered":"2024-04-22T19:58:49.787663+0000","last_clean":"2024-04-22T19:58:49.787663+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787663+0000","last_undegraded":"2024-04-22T19:58:49.787663+0000","last_fullsized":"2024-04-22T19:58:49.787663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823685+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823685+0000","last_peered":"2024-04-22T19:58:54.823685+0000","last_clean":"2024-04-22T19:58:54.823685+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823685+0000","last_undegraded":"2024-04-22T19:58:54.823685+0000","last_fullsized":"2024-04-22T19:58:54.823685+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872313+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872313+0000","last_peered":"2024-04-22T19:58:52.872313+0000","last_clean":"2024-04-22T19:58:52.872313+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872313+0000","last_undegraded":"2024-04-22T19:58:52.872313+0000","last_fullsized":"2024-04-22T19:58:52.872313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781853+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781853+0000","last_peered":"2024-04-22T19:58:49.781853+0000","last_clean":"2024-04-22T19:58:49.781853+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781853+0000","last_undegraded":"2024-04-22T19:58:49.781853+0000","last_fullsized":"2024-04-22T19:58:49.781853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":71,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780377+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780377+0000","last_peered":"2024-04-22T19:58:49.780377+0000","last_clean":"2024-04-22T19:58:49.780377+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780377+0000","last_undegraded":"2024-04-22T19:58:49.780377+0000","last_fullsized":"2024-04-22T19:58:49.780377+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780682+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780682+0000","last_peered":"2024-04-22T19:58:49.780682+0000","last_clean":"2024-04-22T19:58:49.780682+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780682+0000","last_undegraded":"2024-04-22T19:58:49.780682+0000","last_fullsized":"2024-04-22T19:58:49.780682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779291+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779291+0000","last_peered":"2024-04-22T19:58:49.779291+0000","last_clean":"2024-04-22T19:58:49.779291+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779291+0000","last_undegraded":"2024-04-22T19:58:49.779291+0000","last_fullsized":"2024-04-22T19:58:49.779291+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721118+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721118+0000","last_peered":"2024-04-22T19:58:49.721118+0000","last_clean":"2024-04-22T19:58:49.721118+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721118+0000","last_undegraded":"2024-04-22T19:58:49.721118+0000","last_fullsized":"2024-04-22T19:58:49.721118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781338+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781338+0000","last_peered":"2024-04-22T19:58:49.781338+0000","last_clean":"2024-04-22T19:58:49.781338+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781338+0000","last_undegraded":"2024-04-22T19:58:49.781338+0000","last_fullsized":"2024-04-22T19:58:49.781338+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719088+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719088+0000","last_peered":"2024-04-22T19:58:49.719088+0000","last_clean":"2024-04-22T19:58:49.719088+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719088+0000","last_undegraded":"2024-04-22T19:58:49.719088+0000","last_fullsized":"2024-04-22T19:58:49.719088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720449+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720449+0000","last_peered":"2024-04-22T19:58:49.720449+0000","last_clean":"2024-04-22T19:58:49.720449+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720449+0000","last_undegraded":"2024-04-22T19:58:49.720449+0000","last_fullsized":"2024-04-22T19:58:49.720449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784604+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784604+0000","last_peered":"2024-04-22T19:58:49.784604+0000","last_clean":"2024-04-22T19:58:49.784604+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784604+0000","last_undegraded":"2024-04-22T19:58:49.784604+0000","last_fullsized":"2024-04-22T19:58:49.784604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729417+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729417+0000","last_peered":"2024-04-22T19:58:49.729417+0000","last_clean":"2024-04-22T19:58:49.729417+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729417+0000","last_undegraded":"2024-04-22T19:58:49.729417+0000","last_fullsized":"2024-04-22T19:58:49.729417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781330+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781330+0000","last_peered":"2024-04-22T19:58:49.781330+0000","last_clean":"2024-04-22T19:58:49.781330+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781330+0000","last_undegraded":"2024-04-22T19:58:49.781330+0000","last_fullsized":"2024-04-22T19:58:49.781330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730754+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730754+0000","last_peered":"2024-04-22T19:58:49.730754+0000","last_clean":"2024-04-22T19:58:49.730754+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730754+0000","last_undegraded":"2024-04-22T19:58:49.730754+0000","last_fullsized":"2024-04-22T19:58:49.730754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729191+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729191+0000","last_peered":"2024-04-22T19:58:49.729191+0000","last_clean":"2024-04-22T19:58:49.729191+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729191+0000","last_undegraded":"2024-04-22T19:58:49.729191+0000","last_fullsized":"2024-04-22T19:58:49.729191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718683+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718683+0000","last_peered":"2024-04-22T19:58:49.718683+0000","last_clean":"2024-04-22T19:58:49.718683+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718683+0000","last_undegraded":"2024-04-22T19:58:49.718683+0000","last_fullsized":"2024-04-22T19:58:49.718683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":502,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721010+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721010+0000","last_peered":"2024-04-22T19:58:49.721010+0000","last_clean":"2024-04-22T19:58:49.721010+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721010+0000","last_undegraded":"2024-04-22T19:58:49.721010+0000","last_fullsized":"2024-04-22T19:58:49.721010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730730+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730730+0000","last_peered":"2024-04-22T19:58:49.730730+0000","last_clean":"2024-04-22T19:58:49.730730+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730730+0000","last_undegraded":"2024-04-22T19:58:49.730730+0000","last_fullsized":"2024-04-22T19:58:49.730730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727602+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727602+0000","last_peered":"2024-04-22T19:58:49.727602+0000","last_clean":"2024-04-22T19:58:49.727602+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727602+0000","last_undegraded":"2024-04-22T19:58:49.727602+0000","last_fullsized":"2024-04-22T19:58:49.727602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720312+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720312+0000","last_peered":"2024-04-22T19:58:49.720312+0000","last_clean":"2024-04-22T19:58:49.720312+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720312+0000","last_undegraded":"2024-04-22T19:58:49.720312+0000","last_fullsized":"2024-04-22T19:58:49.720312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731405+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731405+0000","last_peered":"2024-04-22T19:58:49.731405+0000","last_clean":"2024-04-22T19:58:49.731405+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731405+0000","last_undegraded":"2024-04-22T19:58:49.731405+0000","last_fullsized":"2024-04-22T19:58:49.731405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723224+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723224+0000","last_peered":"2024-04-22T19:58:49.723224+0000","last_clean":"2024-04-22T19:58:49.723224+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723224+0000","last_undegraded":"2024-04-22T19:58:49.723224+0000","last_fullsized":"2024-04-22T19:58:49.723224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783588+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783588+0000","last_peered":"2024-04-22T19:58:49.783588+0000","last_clean":"2024-04-22T19:58:49.783588+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783588+0000","last_undegraded":"2024-04-22T19:58:49.783588+0000","last_fullsized":"2024-04-22T19:58:49.783588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721496+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721496+0000","last_peered":"2024-04-22T19:58:49.721496+0000","last_clean":"2024-04-22T19:58:49.721496+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721496+0000","last_undegraded":"2024-04-22T19:58:49.721496+0000","last_fullsized":"2024-04-22T19:58:49.721496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781432+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781432+0000","last_peered":"2024-04-22T19:58:49.781432+0000","last_clean":"2024-04-22T19:58:49.781432+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781432+0000","last_undegraded":"2024-04-22T19:58:49.781432+0000","last_fullsized":"2024-04-22T19:58:49.781432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719583+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719583+0000","last_peered":"2024-04-22T19:58:49.719583+0000","last_clean":"2024-04-22T19:58:49.719583+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719583+0000","last_undegraded":"2024-04-22T19:58:49.719583+0000","last_fullsized":"2024-04-22T19:58:49.719583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724455+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724455+0000","last_peered":"2024-04-22T19:58:49.724455+0000","last_clean":"2024-04-22T19:58:49.724455+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724455+0000","last_undegraded":"2024-04-22T19:58:49.724455+0000","last_fullsized":"2024-04-22T19:58:49.724455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720782+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720782+0000","last_peered":"2024-04-22T19:58:49.720782+0000","last_clean":"2024-04-22T19:58:49.720782+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720782+0000","last_undegraded":"2024-04-22T19:58:49.720782+0000","last_fullsized":"2024-04-22T19:58:49.720782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":330,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783618+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.783618+0000","last_peered":"2024-04-22T19:58:49.783618+0000","last_clean":"2024-04-22T19:58:49.783618+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.783618+0000","last_undegraded":"2024-04-22T19:58:49.783618+0000","last_fullsized":"2024-04-22T19:58:49.783618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721832+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721832+0000","last_peered":"2024-04-22T19:58:49.721832+0000","last_clean":"2024-04-22T19:58:49.721832+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721832+0000","last_undegraded":"2024-04-22T19:58:49.721832+0000","last_fullsized":"2024-04-22T19:58:49.721832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720710+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720710+0000","last_peered":"2024-04-22T19:58:49.720710+0000","last_clean":"2024-04-22T19:58:49.720710+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720710+0000","last_undegraded":"2024-04-22T19:58:49.720710+0000","last_fullsized":"2024-04-22T19:58:49.720710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":344,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839417+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839417+0000","last_peered":"2024-04-22T19:58:52.839417+0000","last_clean":"2024-04-22T19:58:52.839417+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839417+0000","last_undegraded":"2024-04-22T19:58:52.839417+0000","last_fullsized":"2024-04-22T19:58:52.839417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718286+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718286+0000","last_peered":"2024-04-22T19:58:49.718286+0000","last_clean":"2024-04-22T19:58:49.718286+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718286+0000","last_undegraded":"2024-04-22T19:58:49.718286+0000","last_fullsized":"2024-04-22T19:58:49.718286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721932+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.721932+0000","last_peered":"2024-04-22T19:58:49.721932+0000","last_clean":"2024-04-22T19:58:49.721932+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.721932+0000","last_undegraded":"2024-04-22T19:58:49.721932+0000","last_fullsized":"2024-04-22T19:58:49.721932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721550+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721550+0000","last_peered":"2024-04-22T19:58:49.721550+0000","last_clean":"2024-04-22T19:58:49.721550+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721550+0000","last_undegraded":"2024-04-22T19:58:49.721550+0000","last_fullsized":"2024-04-22T19:58:49.721550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732345+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732345+0000","last_peered":"2024-04-22T19:58:49.732345+0000","last_clean":"2024-04-22T19:58:49.732345+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732345+0000","last_undegraded":"2024-04-22T19:58:49.732345+0000","last_fullsized":"2024-04-22T19:58:49.732345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778555+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778555+0000","last_peered":"2024-04-22T19:58:49.778555+0000","last_clean":"2024-04-22T19:58:49.778555+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778555+0000","last_undegraded":"2024-04-22T19:58:49.778555+0000","last_fullsized":"2024-04-22T19:58:49.778555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720604+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720604+0000","last_peered":"2024-04-22T19:58:49.720604+0000","last_clean":"2024-04-22T19:58:49.720604+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720604+0000","last_undegraded":"2024-04-22T19:58:49.720604+0000","last_fullsized":"2024-04-22T19:58:49.720604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779173+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779173+0000","last_peered":"2024-04-22T19:58:49.779173+0000","last_clean":"2024-04-22T19:58:49.779173+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779173+0000","last_undegraded":"2024-04-22T19:58:49.779173+0000","last_fullsized":"2024-04-22T19:58:49.779173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787784+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787784+0000","last_peered":"2024-04-22T19:58:49.787784+0000","last_clean":"2024-04-22T19:58:49.787784+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787784+0000","last_undegraded":"2024-04-22T19:58:49.787784+0000","last_fullsized":"2024-04-22T19:58:49.787784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723749+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723749+0000","last_peered":"2024-04-22T19:58:49.723749+0000","last_clean":"2024-04-22T19:58:49.723749+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723749+0000","last_undegraded":"2024-04-22T19:58:49.723749+0000","last_fullsized":"2024-04-22T19:58:49.723749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718541+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718541+0000","last_peered":"2024-04-22T19:58:49.718541+0000","last_clean":"2024-04-22T19:58:49.718541+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718541+0000","last_undegraded":"2024-04-22T19:58:49.718541+0000","last_fullsized":"2024-04-22T19:58:49.718541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121450+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121450+0000","last_peered":"2024-04-22T19:58:53.121450+0000","last_clean":"2024-04-22T19:58:53.121450+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121450+0000","last_undegraded":"2024-04-22T19:58:53.121450+0000","last_fullsized":"2024-04-22T19:58:53.121450+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718933+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.718933+0000","last_peered":"2024-04-22T19:58:49.718933+0000","last_clean":"2024-04-22T19:58:49.718933+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.718933+0000","last_undegraded":"2024-04-22T19:58:49.718933+0000","last_fullsized":"2024-04-22T19:58:49.718933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786532+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786532+0000","last_peered":"2024-04-22T19:58:49.786532+0000","last_clean":"2024-04-22T19:58:49.786532+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786532+0000","last_undegraded":"2024-04-22T19:58:49.786532+0000","last_fullsized":"2024-04-22T19:58:49.786532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729934+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.729934+0000","last_peered":"2024-04-22T19:58:49.729934+0000","last_clean":"2024-04-22T19:58:49.729934+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.729934+0000","last_undegraded":"2024-04-22T19:58:49.729934+0000","last_fullsized":"2024-04-22T19:58:49.729934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724558+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724558+0000","last_peered":"2024-04-22T19:58:49.724558+0000","last_clean":"2024-04-22T19:58:49.724558+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724558+0000","last_undegraded":"2024-04-22T19:58:49.724558+0000","last_fullsized":"2024-04-22T19:58:49.724558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778645+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778645+0000","last_peered":"2024-04-22T19:58:49.778645+0000","last_clean":"2024-04-22T19:58:49.778645+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778645+0000","last_undegraded":"2024-04-22T19:58:49.778645+0000","last_fullsized":"2024-04-22T19:58:49.778645+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778759+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.778759+0000","last_peered":"2024-04-22T19:58:49.778759+0000","last_clean":"2024-04-22T19:58:49.778759+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.778759+0000","last_undegraded":"2024-04-22T19:58:49.778759+0000","last_fullsized":"2024-04-22T19:58:49.778759+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821923+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821923+0000","last_peered":"2024-04-22T19:58:49.821923+0000","last_clean":"2024-04-22T19:58:49.821923+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821923+0000","last_undegraded":"2024-04-22T19:58:49.821923+0000","last_fullsized":"2024-04-22T19:58:49.821923+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":63,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779928+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.779928+0000","last_peered":"2024-04-22T19:58:49.779928+0000","last_clean":"2024-04-22T19:58:49.779928+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.779928+0000","last_undegraded":"2024-04-22T19:58:49.779928+0000","last_fullsized":"2024-04-22T19:58:49.779928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780038+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780038+0000","last_peered":"2024-04-22T19:58:49.780038+0000","last_clean":"2024-04-22T19:58:49.780038+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780038+0000","last_undegraded":"2024-04-22T19:58:49.780038+0000","last_fullsized":"2024-04-22T19:58:49.780038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871288+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871288+0000","last_peered":"2024-04-22T19:58:50.871288+0000","last_clean":"2024-04-22T19:58:50.871288+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871288+0000","last_undegraded":"2024-04-22T19:58:50.871288+0000","last_fullsized":"2024-04-22T19:58:50.871288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786110+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786110+0000","last_peered":"2024-04-22T19:58:49.786110+0000","last_clean":"2024-04-22T19:58:49.786110+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786110+0000","last_undegraded":"2024-04-22T19:58:49.786110+0000","last_fullsized":"2024-04-22T19:58:49.786110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778754+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778754+0000","last_peered":"2024-04-22T19:58:49.778754+0000","last_clean":"2024-04-22T19:58:49.778754+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778754+0000","last_undegraded":"2024-04-22T19:58:49.778754+0000","last_fullsized":"2024-04-22T19:58:49.778754+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725097+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725097+0000","last_peered":"2024-04-22T19:58:49.725097+0000","last_clean":"2024-04-22T19:58:49.725097+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725097+0000","last_undegraded":"2024-04-22T19:58:49.725097+0000","last_fullsized":"2024-04-22T19:58:49.725097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781288+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781288+0000","last_peered":"2024-04-22T19:58:49.781288+0000","last_clean":"2024-04-22T19:58:49.781288+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781288+0000","last_undegraded":"2024-04-22T19:58:49.781288+0000","last_fullsized":"2024-04-22T19:58:49.781288+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725322+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725322+0000","last_peered":"2024-04-22T19:58:49.725322+0000","last_clean":"2024-04-22T19:58:49.725322+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725322+0000","last_undegraded":"2024-04-22T19:58:49.725322+0000","last_fullsized":"2024-04-22T19:58:49.725322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785674+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785674+0000","last_peered":"2024-04-22T19:58:49.785674+0000","last_clean":"2024-04-22T19:58:49.785674+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785674+0000","last_undegraded":"2024-04-22T19:58:49.785674+0000","last_fullsized":"2024-04-22T19:58:49.785674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":55,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779798+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779798+0000","last_peered":"2024-04-22T19:58:49.779798+0000","last_clean":"2024-04-22T19:58:49.779798+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779798+0000","last_undegraded":"2024-04-22T19:58:49.779798+0000","last_fullsized":"2024-04-22T19:58:49.779798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722388+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722388+0000","last_peered":"2024-04-22T19:58:49.722388+0000","last_clean":"2024-04-22T19:58:49.722388+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722388+0000","last_undegraded":"2024-04-22T19:58:49.722388+0000","last_fullsized":"2024-04-22T19:58:49.722388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719954+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.719954+0000","last_peered":"2024-04-22T19:58:49.719954+0000","last_clean":"2024-04-22T19:58:49.719954+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.719954+0000","last_undegraded":"2024-04-22T19:58:49.719954+0000","last_fullsized":"2024-04-22T19:58:49.719954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":434,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784959+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.784959+0000","last_peered":"2024-04-22T19:58:49.784959+0000","last_clean":"2024-04-22T19:58:49.784959+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.784959+0000","last_undegraded":"2024-04-22T19:58:49.784959+0000","last_fullsized":"2024-04-22T19:58:49.784959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":67,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778294+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778294+0000","last_peered":"2024-04-22T19:58:49.778294+0000","last_clean":"2024-04-22T19:58:49.778294+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778294+0000","last_undegraded":"2024-04-22T19:58:49.778294+0000","last_fullsized":"2024-04-22T19:58:49.778294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":65,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783412+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783412+0000","last_peered":"2024-04-22T19:58:49.783412+0000","last_clean":"2024-04-22T19:58:49.783412+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783412+0000","last_undegraded":"2024-04-22T19:58:49.783412+0000","last_fullsized":"2024-04-22T19:58:49.783412+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725567+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725567+0000","last_peered":"2024-04-22T19:58:49.725567+0000","last_clean":"2024-04-22T19:58:49.725567+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725567+0000","last_undegraded":"2024-04-22T19:58:49.725567+0000","last_fullsized":"2024-04-22T19:58:49.725567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777636+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777636+0000","last_peered":"2024-04-22T19:58:49.777636+0000","last_clean":"2024-04-22T19:58:49.777636+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777636+0000","last_undegraded":"2024-04-22T19:58:49.777636+0000","last_fullsized":"2024-04-22T19:58:49.777636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727174+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727174+0000","last_peered":"2024-04-22T19:58:49.727174+0000","last_clean":"2024-04-22T19:58:49.727174+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727174+0000","last_undegraded":"2024-04-22T19:58:49.727174+0000","last_fullsized":"2024-04-22T19:58:49.727174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":355,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617798+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617798+0000","last_peered":"2024-04-22T19:58:50.617798+0000","last_clean":"2024-04-22T19:58:50.617798+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617798+0000","last_undegraded":"2024-04-22T19:58:50.617798+0000","last_fullsized":"2024-04-22T19:58:50.617798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":321,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869764+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869764+0000","last_peered":"2024-04-22T19:58:51.869764+0000","last_clean":"2024-04-22T19:58:51.869764+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869764+0000","last_undegraded":"2024-04-22T19:58:51.869764+0000","last_fullsized":"2024-04-22T19:58:51.869764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720534+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720534+0000","last_peered":"2024-04-22T19:58:49.720534+0000","last_clean":"2024-04-22T19:58:49.720534+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720534+0000","last_undegraded":"2024-04-22T19:58:49.720534+0000","last_fullsized":"2024-04-22T19:58:49.720534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777547+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777547+0000","last_peered":"2024-04-22T19:58:49.777547+0000","last_clean":"2024-04-22T19:58:49.777547+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777547+0000","last_undegraded":"2024-04-22T19:58:49.777547+0000","last_fullsized":"2024-04-22T19:58:49.777547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782025+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782025+0000","last_peered":"2024-04-22T19:58:49.782025+0000","last_clean":"2024-04-22T19:58:49.782025+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782025+0000","last_undegraded":"2024-04-22T19:58:49.782025+0000","last_fullsized":"2024-04-22T19:58:49.782025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":51,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779347+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779347+0000","last_peered":"2024-04-22T19:58:49.779347+0000","last_clean":"2024-04-22T19:58:49.779347+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779347+0000","last_undegraded":"2024-04-22T19:58:49.779347+0000","last_fullsized":"2024-04-22T19:58:49.779347+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:00:00.761 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T20:00:00.762 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:00:20.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:00:21.115 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:00:21.121 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:00:21.138 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-04-22T20:00:19.496138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006856"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731541+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731541+0000","last_peered":"2024-04-22T19:58:49.731541+0000","last_clean":"2024-04-22T19:58:49.731541+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731541+0000","last_undegraded":"2024-04-22T19:58:49.731541+0000","last_fullsized":"2024-04-22T19:58:49.731541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723496+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723496+0000","last_peered":"2024-04-22T19:58:49.723496+0000","last_clean":"2024-04-22T19:58:49.723496+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723496+0000","last_undegraded":"2024-04-22T19:58:49.723496+0000","last_fullsized":"2024-04-22T19:58:49.723496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724878+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.724878+0000","last_peered":"2024-04-22T19:58:49.724878+0000","last_clean":"2024-04-22T19:58:49.724878+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.724878+0000","last_undegraded":"2024-04-22T19:58:49.724878+0000","last_fullsized":"2024-04-22T19:58:49.724878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":347,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601604+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601604+0000","last_peered":"2024-04-22T19:58:52.601604+0000","last_clean":"2024-04-22T19:58:52.601604+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601604+0000","last_undegraded":"2024-04-22T19:58:52.601604+0000","last_fullsized":"2024-04-22T19:58:52.601604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780957+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780957+0000","last_peered":"2024-04-22T19:58:49.780957+0000","last_clean":"2024-04-22T19:58:49.780957+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780957+0000","last_undegraded":"2024-04-22T19:58:49.780957+0000","last_fullsized":"2024-04-22T19:58:49.780957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719945+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.719945+0000","last_peered":"2024-04-22T19:58:49.719945+0000","last_clean":"2024-04-22T19:58:49.719945+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.719945+0000","last_undegraded":"2024-04-22T19:58:49.719945+0000","last_fullsized":"2024-04-22T19:58:49.719945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783599+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783599+0000","last_peered":"2024-04-22T19:58:49.783599+0000","last_clean":"2024-04-22T19:58:49.783599+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783599+0000","last_undegraded":"2024-04-22T19:58:49.783599+0000","last_fullsized":"2024-04-22T19:58:49.783599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780819+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.780819+0000","last_peered":"2024-04-22T19:58:49.780819+0000","last_clean":"2024-04-22T19:58:49.780819+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.780819+0000","last_undegraded":"2024-04-22T19:58:49.780819+0000","last_fullsized":"2024-04-22T19:58:49.780819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729758+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729758+0000","last_peered":"2024-04-22T19:58:49.729758+0000","last_clean":"2024-04-22T19:58:49.729758+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729758+0000","last_undegraded":"2024-04-22T19:58:49.729758+0000","last_fullsized":"2024-04-22T19:58:49.729758+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781166+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781166+0000","last_peered":"2024-04-22T19:58:49.781166+0000","last_clean":"2024-04-22T19:58:49.781166+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781166+0000","last_undegraded":"2024-04-22T19:58:49.781166+0000","last_fullsized":"2024-04-22T19:58:49.781166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780652+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780652+0000","last_peered":"2024-04-22T19:58:49.780652+0000","last_clean":"2024-04-22T19:58:49.780652+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780652+0000","last_undegraded":"2024-04-22T19:58:49.780652+0000","last_fullsized":"2024-04-22T19:58:49.780652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":59,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780876+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780876+0000","last_peered":"2024-04-22T19:58:49.780876+0000","last_clean":"2024-04-22T19:58:49.780876+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780876+0000","last_undegraded":"2024-04-22T19:58:49.780876+0000","last_fullsized":"2024-04-22T19:58:49.780876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787770+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787770+0000","last_peered":"2024-04-22T19:58:49.787770+0000","last_clean":"2024-04-22T19:58:49.787770+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787770+0000","last_undegraded":"2024-04-22T19:58:49.787770+0000","last_fullsized":"2024-04-22T19:58:49.787770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823797+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823797+0000","last_peered":"2024-04-22T19:58:54.823797+0000","last_clean":"2024-04-22T19:58:54.823797+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823797+0000","last_undegraded":"2024-04-22T19:58:54.823797+0000","last_fullsized":"2024-04-22T19:58:54.823797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872374+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872374+0000","last_peered":"2024-04-22T19:58:52.872374+0000","last_clean":"2024-04-22T19:58:52.872374+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872374+0000","last_undegraded":"2024-04-22T19:58:52.872374+0000","last_fullsized":"2024-04-22T19:58:52.872374+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781853+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781853+0000","last_peered":"2024-04-22T19:58:49.781853+0000","last_clean":"2024-04-22T19:58:49.781853+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781853+0000","last_undegraded":"2024-04-22T19:58:49.781853+0000","last_fullsized":"2024-04-22T19:58:49.781853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780496+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780496+0000","last_peered":"2024-04-22T19:58:49.780496+0000","last_clean":"2024-04-22T19:58:49.780496+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780496+0000","last_undegraded":"2024-04-22T19:58:49.780496+0000","last_fullsized":"2024-04-22T19:58:49.780496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780682+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780682+0000","last_peered":"2024-04-22T19:58:49.780682+0000","last_clean":"2024-04-22T19:58:49.780682+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780682+0000","last_undegraded":"2024-04-22T19:58:49.780682+0000","last_fullsized":"2024-04-22T19:58:49.780682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779442+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779442+0000","last_peered":"2024-04-22T19:58:49.779442+0000","last_clean":"2024-04-22T19:58:49.779442+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779442+0000","last_undegraded":"2024-04-22T19:58:49.779442+0000","last_fullsized":"2024-04-22T19:58:49.779442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721118+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721118+0000","last_peered":"2024-04-22T19:58:49.721118+0000","last_clean":"2024-04-22T19:58:49.721118+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721118+0000","last_undegraded":"2024-04-22T19:58:49.721118+0000","last_fullsized":"2024-04-22T19:58:49.721118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":69,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781463+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781463+0000","last_peered":"2024-04-22T19:58:49.781463+0000","last_clean":"2024-04-22T19:58:49.781463+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781463+0000","last_undegraded":"2024-04-22T19:58:49.781463+0000","last_fullsized":"2024-04-22T19:58:49.781463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719088+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719088+0000","last_peered":"2024-04-22T19:58:49.719088+0000","last_clean":"2024-04-22T19:58:49.719088+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719088+0000","last_undegraded":"2024-04-22T19:58:49.719088+0000","last_fullsized":"2024-04-22T19:58:49.719088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720449+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720449+0000","last_peered":"2024-04-22T19:58:49.720449+0000","last_clean":"2024-04-22T19:58:49.720449+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720449+0000","last_undegraded":"2024-04-22T19:58:49.720449+0000","last_fullsized":"2024-04-22T19:58:49.720449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784604+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784604+0000","last_peered":"2024-04-22T19:58:49.784604+0000","last_clean":"2024-04-22T19:58:49.784604+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784604+0000","last_undegraded":"2024-04-22T19:58:49.784604+0000","last_fullsized":"2024-04-22T19:58:49.784604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729545+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729545+0000","last_peered":"2024-04-22T19:58:49.729545+0000","last_clean":"2024-04-22T19:58:49.729545+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729545+0000","last_undegraded":"2024-04-22T19:58:49.729545+0000","last_fullsized":"2024-04-22T19:58:49.729545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781330+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781330+0000","last_peered":"2024-04-22T19:58:49.781330+0000","last_clean":"2024-04-22T19:58:49.781330+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781330+0000","last_undegraded":"2024-04-22T19:58:49.781330+0000","last_fullsized":"2024-04-22T19:58:49.781330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730754+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730754+0000","last_peered":"2024-04-22T19:58:49.730754+0000","last_clean":"2024-04-22T19:58:49.730754+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730754+0000","last_undegraded":"2024-04-22T19:58:49.730754+0000","last_fullsized":"2024-04-22T19:58:49.730754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729291+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729291+0000","last_peered":"2024-04-22T19:58:49.729291+0000","last_clean":"2024-04-22T19:58:49.729291+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729291+0000","last_undegraded":"2024-04-22T19:58:49.729291+0000","last_fullsized":"2024-04-22T19:58:49.729291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718683+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718683+0000","last_peered":"2024-04-22T19:58:49.718683+0000","last_clean":"2024-04-22T19:58:49.718683+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718683+0000","last_undegraded":"2024-04-22T19:58:49.718683+0000","last_fullsized":"2024-04-22T19:58:49.718683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":502,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721010+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721010+0000","last_peered":"2024-04-22T19:58:49.721010+0000","last_clean":"2024-04-22T19:58:49.721010+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721010+0000","last_undegraded":"2024-04-22T19:58:49.721010+0000","last_fullsized":"2024-04-22T19:58:49.721010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730730+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730730+0000","last_peered":"2024-04-22T19:58:49.730730+0000","last_clean":"2024-04-22T19:58:49.730730+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730730+0000","last_undegraded":"2024-04-22T19:58:49.730730+0000","last_fullsized":"2024-04-22T19:58:49.730730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727710+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727710+0000","last_peered":"2024-04-22T19:58:49.727710+0000","last_clean":"2024-04-22T19:58:49.727710+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727710+0000","last_undegraded":"2024-04-22T19:58:49.727710+0000","last_fullsized":"2024-04-22T19:58:49.727710+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720445+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720445+0000","last_peered":"2024-04-22T19:58:49.720445+0000","last_clean":"2024-04-22T19:58:49.720445+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720445+0000","last_undegraded":"2024-04-22T19:58:49.720445+0000","last_fullsized":"2024-04-22T19:58:49.720445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731405+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731405+0000","last_peered":"2024-04-22T19:58:49.731405+0000","last_clean":"2024-04-22T19:58:49.731405+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731405+0000","last_undegraded":"2024-04-22T19:58:49.731405+0000","last_fullsized":"2024-04-22T19:58:49.731405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723224+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723224+0000","last_peered":"2024-04-22T19:58:49.723224+0000","last_clean":"2024-04-22T19:58:49.723224+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723224+0000","last_undegraded":"2024-04-22T19:58:49.723224+0000","last_fullsized":"2024-04-22T19:58:49.723224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783753+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783753+0000","last_peered":"2024-04-22T19:58:49.783753+0000","last_clean":"2024-04-22T19:58:49.783753+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783753+0000","last_undegraded":"2024-04-22T19:58:49.783753+0000","last_fullsized":"2024-04-22T19:58:49.783753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721496+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721496+0000","last_peered":"2024-04-22T19:58:49.721496+0000","last_clean":"2024-04-22T19:58:49.721496+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721496+0000","last_undegraded":"2024-04-22T19:58:49.721496+0000","last_fullsized":"2024-04-22T19:58:49.721496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781432+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781432+0000","last_peered":"2024-04-22T19:58:49.781432+0000","last_clean":"2024-04-22T19:58:49.781432+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781432+0000","last_undegraded":"2024-04-22T19:58:49.781432+0000","last_fullsized":"2024-04-22T19:58:49.781432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719583+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719583+0000","last_peered":"2024-04-22T19:58:49.719583+0000","last_clean":"2024-04-22T19:58:49.719583+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719583+0000","last_undegraded":"2024-04-22T19:58:49.719583+0000","last_fullsized":"2024-04-22T19:58:49.719583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724455+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724455+0000","last_peered":"2024-04-22T19:58:49.724455+0000","last_clean":"2024-04-22T19:58:49.724455+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724455+0000","last_undegraded":"2024-04-22T19:58:49.724455+0000","last_fullsized":"2024-04-22T19:58:49.724455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720782+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720782+0000","last_peered":"2024-04-22T19:58:49.720782+0000","last_clean":"2024-04-22T19:58:49.720782+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720782+0000","last_undegraded":"2024-04-22T19:58:49.720782+0000","last_fullsized":"2024-04-22T19:58:49.720782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":330,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783618+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.783618+0000","last_peered":"2024-04-22T19:58:49.783618+0000","last_clean":"2024-04-22T19:58:49.783618+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.783618+0000","last_undegraded":"2024-04-22T19:58:49.783618+0000","last_fullsized":"2024-04-22T19:58:49.783618+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721832+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721832+0000","last_peered":"2024-04-22T19:58:49.721832+0000","last_clean":"2024-04-22T19:58:49.721832+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721832+0000","last_undegraded":"2024-04-22T19:58:49.721832+0000","last_fullsized":"2024-04-22T19:58:49.721832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720710+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720710+0000","last_peered":"2024-04-22T19:58:49.720710+0000","last_clean":"2024-04-22T19:58:49.720710+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720710+0000","last_undegraded":"2024-04-22T19:58:49.720710+0000","last_fullsized":"2024-04-22T19:58:49.720710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839511+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839511+0000","last_peered":"2024-04-22T19:58:52.839511+0000","last_clean":"2024-04-22T19:58:52.839511+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839511+0000","last_undegraded":"2024-04-22T19:58:52.839511+0000","last_fullsized":"2024-04-22T19:58:52.839511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718286+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718286+0000","last_peered":"2024-04-22T19:58:49.718286+0000","last_clean":"2024-04-22T19:58:49.718286+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718286+0000","last_undegraded":"2024-04-22T19:58:49.718286+0000","last_fullsized":"2024-04-22T19:58:49.718286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721932+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.721932+0000","last_peered":"2024-04-22T19:58:49.721932+0000","last_clean":"2024-04-22T19:58:49.721932+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.721932+0000","last_undegraded":"2024-04-22T19:58:49.721932+0000","last_fullsized":"2024-04-22T19:58:49.721932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721550+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721550+0000","last_peered":"2024-04-22T19:58:49.721550+0000","last_clean":"2024-04-22T19:58:49.721550+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721550+0000","last_undegraded":"2024-04-22T19:58:49.721550+0000","last_fullsized":"2024-04-22T19:58:49.721550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732345+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732345+0000","last_peered":"2024-04-22T19:58:49.732345+0000","last_clean":"2024-04-22T19:58:49.732345+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732345+0000","last_undegraded":"2024-04-22T19:58:49.732345+0000","last_fullsized":"2024-04-22T19:58:49.732345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778555+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778555+0000","last_peered":"2024-04-22T19:58:49.778555+0000","last_clean":"2024-04-22T19:58:49.778555+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778555+0000","last_undegraded":"2024-04-22T19:58:49.778555+0000","last_fullsized":"2024-04-22T19:58:49.778555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720604+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720604+0000","last_peered":"2024-04-22T19:58:49.720604+0000","last_clean":"2024-04-22T19:58:49.720604+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720604+0000","last_undegraded":"2024-04-22T19:58:49.720604+0000","last_fullsized":"2024-04-22T19:58:49.720604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779173+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779173+0000","last_peered":"2024-04-22T19:58:49.779173+0000","last_clean":"2024-04-22T19:58:49.779173+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779173+0000","last_undegraded":"2024-04-22T19:58:49.779173+0000","last_fullsized":"2024-04-22T19:58:49.779173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787894+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787894+0000","last_peered":"2024-04-22T19:58:49.787894+0000","last_clean":"2024-04-22T19:58:49.787894+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787894+0000","last_undegraded":"2024-04-22T19:58:49.787894+0000","last_fullsized":"2024-04-22T19:58:49.787894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723749+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723749+0000","last_peered":"2024-04-22T19:58:49.723749+0000","last_clean":"2024-04-22T19:58:49.723749+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723749+0000","last_undegraded":"2024-04-22T19:58:49.723749+0000","last_fullsized":"2024-04-22T19:58:49.723749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718541+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718541+0000","last_peered":"2024-04-22T19:58:49.718541+0000","last_clean":"2024-04-22T19:58:49.718541+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718541+0000","last_undegraded":"2024-04-22T19:58:49.718541+0000","last_fullsized":"2024-04-22T19:58:49.718541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121450+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121450+0000","last_peered":"2024-04-22T19:58:53.121450+0000","last_clean":"2024-04-22T19:58:53.121450+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121450+0000","last_undegraded":"2024-04-22T19:58:53.121450+0000","last_fullsized":"2024-04-22T19:58:53.121450+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718933+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.718933+0000","last_peered":"2024-04-22T19:58:49.718933+0000","last_clean":"2024-04-22T19:58:49.718933+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.718933+0000","last_undegraded":"2024-04-22T19:58:49.718933+0000","last_fullsized":"2024-04-22T19:58:49.718933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786532+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786532+0000","last_peered":"2024-04-22T19:58:49.786532+0000","last_clean":"2024-04-22T19:58:49.786532+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786532+0000","last_undegraded":"2024-04-22T19:58:49.786532+0000","last_fullsized":"2024-04-22T19:58:49.786532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729934+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.729934+0000","last_peered":"2024-04-22T19:58:49.729934+0000","last_clean":"2024-04-22T19:58:49.729934+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.729934+0000","last_undegraded":"2024-04-22T19:58:49.729934+0000","last_fullsized":"2024-04-22T19:58:49.729934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724558+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724558+0000","last_peered":"2024-04-22T19:58:49.724558+0000","last_clean":"2024-04-22T19:58:49.724558+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724558+0000","last_undegraded":"2024-04-22T19:58:49.724558+0000","last_fullsized":"2024-04-22T19:58:49.724558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778734+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778734+0000","last_peered":"2024-04-22T19:58:49.778734+0000","last_clean":"2024-04-22T19:58:49.778734+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778734+0000","last_undegraded":"2024-04-22T19:58:49.778734+0000","last_fullsized":"2024-04-22T19:58:49.778734+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781767+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.781767+0000","last_peered":"2024-04-22T19:58:49.781767+0000","last_clean":"2024-04-22T19:58:49.781767+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.781767+0000","last_undegraded":"2024-04-22T19:58:49.781767+0000","last_fullsized":"2024-04-22T19:58:49.781767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821961+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821961+0000","last_peered":"2024-04-22T19:58:49.821961+0000","last_clean":"2024-04-22T19:58:49.821961+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821961+0000","last_undegraded":"2024-04-22T19:58:49.821961+0000","last_fullsized":"2024-04-22T19:58:49.821961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780035+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.780035+0000","last_peered":"2024-04-22T19:58:49.780035+0000","last_clean":"2024-04-22T19:58:49.780035+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.780035+0000","last_undegraded":"2024-04-22T19:58:49.780035+0000","last_fullsized":"2024-04-22T19:58:49.780035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780166+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780166+0000","last_peered":"2024-04-22T19:58:49.780166+0000","last_clean":"2024-04-22T19:58:49.780166+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780166+0000","last_undegraded":"2024-04-22T19:58:49.780166+0000","last_fullsized":"2024-04-22T19:58:49.780166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871339+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871339+0000","last_peered":"2024-04-22T19:58:50.871339+0000","last_clean":"2024-04-22T19:58:50.871339+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871339+0000","last_undegraded":"2024-04-22T19:58:50.871339+0000","last_fullsized":"2024-04-22T19:58:50.871339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786110+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786110+0000","last_peered":"2024-04-22T19:58:49.786110+0000","last_clean":"2024-04-22T19:58:49.786110+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786110+0000","last_undegraded":"2024-04-22T19:58:49.786110+0000","last_fullsized":"2024-04-22T19:58:49.786110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778906+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778906+0000","last_peered":"2024-04-22T19:58:49.778906+0000","last_clean":"2024-04-22T19:58:49.778906+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778906+0000","last_undegraded":"2024-04-22T19:58:49.778906+0000","last_fullsized":"2024-04-22T19:58:49.778906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725206+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725206+0000","last_peered":"2024-04-22T19:58:49.725206+0000","last_clean":"2024-04-22T19:58:49.725206+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725206+0000","last_undegraded":"2024-04-22T19:58:49.725206+0000","last_fullsized":"2024-04-22T19:58:49.725206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781415+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781415+0000","last_peered":"2024-04-22T19:58:49.781415+0000","last_clean":"2024-04-22T19:58:49.781415+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781415+0000","last_undegraded":"2024-04-22T19:58:49.781415+0000","last_fullsized":"2024-04-22T19:58:49.781415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725477+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725477+0000","last_peered":"2024-04-22T19:58:49.725477+0000","last_clean":"2024-04-22T19:58:49.725477+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725477+0000","last_undegraded":"2024-04-22T19:58:49.725477+0000","last_fullsized":"2024-04-22T19:58:49.725477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785674+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785674+0000","last_peered":"2024-04-22T19:58:49.785674+0000","last_clean":"2024-04-22T19:58:49.785674+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785674+0000","last_undegraded":"2024-04-22T19:58:49.785674+0000","last_fullsized":"2024-04-22T19:58:49.785674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779914+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779914+0000","last_peered":"2024-04-22T19:58:49.779914+0000","last_clean":"2024-04-22T19:58:49.779914+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779914+0000","last_undegraded":"2024-04-22T19:58:49.779914+0000","last_fullsized":"2024-04-22T19:58:49.779914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722388+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722388+0000","last_peered":"2024-04-22T19:58:49.722388+0000","last_clean":"2024-04-22T19:58:49.722388+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722388+0000","last_undegraded":"2024-04-22T19:58:49.722388+0000","last_fullsized":"2024-04-22T19:58:49.722388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720078+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.720078+0000","last_peered":"2024-04-22T19:58:49.720078+0000","last_clean":"2024-04-22T19:58:49.720078+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.720078+0000","last_undegraded":"2024-04-22T19:58:49.720078+0000","last_fullsized":"2024-04-22T19:58:49.720078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":434,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784959+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.784959+0000","last_peered":"2024-04-22T19:58:49.784959+0000","last_clean":"2024-04-22T19:58:49.784959+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.784959+0000","last_undegraded":"2024-04-22T19:58:49.784959+0000","last_fullsized":"2024-04-22T19:58:49.784959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779236+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779236+0000","last_peered":"2024-04-22T19:58:49.779236+0000","last_clean":"2024-04-22T19:58:49.779236+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779236+0000","last_undegraded":"2024-04-22T19:58:49.779236+0000","last_fullsized":"2024-04-22T19:58:49.779236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778873+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778873+0000","last_peered":"2024-04-22T19:58:49.778873+0000","last_clean":"2024-04-22T19:58:49.778873+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778873+0000","last_undegraded":"2024-04-22T19:58:49.778873+0000","last_fullsized":"2024-04-22T19:58:49.778873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":66,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783540+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783540+0000","last_peered":"2024-04-22T19:58:49.783540+0000","last_clean":"2024-04-22T19:58:49.783540+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783540+0000","last_undegraded":"2024-04-22T19:58:49.783540+0000","last_fullsized":"2024-04-22T19:58:49.783540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725567+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725567+0000","last_peered":"2024-04-22T19:58:49.725567+0000","last_clean":"2024-04-22T19:58:49.725567+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725567+0000","last_undegraded":"2024-04-22T19:58:49.725567+0000","last_fullsized":"2024-04-22T19:58:49.725567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777636+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777636+0000","last_peered":"2024-04-22T19:58:49.777636+0000","last_clean":"2024-04-22T19:58:49.777636+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777636+0000","last_undegraded":"2024-04-22T19:58:49.777636+0000","last_fullsized":"2024-04-22T19:58:49.777636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727174+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727174+0000","last_peered":"2024-04-22T19:58:49.727174+0000","last_clean":"2024-04-22T19:58:49.727174+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727174+0000","last_undegraded":"2024-04-22T19:58:49.727174+0000","last_fullsized":"2024-04-22T19:58:49.727174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":355,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617798+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617798+0000","last_peered":"2024-04-22T19:58:50.617798+0000","last_clean":"2024-04-22T19:58:50.617798+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617798+0000","last_undegraded":"2024-04-22T19:58:50.617798+0000","last_fullsized":"2024-04-22T19:58:50.617798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":321,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869764+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869764+0000","last_peered":"2024-04-22T19:58:51.869764+0000","last_clean":"2024-04-22T19:58:51.869764+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869764+0000","last_undegraded":"2024-04-22T19:58:51.869764+0000","last_fullsized":"2024-04-22T19:58:51.869764+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720534+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720534+0000","last_peered":"2024-04-22T19:58:49.720534+0000","last_clean":"2024-04-22T19:58:49.720534+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720534+0000","last_undegraded":"2024-04-22T19:58:49.720534+0000","last_fullsized":"2024-04-22T19:58:49.720534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777547+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777547+0000","last_peered":"2024-04-22T19:58:49.777547+0000","last_clean":"2024-04-22T19:58:49.777547+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777547+0000","last_undegraded":"2024-04-22T19:58:49.777547+0000","last_fullsized":"2024-04-22T19:58:49.777547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":156,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782158+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782158+0000","last_peered":"2024-04-22T19:58:49.782158+0000","last_clean":"2024-04-22T19:58:49.782158+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782158+0000","last_undegraded":"2024-04-22T19:58:49.782158+0000","last_fullsized":"2024-04-22T19:58:49.782158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:00:21.150 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T20:00:21.150 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:00:41.151 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:00:41.512 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:00:41.518 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:00:41.537 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-04-22T20:00:39.506563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006823"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731664+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731664+0000","last_peered":"2024-04-22T19:58:49.731664+0000","last_clean":"2024-04-22T19:58:49.731664+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731664+0000","last_undegraded":"2024-04-22T19:58:49.731664+0000","last_fullsized":"2024-04-22T19:58:49.731664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723614+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723614+0000","last_peered":"2024-04-22T19:58:49.723614+0000","last_clean":"2024-04-22T19:58:49.723614+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723614+0000","last_undegraded":"2024-04-22T19:58:49.723614+0000","last_fullsized":"2024-04-22T19:58:49.723614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725001+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.725001+0000","last_peered":"2024-04-22T19:58:49.725001+0000","last_clean":"2024-04-22T19:58:49.725001+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.725001+0000","last_undegraded":"2024-04-22T19:58:49.725001+0000","last_fullsized":"2024-04-22T19:58:49.725001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":347,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601604+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601604+0000","last_peered":"2024-04-22T19:58:52.601604+0000","last_clean":"2024-04-22T19:58:52.601604+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601604+0000","last_undegraded":"2024-04-22T19:58:52.601604+0000","last_fullsized":"2024-04-22T19:58:52.601604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780957+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780957+0000","last_peered":"2024-04-22T19:58:49.780957+0000","last_clean":"2024-04-22T19:58:49.780957+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780957+0000","last_undegraded":"2024-04-22T19:58:49.780957+0000","last_fullsized":"2024-04-22T19:58:49.780957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720074+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.720074+0000","last_peered":"2024-04-22T19:58:49.720074+0000","last_clean":"2024-04-22T19:58:49.720074+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.720074+0000","last_undegraded":"2024-04-22T19:58:49.720074+0000","last_fullsized":"2024-04-22T19:58:49.720074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783725+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783725+0000","last_peered":"2024-04-22T19:58:49.783725+0000","last_clean":"2024-04-22T19:58:49.783725+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783725+0000","last_undegraded":"2024-04-22T19:58:49.783725+0000","last_fullsized":"2024-04-22T19:58:49.783725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780819+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.780819+0000","last_peered":"2024-04-22T19:58:49.780819+0000","last_clean":"2024-04-22T19:58:49.780819+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.780819+0000","last_undegraded":"2024-04-22T19:58:49.780819+0000","last_fullsized":"2024-04-22T19:58:49.780819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729828+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729828+0000","last_peered":"2024-04-22T19:58:49.729828+0000","last_clean":"2024-04-22T19:58:49.729828+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729828+0000","last_undegraded":"2024-04-22T19:58:49.729828+0000","last_fullsized":"2024-04-22T19:58:49.729828+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781166+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781166+0000","last_peered":"2024-04-22T19:58:49.781166+0000","last_clean":"2024-04-22T19:58:49.781166+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781166+0000","last_undegraded":"2024-04-22T19:58:49.781166+0000","last_fullsized":"2024-04-22T19:58:49.781166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780652+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780652+0000","last_peered":"2024-04-22T19:58:49.780652+0000","last_clean":"2024-04-22T19:58:49.780652+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780652+0000","last_undegraded":"2024-04-22T19:58:49.780652+0000","last_fullsized":"2024-04-22T19:58:49.780652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":59,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780876+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780876+0000","last_peered":"2024-04-22T19:58:49.780876+0000","last_clean":"2024-04-22T19:58:49.780876+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780876+0000","last_undegraded":"2024-04-22T19:58:49.780876+0000","last_fullsized":"2024-04-22T19:58:49.780876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787770+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787770+0000","last_peered":"2024-04-22T19:58:49.787770+0000","last_clean":"2024-04-22T19:58:49.787770+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787770+0000","last_undegraded":"2024-04-22T19:58:49.787770+0000","last_fullsized":"2024-04-22T19:58:49.787770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823797+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823797+0000","last_peered":"2024-04-22T19:58:54.823797+0000","last_clean":"2024-04-22T19:58:54.823797+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823797+0000","last_undegraded":"2024-04-22T19:58:54.823797+0000","last_fullsized":"2024-04-22T19:58:54.823797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872374+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872374+0000","last_peered":"2024-04-22T19:58:52.872374+0000","last_clean":"2024-04-22T19:58:52.872374+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872374+0000","last_undegraded":"2024-04-22T19:58:52.872374+0000","last_fullsized":"2024-04-22T19:58:52.872374+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779510+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779510+0000","last_peered":"2024-04-22T19:58:49.779510+0000","last_clean":"2024-04-22T19:58:49.779510+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779510+0000","last_undegraded":"2024-04-22T19:58:49.779510+0000","last_fullsized":"2024-04-22T19:58:49.779510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731638+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731638+0000","last_peered":"2024-04-22T19:58:49.731638+0000","last_clean":"2024-04-22T19:58:49.731638+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731638+0000","last_undegraded":"2024-04-22T19:58:49.731638+0000","last_fullsized":"2024-04-22T19:58:49.731638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728842+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728842+0000","last_peered":"2024-04-22T19:58:49.728842+0000","last_clean":"2024-04-22T19:58:49.728842+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728842+0000","last_undegraded":"2024-04-22T19:58:49.728842+0000","last_fullsized":"2024-04-22T19:58:49.728842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778351+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778351+0000","last_peered":"2024-04-22T19:58:49.778351+0000","last_clean":"2024-04-22T19:58:49.778351+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778351+0000","last_undegraded":"2024-04-22T19:58:49.778351+0000","last_fullsized":"2024-04-22T19:58:49.778351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781981+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781981+0000","last_peered":"2024-04-22T19:58:49.781981+0000","last_clean":"2024-04-22T19:58:49.781981+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781981+0000","last_undegraded":"2024-04-22T19:58:49.781981+0000","last_fullsized":"2024-04-22T19:58:49.781981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718678+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718678+0000","last_peered":"2024-04-22T19:58:49.718678+0000","last_clean":"2024-04-22T19:58:49.718678+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718678+0000","last_undegraded":"2024-04-22T19:58:49.718678+0000","last_fullsized":"2024-04-22T19:58:49.718678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731680+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731680+0000","last_peered":"2024-04-22T19:58:49.731680+0000","last_clean":"2024-04-22T19:58:49.731680+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731680+0000","last_undegraded":"2024-04-22T19:58:49.731680+0000","last_fullsized":"2024-04-22T19:58:49.731680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726972+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.726972+0000","last_peered":"2024-04-22T19:58:49.726972+0000","last_clean":"2024-04-22T19:58:49.726972+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.726972+0000","last_undegraded":"2024-04-22T19:58:49.726972+0000","last_fullsized":"2024-04-22T19:58:49.726972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780496+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780496+0000","last_peered":"2024-04-22T19:58:49.780496+0000","last_clean":"2024-04-22T19:58:49.780496+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780496+0000","last_undegraded":"2024-04-22T19:58:49.780496+0000","last_fullsized":"2024-04-22T19:58:49.780496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780807+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780807+0000","last_peered":"2024-04-22T19:58:49.780807+0000","last_clean":"2024-04-22T19:58:49.780807+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780807+0000","last_undegraded":"2024-04-22T19:58:49.780807+0000","last_fullsized":"2024-04-22T19:58:49.780807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779051+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779051+0000","last_peered":"2024-04-22T19:58:49.779051+0000","last_clean":"2024-04-22T19:58:49.779051+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779051+0000","last_undegraded":"2024-04-22T19:58:49.779051+0000","last_fullsized":"2024-04-22T19:58:49.779051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732053+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732053+0000","last_peered":"2024-04-22T19:58:49.732053+0000","last_clean":"2024-04-22T19:58:49.732053+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732053+0000","last_undegraded":"2024-04-22T19:58:49.732053+0000","last_fullsized":"2024-04-22T19:58:49.732053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729009+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729009+0000","last_peered":"2024-04-22T19:58:49.729009+0000","last_clean":"2024-04-22T19:58:49.729009+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729009+0000","last_undegraded":"2024-04-22T19:58:49.729009+0000","last_fullsized":"2024-04-22T19:58:49.729009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729269+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729269+0000","last_peered":"2024-04-22T19:58:49.729269+0000","last_clean":"2024-04-22T19:58:49.729269+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729269+0000","last_undegraded":"2024-04-22T19:58:49.729269+0000","last_fullsized":"2024-04-22T19:58:49.729269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717969+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.717969+0000","last_peered":"2024-04-22T19:58:49.717969+0000","last_clean":"2024-04-22T19:58:49.717969+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.717969+0000","last_undegraded":"2024-04-22T19:58:49.717969+0000","last_fullsized":"2024-04-22T19:58:49.717969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724826+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724826+0000","last_peered":"2024-04-22T19:58:49.724826+0000","last_clean":"2024-04-22T19:58:49.724826+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724826+0000","last_undegraded":"2024-04-22T19:58:49.724826+0000","last_fullsized":"2024-04-22T19:58:49.724826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722154+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722154+0000","last_peered":"2024-04-22T19:58:49.722154+0000","last_clean":"2024-04-22T19:58:49.722154+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722154+0000","last_undegraded":"2024-04-22T19:58:49.722154+0000","last_fullsized":"2024-04-22T19:58:49.722154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577159+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577159+0000","last_peered":"2024-04-22T19:58:51.577159+0000","last_clean":"2024-04-22T19:58:51.577159+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577159+0000","last_undegraded":"2024-04-22T19:58:51.577159+0000","last_fullsized":"2024-04-22T19:58:51.577159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727962+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.727962+0000","last_peered":"2024-04-22T19:58:49.727962+0000","last_clean":"2024-04-22T19:58:49.727962+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.727962+0000","last_undegraded":"2024-04-22T19:58:49.727962+0000","last_fullsized":"2024-04-22T19:58:49.727962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718671+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718671+0000","last_peered":"2024-04-22T19:58:49.718671+0000","last_clean":"2024-04-22T19:58:49.718671+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718671+0000","last_undegraded":"2024-04-22T19:58:49.718671+0000","last_fullsized":"2024-04-22T19:58:49.718671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726715+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726715+0000","last_peered":"2024-04-22T19:58:49.726715+0000","last_clean":"2024-04-22T19:58:49.726715+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726715+0000","last_undegraded":"2024-04-22T19:58:49.726715+0000","last_fullsized":"2024-04-22T19:58:49.726715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722690+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722690+0000","last_peered":"2024-04-22T19:58:49.722690+0000","last_clean":"2024-04-22T19:58:49.722690+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722690+0000","last_undegraded":"2024-04-22T19:58:49.722690+0000","last_fullsized":"2024-04-22T19:58:49.722690+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103503+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103503+0000","last_peered":"2024-04-22T19:58:52.103503+0000","last_clean":"2024-04-22T19:58:52.103503+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103503+0000","last_undegraded":"2024-04-22T19:58:52.103503+0000","last_fullsized":"2024-04-22T19:58:52.103503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779442+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779442+0000","last_peered":"2024-04-22T19:58:49.779442+0000","last_clean":"2024-04-22T19:58:49.779442+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779442+0000","last_undegraded":"2024-04-22T19:58:49.779442+0000","last_fullsized":"2024-04-22T19:58:49.779442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728553+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728553+0000","last_peered":"2024-04-22T19:58:49.728553+0000","last_clean":"2024-04-22T19:58:49.728553+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728553+0000","last_undegraded":"2024-04-22T19:58:49.728553+0000","last_fullsized":"2024-04-22T19:58:49.728553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719831+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719831+0000","last_peered":"2024-04-22T19:58:49.719831+0000","last_clean":"2024-04-22T19:58:49.719831+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719831+0000","last_undegraded":"2024-04-22T19:58:49.719831+0000","last_fullsized":"2024-04-22T19:58:49.719831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720215+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720215+0000","last_peered":"2024-04-22T19:58:49.720215+0000","last_clean":"2024-04-22T19:58:49.720215+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720215+0000","last_undegraded":"2024-04-22T19:58:49.720215+0000","last_fullsized":"2024-04-22T19:58:49.720215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779272+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779272+0000","last_peered":"2024-04-22T19:58:49.779272+0000","last_clean":"2024-04-22T19:58:49.779272+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779272+0000","last_undegraded":"2024-04-22T19:58:49.779272+0000","last_fullsized":"2024-04-22T19:58:49.779272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721128+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721128+0000","last_peered":"2024-04-22T19:58:49.721128+0000","last_clean":"2024-04-22T19:58:49.721128+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721128+0000","last_undegraded":"2024-04-22T19:58:49.721128+0000","last_fullsized":"2024-04-22T19:58:49.721128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729646+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729646+0000","last_peered":"2024-04-22T19:58:49.729646+0000","last_clean":"2024-04-22T19:58:49.729646+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729646+0000","last_undegraded":"2024-04-22T19:58:49.729646+0000","last_fullsized":"2024-04-22T19:58:49.729646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721254+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721254+0000","last_peered":"2024-04-22T19:58:49.721254+0000","last_clean":"2024-04-22T19:58:49.721254+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721254+0000","last_undegraded":"2024-04-22T19:58:49.721254+0000","last_fullsized":"2024-04-22T19:58:49.721254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720401+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720401+0000","last_peered":"2024-04-22T19:58:49.720401+0000","last_clean":"2024-04-22T19:58:49.720401+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720401+0000","last_undegraded":"2024-04-22T19:58:49.720401+0000","last_fullsized":"2024-04-22T19:58:49.720401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719618+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719618+0000","last_peered":"2024-04-22T19:58:49.719618+0000","last_clean":"2024-04-22T19:58:49.719618+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719618+0000","last_undegraded":"2024-04-22T19:58:49.719618+0000","last_fullsized":"2024-04-22T19:58:49.719618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":416,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782577+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782577+0000","last_peered":"2024-04-22T19:58:49.782577+0000","last_clean":"2024-04-22T19:58:49.782577+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782577+0000","last_undegraded":"2024-04-22T19:58:49.782577+0000","last_fullsized":"2024-04-22T19:58:49.782577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":69,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781463+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781463+0000","last_peered":"2024-04-22T19:58:49.781463+0000","last_clean":"2024-04-22T19:58:49.781463+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781463+0000","last_undegraded":"2024-04-22T19:58:49.781463+0000","last_fullsized":"2024-04-22T19:58:49.781463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719225+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719225+0000","last_peered":"2024-04-22T19:58:49.719225+0000","last_clean":"2024-04-22T19:58:49.719225+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719225+0000","last_undegraded":"2024-04-22T19:58:49.719225+0000","last_fullsized":"2024-04-22T19:58:49.719225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720126+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720126+0000","last_peered":"2024-04-22T19:58:49.720126+0000","last_clean":"2024-04-22T19:58:49.720126+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720126+0000","last_undegraded":"2024-04-22T19:58:49.720126+0000","last_fullsized":"2024-04-22T19:58:49.720126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781466+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781466+0000","last_peered":"2024-04-22T19:58:49.781466+0000","last_clean":"2024-04-22T19:58:49.781466+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781466+0000","last_undegraded":"2024-04-22T19:58:49.781466+0000","last_fullsized":"2024-04-22T19:58:49.781466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720731+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720731+0000","last_peered":"2024-04-22T19:58:49.720731+0000","last_clean":"2024-04-22T19:58:49.720731+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720731+0000","last_undegraded":"2024-04-22T19:58:49.720731+0000","last_fullsized":"2024-04-22T19:58:49.720731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784728+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784728+0000","last_peered":"2024-04-22T19:58:49.784728+0000","last_clean":"2024-04-22T19:58:49.784728+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784728+0000","last_undegraded":"2024-04-22T19:58:49.784728+0000","last_fullsized":"2024-04-22T19:58:49.784728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729545+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729545+0000","last_peered":"2024-04-22T19:58:49.729545+0000","last_clean":"2024-04-22T19:58:49.729545+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729545+0000","last_undegraded":"2024-04-22T19:58:49.729545+0000","last_fullsized":"2024-04-22T19:58:49.729545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781475+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781475+0000","last_peered":"2024-04-22T19:58:49.781475+0000","last_clean":"2024-04-22T19:58:49.781475+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781475+0000","last_undegraded":"2024-04-22T19:58:49.781475+0000","last_fullsized":"2024-04-22T19:58:49.781475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730855+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730855+0000","last_peered":"2024-04-22T19:58:49.730855+0000","last_clean":"2024-04-22T19:58:49.730855+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730855+0000","last_undegraded":"2024-04-22T19:58:49.730855+0000","last_fullsized":"2024-04-22T19:58:49.730855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783138+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783138+0000","last_peered":"2024-04-22T19:58:49.783138+0000","last_clean":"2024-04-22T19:58:49.783138+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783138+0000","last_undegraded":"2024-04-22T19:58:49.783138+0000","last_fullsized":"2024-04-22T19:58:49.783138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725013+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725013+0000","last_peered":"2024-04-22T19:58:49.725013+0000","last_clean":"2024-04-22T19:58:49.725013+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725013+0000","last_undegraded":"2024-04-22T19:58:49.725013+0000","last_fullsized":"2024-04-22T19:58:49.725013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777559+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777559+0000","last_peered":"2024-04-22T19:58:49.777559+0000","last_clean":"2024-04-22T19:58:49.777559+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777559+0000","last_undegraded":"2024-04-22T19:58:49.777559+0000","last_fullsized":"2024-04-22T19:58:49.777559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725492+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725492+0000","last_peered":"2024-04-22T19:58:49.725492+0000","last_clean":"2024-04-22T19:58:49.725492+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725492+0000","last_undegraded":"2024-04-22T19:58:49.725492+0000","last_fullsized":"2024-04-22T19:58:49.725492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729291+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729291+0000","last_peered":"2024-04-22T19:58:49.729291+0000","last_clean":"2024-04-22T19:58:49.729291+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729291+0000","last_undegraded":"2024-04-22T19:58:49.729291+0000","last_fullsized":"2024-04-22T19:58:49.729291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718816+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718816+0000","last_peered":"2024-04-22T19:58:49.718816+0000","last_clean":"2024-04-22T19:58:49.718816+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718816+0000","last_undegraded":"2024-04-22T19:58:49.718816+0000","last_fullsized":"2024-04-22T19:58:49.718816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784718+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784718+0000","last_peered":"2024-04-22T19:58:49.784718+0000","last_clean":"2024-04-22T19:58:49.784718+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784718+0000","last_undegraded":"2024-04-22T19:58:49.784718+0000","last_fullsized":"2024-04-22T19:58:49.784718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":503,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721143+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721143+0000","last_peered":"2024-04-22T19:58:49.721143+0000","last_clean":"2024-04-22T19:58:49.721143+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721143+0000","last_undegraded":"2024-04-22T19:58:49.721143+0000","last_fullsized":"2024-04-22T19:58:49.721143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730831+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730831+0000","last_peered":"2024-04-22T19:58:49.730831+0000","last_clean":"2024-04-22T19:58:49.730831+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730831+0000","last_undegraded":"2024-04-22T19:58:49.730831+0000","last_fullsized":"2024-04-22T19:58:49.730831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720218+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720218+0000","last_peered":"2024-04-22T19:58:49.720218+0000","last_clean":"2024-04-22T19:58:49.720218+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720218+0000","last_undegraded":"2024-04-22T19:58:49.720218+0000","last_fullsized":"2024-04-22T19:58:49.720218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723398+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723398+0000","last_peered":"2024-04-22T19:58:49.723398+0000","last_clean":"2024-04-22T19:58:49.723398+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723398+0000","last_undegraded":"2024-04-22T19:58:49.723398+0000","last_fullsized":"2024-04-22T19:58:49.723398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727710+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727710+0000","last_peered":"2024-04-22T19:58:49.727710+0000","last_clean":"2024-04-22T19:58:49.727710+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727710+0000","last_undegraded":"2024-04-22T19:58:49.727710+0000","last_fullsized":"2024-04-22T19:58:49.727710+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720445+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720445+0000","last_peered":"2024-04-22T19:58:49.720445+0000","last_clean":"2024-04-22T19:58:49.720445+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720445+0000","last_undegraded":"2024-04-22T19:58:49.720445+0000","last_fullsized":"2024-04-22T19:58:49.720445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":324,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729100+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729100+0000","last_peered":"2024-04-22T19:58:49.729100+0000","last_clean":"2024-04-22T19:58:49.729100+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729100+0000","last_undegraded":"2024-04-22T19:58:49.729100+0000","last_fullsized":"2024-04-22T19:58:49.729100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731596+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731596+0000","last_peered":"2024-04-22T19:58:49.731596+0000","last_clean":"2024-04-22T19:58:49.731596+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731596+0000","last_undegraded":"2024-04-22T19:58:49.731596+0000","last_fullsized":"2024-04-22T19:58:49.731596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723336+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723336+0000","last_peered":"2024-04-22T19:58:49.723336+0000","last_clean":"2024-04-22T19:58:49.723336+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723336+0000","last_undegraded":"2024-04-22T19:58:49.723336+0000","last_fullsized":"2024-04-22T19:58:49.723336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783753+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783753+0000","last_peered":"2024-04-22T19:58:49.783753+0000","last_clean":"2024-04-22T19:58:49.783753+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783753+0000","last_undegraded":"2024-04-22T19:58:49.783753+0000","last_fullsized":"2024-04-22T19:58:49.783753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721618+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721618+0000","last_peered":"2024-04-22T19:58:49.721618+0000","last_clean":"2024-04-22T19:58:49.721618+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721618+0000","last_undegraded":"2024-04-22T19:58:49.721618+0000","last_fullsized":"2024-04-22T19:58:49.721618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781547+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781547+0000","last_peered":"2024-04-22T19:58:49.781547+0000","last_clean":"2024-04-22T19:58:49.781547+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781547+0000","last_undegraded":"2024-04-22T19:58:49.781547+0000","last_fullsized":"2024-04-22T19:58:49.781547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719703+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719703+0000","last_peered":"2024-04-22T19:58:49.719703+0000","last_clean":"2024-04-22T19:58:49.719703+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719703+0000","last_undegraded":"2024-04-22T19:58:49.719703+0000","last_fullsized":"2024-04-22T19:58:49.719703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724590+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724590+0000","last_peered":"2024-04-22T19:58:49.724590+0000","last_clean":"2024-04-22T19:58:49.724590+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724590+0000","last_undegraded":"2024-04-22T19:58:49.724590+0000","last_fullsized":"2024-04-22T19:58:49.724590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785659+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785659+0000","last_peered":"2024-04-22T19:58:49.785659+0000","last_clean":"2024-04-22T19:58:49.785659+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785659+0000","last_undegraded":"2024-04-22T19:58:49.785659+0000","last_fullsized":"2024-04-22T19:58:49.785659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778230+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778230+0000","last_peered":"2024-04-22T19:58:49.778230+0000","last_clean":"2024-04-22T19:58:49.778230+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778230+0000","last_undegraded":"2024-04-22T19:58:49.778230+0000","last_fullsized":"2024-04-22T19:58:49.778230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720927+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720927+0000","last_peered":"2024-04-22T19:58:49.720927+0000","last_clean":"2024-04-22T19:58:49.720927+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720927+0000","last_undegraded":"2024-04-22T19:58:49.720927+0000","last_fullsized":"2024-04-22T19:58:49.720927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":331,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784400+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.784400+0000","last_peered":"2024-04-22T19:58:49.784400+0000","last_clean":"2024-04-22T19:58:49.784400+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.784400+0000","last_undegraded":"2024-04-22T19:58:49.784400+0000","last_fullsized":"2024-04-22T19:58:49.784400+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721907+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721907+0000","last_peered":"2024-04-22T19:58:49.721907+0000","last_clean":"2024-04-22T19:58:49.721907+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721907+0000","last_undegraded":"2024-04-22T19:58:49.721907+0000","last_fullsized":"2024-04-22T19:58:49.721907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720812+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720812+0000","last_peered":"2024-04-22T19:58:49.720812+0000","last_clean":"2024-04-22T19:58:49.720812+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720812+0000","last_undegraded":"2024-04-22T19:58:49.720812+0000","last_fullsized":"2024-04-22T19:58:49.720812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839511+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839511+0000","last_peered":"2024-04-22T19:58:52.839511+0000","last_clean":"2024-04-22T19:58:52.839511+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839511+0000","last_undegraded":"2024-04-22T19:58:52.839511+0000","last_fullsized":"2024-04-22T19:58:52.839511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718405+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718405+0000","last_peered":"2024-04-22T19:58:49.718405+0000","last_clean":"2024-04-22T19:58:49.718405+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718405+0000","last_undegraded":"2024-04-22T19:58:49.718405+0000","last_fullsized":"2024-04-22T19:58:49.718405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722047+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.722047+0000","last_peered":"2024-04-22T19:58:49.722047+0000","last_clean":"2024-04-22T19:58:49.722047+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.722047+0000","last_undegraded":"2024-04-22T19:58:49.722047+0000","last_fullsized":"2024-04-22T19:58:49.722047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732453+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732453+0000","last_peered":"2024-04-22T19:58:49.732453+0000","last_clean":"2024-04-22T19:58:49.732453+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732453+0000","last_undegraded":"2024-04-22T19:58:49.732453+0000","last_fullsized":"2024-04-22T19:58:49.732453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778655+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778655+0000","last_peered":"2024-04-22T19:58:49.778655+0000","last_clean":"2024-04-22T19:58:49.778655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778655+0000","last_undegraded":"2024-04-22T19:58:49.778655+0000","last_fullsized":"2024-04-22T19:58:49.778655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720753+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720753+0000","last_peered":"2024-04-22T19:58:49.720753+0000","last_clean":"2024-04-22T19:58:49.720753+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720753+0000","last_undegraded":"2024-04-22T19:58:49.720753+0000","last_fullsized":"2024-04-22T19:58:49.720753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779292+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779292+0000","last_peered":"2024-04-22T19:58:49.779292+0000","last_clean":"2024-04-22T19:58:49.779292+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779292+0000","last_undegraded":"2024-04-22T19:58:49.779292+0000","last_fullsized":"2024-04-22T19:58:49.779292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787894+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787894+0000","last_peered":"2024-04-22T19:58:49.787894+0000","last_clean":"2024-04-22T19:58:49.787894+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787894+0000","last_undegraded":"2024-04-22T19:58:49.787894+0000","last_fullsized":"2024-04-22T19:58:49.787894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723854+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723854+0000","last_peered":"2024-04-22T19:58:49.723854+0000","last_clean":"2024-04-22T19:58:49.723854+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723854+0000","last_undegraded":"2024-04-22T19:58:49.723854+0000","last_fullsized":"2024-04-22T19:58:49.723854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718745+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718745+0000","last_peered":"2024-04-22T19:58:49.718745+0000","last_clean":"2024-04-22T19:58:49.718745+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718745+0000","last_undegraded":"2024-04-22T19:58:49.718745+0000","last_fullsized":"2024-04-22T19:58:49.718745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121529+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121529+0000","last_peered":"2024-04-22T19:58:53.121529+0000","last_clean":"2024-04-22T19:58:53.121529+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121529+0000","last_undegraded":"2024-04-22T19:58:53.121529+0000","last_fullsized":"2024-04-22T19:58:53.121529+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719083+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.719083+0000","last_peered":"2024-04-22T19:58:49.719083+0000","last_clean":"2024-04-22T19:58:49.719083+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.719083+0000","last_undegraded":"2024-04-22T19:58:49.719083+0000","last_fullsized":"2024-04-22T19:58:49.719083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725762+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725762+0000","last_peered":"2024-04-22T19:58:49.725762+0000","last_clean":"2024-04-22T19:58:49.725762+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725762+0000","last_undegraded":"2024-04-22T19:58:49.725762+0000","last_fullsized":"2024-04-22T19:58:49.725762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786647+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786647+0000","last_peered":"2024-04-22T19:58:49.786647+0000","last_clean":"2024-04-22T19:58:49.786647+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786647+0000","last_undegraded":"2024-04-22T19:58:49.786647+0000","last_fullsized":"2024-04-22T19:58:49.786647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":312,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730066+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.730066+0000","last_peered":"2024-04-22T19:58:49.730066+0000","last_clean":"2024-04-22T19:58:49.730066+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.730066+0000","last_undegraded":"2024-04-22T19:58:49.730066+0000","last_fullsized":"2024-04-22T19:58:49.730066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724733+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724733+0000","last_peered":"2024-04-22T19:58:49.724733+0000","last_clean":"2024-04-22T19:58:49.724733+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724733+0000","last_undegraded":"2024-04-22T19:58:49.724733+0000","last_fullsized":"2024-04-22T19:58:49.724733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778734+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778734+0000","last_peered":"2024-04-22T19:58:49.778734+0000","last_clean":"2024-04-22T19:58:49.778734+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778734+0000","last_undegraded":"2024-04-22T19:58:49.778734+0000","last_fullsized":"2024-04-22T19:58:49.778734+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781767+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.781767+0000","last_peered":"2024-04-22T19:58:49.781767+0000","last_clean":"2024-04-22T19:58:49.781767+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.781767+0000","last_undegraded":"2024-04-22T19:58:49.781767+0000","last_fullsized":"2024-04-22T19:58:49.781767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821961+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821961+0000","last_peered":"2024-04-22T19:58:49.821961+0000","last_clean":"2024-04-22T19:58:49.821961+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821961+0000","last_undegraded":"2024-04-22T19:58:49.821961+0000","last_fullsized":"2024-04-22T19:58:49.821961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780035+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.780035+0000","last_peered":"2024-04-22T19:58:49.780035+0000","last_clean":"2024-04-22T19:58:49.780035+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.780035+0000","last_undegraded":"2024-04-22T19:58:49.780035+0000","last_fullsized":"2024-04-22T19:58:49.780035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780166+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780166+0000","last_peered":"2024-04-22T19:58:49.780166+0000","last_clean":"2024-04-22T19:58:49.780166+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780166+0000","last_undegraded":"2024-04-22T19:58:49.780166+0000","last_fullsized":"2024-04-22T19:58:49.780166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871339+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871339+0000","last_peered":"2024-04-22T19:58:50.871339+0000","last_clean":"2024-04-22T19:58:50.871339+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871339+0000","last_undegraded":"2024-04-22T19:58:50.871339+0000","last_fullsized":"2024-04-22T19:58:50.871339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786228+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786228+0000","last_peered":"2024-04-22T19:58:49.786228+0000","last_clean":"2024-04-22T19:58:49.786228+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786228+0000","last_undegraded":"2024-04-22T19:58:49.786228+0000","last_fullsized":"2024-04-22T19:58:49.786228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778906+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778906+0000","last_peered":"2024-04-22T19:58:49.778906+0000","last_clean":"2024-04-22T19:58:49.778906+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778906+0000","last_undegraded":"2024-04-22T19:58:49.778906+0000","last_fullsized":"2024-04-22T19:58:49.778906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725206+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725206+0000","last_peered":"2024-04-22T19:58:49.725206+0000","last_clean":"2024-04-22T19:58:49.725206+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725206+0000","last_undegraded":"2024-04-22T19:58:49.725206+0000","last_fullsized":"2024-04-22T19:58:49.725206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781415+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781415+0000","last_peered":"2024-04-22T19:58:49.781415+0000","last_clean":"2024-04-22T19:58:49.781415+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781415+0000","last_undegraded":"2024-04-22T19:58:49.781415+0000","last_fullsized":"2024-04-22T19:58:49.781415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725477+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725477+0000","last_peered":"2024-04-22T19:58:49.725477+0000","last_clean":"2024-04-22T19:58:49.725477+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725477+0000","last_undegraded":"2024-04-22T19:58:49.725477+0000","last_fullsized":"2024-04-22T19:58:49.725477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785788+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785788+0000","last_peered":"2024-04-22T19:58:49.785788+0000","last_clean":"2024-04-22T19:58:49.785788+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785788+0000","last_undegraded":"2024-04-22T19:58:49.785788+0000","last_fullsized":"2024-04-22T19:58:49.785788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779914+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779914+0000","last_peered":"2024-04-22T19:58:49.779914+0000","last_clean":"2024-04-22T19:58:49.779914+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779914+0000","last_undegraded":"2024-04-22T19:58:49.779914+0000","last_fullsized":"2024-04-22T19:58:49.779914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722495+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722495+0000","last_peered":"2024-04-22T19:58:49.722495+0000","last_clean":"2024-04-22T19:58:49.722495+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722495+0000","last_undegraded":"2024-04-22T19:58:49.722495+0000","last_fullsized":"2024-04-22T19:58:49.722495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720078+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.720078+0000","last_peered":"2024-04-22T19:58:49.720078+0000","last_clean":"2024-04-22T19:58:49.720078+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.720078+0000","last_undegraded":"2024-04-22T19:58:49.720078+0000","last_fullsized":"2024-04-22T19:58:49.720078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":435,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785100+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.785100+0000","last_peered":"2024-04-22T19:58:49.785100+0000","last_clean":"2024-04-22T19:58:49.785100+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.785100+0000","last_undegraded":"2024-04-22T19:58:49.785100+0000","last_fullsized":"2024-04-22T19:58:49.785100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779236+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779236+0000","last_peered":"2024-04-22T19:58:49.779236+0000","last_clean":"2024-04-22T19:58:49.779236+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779236+0000","last_undegraded":"2024-04-22T19:58:49.779236+0000","last_fullsized":"2024-04-22T19:58:49.779236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778873+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778873+0000","last_peered":"2024-04-22T19:58:49.778873+0000","last_clean":"2024-04-22T19:58:49.778873+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778873+0000","last_undegraded":"2024-04-22T19:58:49.778873+0000","last_fullsized":"2024-04-22T19:58:49.778873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":66,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783540+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783540+0000","last_peered":"2024-04-22T19:58:49.783540+0000","last_clean":"2024-04-22T19:58:49.783540+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783540+0000","last_undegraded":"2024-04-22T19:58:49.783540+0000","last_fullsized":"2024-04-22T19:58:49.783540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725683+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725683+0000","last_peered":"2024-04-22T19:58:49.725683+0000","last_clean":"2024-04-22T19:58:49.725683+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725683+0000","last_undegraded":"2024-04-22T19:58:49.725683+0000","last_fullsized":"2024-04-22T19:58:49.725683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723172+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723172+0000","last_peered":"2024-04-22T19:58:49.723172+0000","last_clean":"2024-04-22T19:58:49.723172+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723172+0000","last_undegraded":"2024-04-22T19:58:49.723172+0000","last_fullsized":"2024-04-22T19:58:49.723172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777755+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777755+0000","last_peered":"2024-04-22T19:58:49.777755+0000","last_clean":"2024-04-22T19:58:49.777755+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777755+0000","last_undegraded":"2024-04-22T19:58:49.777755+0000","last_fullsized":"2024-04-22T19:58:49.777755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723083+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723083+0000","last_peered":"2024-04-22T19:58:49.723083+0000","last_clean":"2024-04-22T19:58:49.723083+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723083+0000","last_undegraded":"2024-04-22T19:58:49.723083+0000","last_fullsized":"2024-04-22T19:58:49.723083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727305+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727305+0000","last_peered":"2024-04-22T19:58:49.727305+0000","last_clean":"2024-04-22T19:58:49.727305+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727305+0000","last_undegraded":"2024-04-22T19:58:49.727305+0000","last_fullsized":"2024-04-22T19:58:49.727305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783029+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783029+0000","last_peered":"2024-04-22T19:58:49.783029+0000","last_clean":"2024-04-22T19:58:49.783029+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783029+0000","last_undegraded":"2024-04-22T19:58:49.783029+0000","last_fullsized":"2024-04-22T19:58:49.783029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":356,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617855+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617855+0000","last_peered":"2024-04-22T19:58:50.617855+0000","last_clean":"2024-04-22T19:58:50.617855+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617855+0000","last_undegraded":"2024-04-22T19:58:50.617855+0000","last_fullsized":"2024-04-22T19:58:50.617855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721746+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721746+0000","last_peered":"2024-04-22T19:58:49.721746+0000","last_clean":"2024-04-22T19:58:49.721746+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721746+0000","last_undegraded":"2024-04-22T19:58:49.721746+0000","last_fullsized":"2024-04-22T19:58:49.721746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869837+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869837+0000","last_peered":"2024-04-22T19:58:51.869837+0000","last_clean":"2024-04-22T19:58:51.869837+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869837+0000","last_undegraded":"2024-04-22T19:58:51.869837+0000","last_fullsized":"2024-04-22T19:58:51.869837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.803939+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:49.803939+0000","last_peered":"2024-04-22T19:58:49.803939+0000","last_clean":"2024-04-22T19:58:49.803939+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:49.803939+0000","last_undegraded":"2024-04-22T19:58:49.803939+0000","last_fullsized":"2024-04-22T19:58:49.803939+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720641+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720641+0000","last_peered":"2024-04-22T19:58:49.720641+0000","last_clean":"2024-04-22T19:58:49.720641+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720641+0000","last_undegraded":"2024-04-22T19:58:49.720641+0000","last_fullsized":"2024-04-22T19:58:49.720641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722862+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722862+0000","last_peered":"2024-04-22T19:58:49.722862+0000","last_clean":"2024-04-22T19:58:49.722862+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722862+0000","last_undegraded":"2024-04-22T19:58:49.722862+0000","last_fullsized":"2024-04-22T19:58:49.722862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785755+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785755+0000","last_peered":"2024-04-22T19:58:49.785755+0000","last_clean":"2024-04-22T19:58:49.785755+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785755+0000","last_undegraded":"2024-04-22T19:58:49.785755+0000","last_fullsized":"2024-04-22T19:58:49.785755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777695+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777695+0000","last_peered":"2024-04-22T19:58:49.777695+0000","last_clean":"2024-04-22T19:58:49.777695+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777695+0000","last_undegraded":"2024-04-22T19:58:49.777695+0000","last_fullsized":"2024-04-22T19:58:49.777695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":366,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628002+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628002+0000","last_peered":"2024-04-22T19:58:53.628002+0000","last_clean":"2024-04-22T19:58:53.628002+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628002+0000","last_undegraded":"2024-04-22T19:58:53.628002+0000","last_fullsized":"2024-04-22T19:58:53.628002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":156,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782158+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782158+0000","last_peered":"2024-04-22T19:58:49.782158+0000","last_clean":"2024-04-22T19:58:49.782158+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782158+0000","last_undegraded":"2024-04-22T19:58:49.782158+0000","last_fullsized":"2024-04-22T19:58:49.782158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729576+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729576+0000","last_peered":"2024-04-22T19:58:49.729576+0000","last_clean":"2024-04-22T19:58:49.729576+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729576+0000","last_undegraded":"2024-04-22T19:58:49.729576+0000","last_fullsized":"2024-04-22T19:58:49.729576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":310,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780893+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.780893+0000","last_peered":"2024-04-22T19:58:49.780893+0000","last_clean":"2024-04-22T19:58:49.780893+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.780893+0000","last_undegraded":"2024-04-22T19:58:49.780893+0000","last_fullsized":"2024-04-22T19:58:49.780893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721164+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721164+0000","last_peered":"2024-04-22T19:58:49.721164+0000","last_clean":"2024-04-22T19:58:49.721164+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721164+0000","last_undegraded":"2024-04-22T19:58:49.721164+0000","last_fullsized":"2024-04-22T19:58:49.721164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369115+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369115+0000","last_peered":"2024-04-22T19:58:52.369115+0000","last_clean":"2024-04-22T19:58:52.369115+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369115+0000","last_undegraded":"2024-04-22T19:58:52.369115+0000","last_fullsized":"2024-04-22T19:58:52.369115+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781249+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781249+0000","last_peered":"2024-04-22T19:58:49.781249+0000","last_clean":"2024-04-22T19:58:49.781249+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781249+0000","last_undegraded":"2024-04-22T19:58:49.781249+0000","last_fullsized":"2024-04-22T19:58:49.781249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718951+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.718951+0000","last_peered":"2024-04-22T19:58:49.718951+0000","last_clean":"2024-04-22T19:58:49.718951+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.718951+0000","last_undegraded":"2024-04-22T19:58:49.718951+0000","last_fullsized":"2024-04-22T19:58:49.718951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732352+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732352+0000","last_peered":"2024-04-22T19:58:49.732352+0000","last_clean":"2024-04-22T19:58:49.732352+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732352+0000","last_undegraded":"2024-04-22T19:58:49.732352+0000","last_fullsized":"2024-04-22T19:58:49.732352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357589+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357589+0000","last_peered":"2024-04-22T19:58:51.357589+0000","last_clean":"2024-04-22T19:58:51.357589+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357589+0000","last_undegraded":"2024-04-22T19:58:51.357589+0000","last_fullsized":"2024-04-22T19:58:51.357589+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783173+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783173+0000","last_peered":"2024-04-22T19:58:49.783173+0000","last_clean":"2024-04-22T19:58:49.783173+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783173+0000","last_undegraded":"2024-04-22T19:58:49.783173+0000","last_fullsized":"2024-04-22T19:58:49.783173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:00:41.550 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T20:00:41.550 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:01:01.551 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:01:01.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:01:01.920 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:01:01.937 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-04-22T20:01:01.517972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005948"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731664+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731664+0000","last_peered":"2024-04-22T19:58:49.731664+0000","last_clean":"2024-04-22T19:58:49.731664+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731664+0000","last_undegraded":"2024-04-22T19:58:49.731664+0000","last_fullsized":"2024-04-22T19:58:49.731664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723614+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723614+0000","last_peered":"2024-04-22T19:58:49.723614+0000","last_clean":"2024-04-22T19:58:49.723614+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723614+0000","last_undegraded":"2024-04-22T19:58:49.723614+0000","last_fullsized":"2024-04-22T19:58:49.723614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725001+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.725001+0000","last_peered":"2024-04-22T19:58:49.725001+0000","last_clean":"2024-04-22T19:58:49.725001+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.725001+0000","last_undegraded":"2024-04-22T19:58:49.725001+0000","last_fullsized":"2024-04-22T19:58:49.725001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":347,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601604+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601604+0000","last_peered":"2024-04-22T19:58:52.601604+0000","last_clean":"2024-04-22T19:58:52.601604+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601604+0000","last_undegraded":"2024-04-22T19:58:52.601604+0000","last_fullsized":"2024-04-22T19:58:52.601604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780957+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780957+0000","last_peered":"2024-04-22T19:58:49.780957+0000","last_clean":"2024-04-22T19:58:49.780957+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780957+0000","last_undegraded":"2024-04-22T19:58:49.780957+0000","last_fullsized":"2024-04-22T19:58:49.780957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720074+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.720074+0000","last_peered":"2024-04-22T19:58:49.720074+0000","last_clean":"2024-04-22T19:58:49.720074+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.720074+0000","last_undegraded":"2024-04-22T19:58:49.720074+0000","last_fullsized":"2024-04-22T19:58:49.720074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783725+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783725+0000","last_peered":"2024-04-22T19:58:49.783725+0000","last_clean":"2024-04-22T19:58:49.783725+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783725+0000","last_undegraded":"2024-04-22T19:58:49.783725+0000","last_fullsized":"2024-04-22T19:58:49.783725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780819+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.780819+0000","last_peered":"2024-04-22T19:58:49.780819+0000","last_clean":"2024-04-22T19:58:49.780819+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.780819+0000","last_undegraded":"2024-04-22T19:58:49.780819+0000","last_fullsized":"2024-04-22T19:58:49.780819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729828+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729828+0000","last_peered":"2024-04-22T19:58:49.729828+0000","last_clean":"2024-04-22T19:58:49.729828+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729828+0000","last_undegraded":"2024-04-22T19:58:49.729828+0000","last_fullsized":"2024-04-22T19:58:49.729828+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718701+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:49.718701+0000","last_peered":"2024-04-22T19:58:49.718701+0000","last_clean":"2024-04-22T19:58:49.718701+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:49.718701+0000","last_undegraded":"2024-04-22T19:58:49.718701+0000","last_fullsized":"2024-04-22T19:58:49.718701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730777+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730777+0000","last_peered":"2024-04-22T19:58:49.730777+0000","last_clean":"2024-04-22T19:58:49.730777+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730777+0000","last_undegraded":"2024-04-22T19:58:49.730777+0000","last_fullsized":"2024-04-22T19:58:49.730777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729481+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:49.729481+0000","last_peered":"2024-04-22T19:58:49.729481+0000","last_clean":"2024-04-22T19:58:49.729481+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:49.729481+0000","last_undegraded":"2024-04-22T19:58:49.729481+0000","last_fullsized":"2024-04-22T19:58:49.729481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780765+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:49.780765+0000","last_peered":"2024-04-22T19:58:49.780765+0000","last_clean":"2024-04-22T19:58:49.780765+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:49.780765+0000","last_undegraded":"2024-04-22T19:58:49.780765+0000","last_fullsized":"2024-04-22T19:58:49.780765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781166+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781166+0000","last_peered":"2024-04-22T19:58:49.781166+0000","last_clean":"2024-04-22T19:58:49.781166+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781166+0000","last_undegraded":"2024-04-22T19:58:49.781166+0000","last_fullsized":"2024-04-22T19:58:49.781166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719702+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:49.719702+0000","last_peered":"2024-04-22T19:58:49.719702+0000","last_clean":"2024-04-22T19:58:49.719702+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:49.719702+0000","last_undegraded":"2024-04-22T19:58:49.719702+0000","last_fullsized":"2024-04-22T19:58:49.719702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780652+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780652+0000","last_peered":"2024-04-22T19:58:49.780652+0000","last_clean":"2024-04-22T19:58:49.780652+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780652+0000","last_undegraded":"2024-04-22T19:58:49.780652+0000","last_fullsized":"2024-04-22T19:58:49.780652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731612+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:49.731612+0000","last_peered":"2024-04-22T19:58:49.731612+0000","last_clean":"2024-04-22T19:58:49.731612+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:49.731612+0000","last_undegraded":"2024-04-22T19:58:49.731612+0000","last_fullsized":"2024-04-22T19:58:49.731612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719695+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:49.719695+0000","last_peered":"2024-04-22T19:58:49.719695+0000","last_clean":"2024-04-22T19:58:49.719695+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:49.719695+0000","last_undegraded":"2024-04-22T19:58:49.719695+0000","last_fullsized":"2024-04-22T19:58:49.719695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":59,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780876+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780876+0000","last_peered":"2024-04-22T19:58:49.780876+0000","last_clean":"2024-04-22T19:58:49.780876+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780876+0000","last_undegraded":"2024-04-22T19:58:49.780876+0000","last_fullsized":"2024-04-22T19:58:49.780876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729729+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:49.729729+0000","last_peered":"2024-04-22T19:58:49.729729+0000","last_clean":"2024-04-22T19:58:49.729729+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:49.729729+0000","last_undegraded":"2024-04-22T19:58:49.729729+0000","last_fullsized":"2024-04-22T19:58:49.729729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787770+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787770+0000","last_peered":"2024-04-22T19:58:49.787770+0000","last_clean":"2024-04-22T19:58:49.787770+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787770+0000","last_undegraded":"2024-04-22T19:58:49.787770+0000","last_fullsized":"2024-04-22T19:58:49.787770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728674+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:49.728674+0000","last_peered":"2024-04-22T19:58:49.728674+0000","last_clean":"2024-04-22T19:58:49.728674+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:49.728674+0000","last_undegraded":"2024-04-22T19:58:49.728674+0000","last_fullsized":"2024-04-22T19:58:49.728674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823797+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823797+0000","last_peered":"2024-04-22T19:58:54.823797+0000","last_clean":"2024-04-22T19:58:54.823797+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823797+0000","last_undegraded":"2024-04-22T19:58:54.823797+0000","last_fullsized":"2024-04-22T19:58:54.823797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778130+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:49.778130+0000","last_peered":"2024-04-22T19:58:49.778130+0000","last_clean":"2024-04-22T19:58:49.778130+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:49.778130+0000","last_undegraded":"2024-04-22T19:58:49.778130+0000","last_fullsized":"2024-04-22T19:58:49.778130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872374+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872374+0000","last_peered":"2024-04-22T19:58:52.872374+0000","last_clean":"2024-04-22T19:58:52.872374+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872374+0000","last_undegraded":"2024-04-22T19:58:52.872374+0000","last_fullsized":"2024-04-22T19:58:52.872374+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779647+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779647+0000","last_peered":"2024-04-22T19:58:49.779647+0000","last_clean":"2024-04-22T19:58:49.779647+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779647+0000","last_undegraded":"2024-04-22T19:58:49.779647+0000","last_fullsized":"2024-04-22T19:58:49.779647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731757+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731757+0000","last_peered":"2024-04-22T19:58:49.731757+0000","last_clean":"2024-04-22T19:58:49.731757+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731757+0000","last_undegraded":"2024-04-22T19:58:49.731757+0000","last_fullsized":"2024-04-22T19:58:49.731757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728959+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728959+0000","last_peered":"2024-04-22T19:58:49.728959+0000","last_clean":"2024-04-22T19:58:49.728959+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728959+0000","last_undegraded":"2024-04-22T19:58:49.728959+0000","last_fullsized":"2024-04-22T19:58:49.728959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778574+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778574+0000","last_peered":"2024-04-22T19:58:49.778574+0000","last_clean":"2024-04-22T19:58:49.778574+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778574+0000","last_undegraded":"2024-04-22T19:58:49.778574+0000","last_fullsized":"2024-04-22T19:58:49.778574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720688+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:49.720688+0000","last_peered":"2024-04-22T19:58:49.720688+0000","last_clean":"2024-04-22T19:58:49.720688+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:49.720688+0000","last_undegraded":"2024-04-22T19:58:49.720688+0000","last_fullsized":"2024-04-22T19:58:49.720688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781981+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781981+0000","last_peered":"2024-04-22T19:58:49.781981+0000","last_clean":"2024-04-22T19:58:49.781981+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781981+0000","last_undegraded":"2024-04-22T19:58:49.781981+0000","last_fullsized":"2024-04-22T19:58:49.781981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718925+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718925+0000","last_peered":"2024-04-22T19:58:49.718925+0000","last_clean":"2024-04-22T19:58:49.718925+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718925+0000","last_undegraded":"2024-04-22T19:58:49.718925+0000","last_fullsized":"2024-04-22T19:58:49.718925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731844+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731844+0000","last_peered":"2024-04-22T19:58:49.731844+0000","last_clean":"2024-04-22T19:58:49.731844+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731844+0000","last_undegraded":"2024-04-22T19:58:49.731844+0000","last_fullsized":"2024-04-22T19:58:49.731844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727106+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.727106+0000","last_peered":"2024-04-22T19:58:49.727106+0000","last_clean":"2024-04-22T19:58:49.727106+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.727106+0000","last_undegraded":"2024-04-22T19:58:49.727106+0000","last_fullsized":"2024-04-22T19:58:49.727106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780496+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780496+0000","last_peered":"2024-04-22T19:58:49.780496+0000","last_clean":"2024-04-22T19:58:49.780496+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780496+0000","last_undegraded":"2024-04-22T19:58:49.780496+0000","last_fullsized":"2024-04-22T19:58:49.780496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780807+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780807+0000","last_peered":"2024-04-22T19:58:49.780807+0000","last_clean":"2024-04-22T19:58:49.780807+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780807+0000","last_undegraded":"2024-04-22T19:58:49.780807+0000","last_fullsized":"2024-04-22T19:58:49.780807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732174+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732174+0000","last_peered":"2024-04-22T19:58:49.732174+0000","last_clean":"2024-04-22T19:58:49.732174+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732174+0000","last_undegraded":"2024-04-22T19:58:49.732174+0000","last_fullsized":"2024-04-22T19:58:49.732174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729122+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729122+0000","last_peered":"2024-04-22T19:58:49.729122+0000","last_clean":"2024-04-22T19:58:49.729122+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729122+0000","last_undegraded":"2024-04-22T19:58:49.729122+0000","last_fullsized":"2024-04-22T19:58:49.729122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729394+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729394+0000","last_peered":"2024-04-22T19:58:49.729394+0000","last_clean":"2024-04-22T19:58:49.729394+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729394+0000","last_undegraded":"2024-04-22T19:58:49.729394+0000","last_fullsized":"2024-04-22T19:58:49.729394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":408,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718103+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.718103+0000","last_peered":"2024-04-22T19:58:49.718103+0000","last_clean":"2024-04-22T19:58:49.718103+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.718103+0000","last_undegraded":"2024-04-22T19:58:49.718103+0000","last_fullsized":"2024-04-22T19:58:49.718103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724964+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724964+0000","last_peered":"2024-04-22T19:58:49.724964+0000","last_clean":"2024-04-22T19:58:49.724964+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724964+0000","last_undegraded":"2024-04-22T19:58:49.724964+0000","last_fullsized":"2024-04-22T19:58:49.724964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722262+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722262+0000","last_peered":"2024-04-22T19:58:49.722262+0000","last_clean":"2024-04-22T19:58:49.722262+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722262+0000","last_undegraded":"2024-04-22T19:58:49.722262+0000","last_fullsized":"2024-04-22T19:58:49.722262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":358,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577277+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577277+0000","last_peered":"2024-04-22T19:58:51.577277+0000","last_clean":"2024-04-22T19:58:51.577277+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577277+0000","last_undegraded":"2024-04-22T19:58:51.577277+0000","last_fullsized":"2024-04-22T19:58:51.577277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728084+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.728084+0000","last_peered":"2024-04-22T19:58:49.728084+0000","last_clean":"2024-04-22T19:58:49.728084+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.728084+0000","last_undegraded":"2024-04-22T19:58:49.728084+0000","last_fullsized":"2024-04-22T19:58:49.728084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718802+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718802+0000","last_peered":"2024-04-22T19:58:49.718802+0000","last_clean":"2024-04-22T19:58:49.718802+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718802+0000","last_undegraded":"2024-04-22T19:58:49.718802+0000","last_fullsized":"2024-04-22T19:58:49.718802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726829+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726829+0000","last_peered":"2024-04-22T19:58:49.726829+0000","last_clean":"2024-04-22T19:58:49.726829+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726829+0000","last_undegraded":"2024-04-22T19:58:49.726829+0000","last_fullsized":"2024-04-22T19:58:49.726829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722850+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722850+0000","last_peered":"2024-04-22T19:58:49.722850+0000","last_clean":"2024-04-22T19:58:49.722850+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722850+0000","last_undegraded":"2024-04-22T19:58:49.722850+0000","last_fullsized":"2024-04-22T19:58:49.722850+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103567+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103567+0000","last_peered":"2024-04-22T19:58:52.103567+0000","last_clean":"2024-04-22T19:58:52.103567+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103567+0000","last_undegraded":"2024-04-22T19:58:52.103567+0000","last_fullsized":"2024-04-22T19:58:52.103567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779442+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779442+0000","last_peered":"2024-04-22T19:58:49.779442+0000","last_clean":"2024-04-22T19:58:49.779442+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779442+0000","last_undegraded":"2024-04-22T19:58:49.779442+0000","last_fullsized":"2024-04-22T19:58:49.779442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728665+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728665+0000","last_peered":"2024-04-22T19:58:49.728665+0000","last_clean":"2024-04-22T19:58:49.728665+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728665+0000","last_undegraded":"2024-04-22T19:58:49.728665+0000","last_fullsized":"2024-04-22T19:58:49.728665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719970+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719970+0000","last_peered":"2024-04-22T19:58:49.719970+0000","last_clean":"2024-04-22T19:58:49.719970+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719970+0000","last_undegraded":"2024-04-22T19:58:49.719970+0000","last_fullsized":"2024-04-22T19:58:49.719970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.848072+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:49.848072+0000","last_peered":"2024-04-22T19:58:49.848072+0000","last_clean":"2024-04-22T19:58:49.848072+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:49.848072+0000","last_undegraded":"2024-04-22T19:58:49.848072+0000","last_fullsized":"2024-04-22T19:58:49.848072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720329+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720329+0000","last_peered":"2024-04-22T19:58:49.720329+0000","last_clean":"2024-04-22T19:58:49.720329+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720329+0000","last_undegraded":"2024-04-22T19:58:49.720329+0000","last_fullsized":"2024-04-22T19:58:49.720329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779333+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779333+0000","last_peered":"2024-04-22T19:58:49.779333+0000","last_clean":"2024-04-22T19:58:49.779333+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779333+0000","last_undegraded":"2024-04-22T19:58:49.779333+0000","last_fullsized":"2024-04-22T19:58:49.779333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721241+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721241+0000","last_peered":"2024-04-22T19:58:49.721241+0000","last_clean":"2024-04-22T19:58:49.721241+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721241+0000","last_undegraded":"2024-04-22T19:58:49.721241+0000","last_fullsized":"2024-04-22T19:58:49.721241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729783+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729783+0000","last_peered":"2024-04-22T19:58:49.729783+0000","last_clean":"2024-04-22T19:58:49.729783+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729783+0000","last_undegraded":"2024-04-22T19:58:49.729783+0000","last_fullsized":"2024-04-22T19:58:49.729783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728748+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:49.728748+0000","last_peered":"2024-04-22T19:58:49.728748+0000","last_clean":"2024-04-22T19:58:49.728748+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:49.728748+0000","last_undegraded":"2024-04-22T19:58:49.728748+0000","last_fullsized":"2024-04-22T19:58:49.728748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721254+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721254+0000","last_peered":"2024-04-22T19:58:49.721254+0000","last_clean":"2024-04-22T19:58:49.721254+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721254+0000","last_undegraded":"2024-04-22T19:58:49.721254+0000","last_fullsized":"2024-04-22T19:58:49.721254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720538+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720538+0000","last_peered":"2024-04-22T19:58:49.720538+0000","last_clean":"2024-04-22T19:58:49.720538+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720538+0000","last_undegraded":"2024-04-22T19:58:49.720538+0000","last_fullsized":"2024-04-22T19:58:49.720538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":305,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719766+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719766+0000","last_peered":"2024-04-22T19:58:49.719766+0000","last_clean":"2024-04-22T19:58:49.719766+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719766+0000","last_undegraded":"2024-04-22T19:58:49.719766+0000","last_fullsized":"2024-04-22T19:58:49.719766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":417,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782671+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782671+0000","last_peered":"2024-04-22T19:58:49.782671+0000","last_clean":"2024-04-22T19:58:49.782671+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782671+0000","last_undegraded":"2024-04-22T19:58:49.782671+0000","last_fullsized":"2024-04-22T19:58:49.782671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":69,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781463+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781463+0000","last_peered":"2024-04-22T19:58:49.781463+0000","last_clean":"2024-04-22T19:58:49.781463+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781463+0000","last_undegraded":"2024-04-22T19:58:49.781463+0000","last_fullsized":"2024-04-22T19:58:49.781463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":452,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784196+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:49.784196+0000","last_peered":"2024-04-22T19:58:49.784196+0000","last_clean":"2024-04-22T19:58:49.784196+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:49.784196+0000","last_undegraded":"2024-04-22T19:58:49.784196+0000","last_fullsized":"2024-04-22T19:58:49.784196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719225+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719225+0000","last_peered":"2024-04-22T19:58:49.719225+0000","last_clean":"2024-04-22T19:58:49.719225+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719225+0000","last_undegraded":"2024-04-22T19:58:49.719225+0000","last_fullsized":"2024-04-22T19:58:49.719225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720244+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720244+0000","last_peered":"2024-04-22T19:58:49.720244+0000","last_clean":"2024-04-22T19:58:49.720244+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720244+0000","last_undegraded":"2024-04-22T19:58:49.720244+0000","last_fullsized":"2024-04-22T19:58:49.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781603+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781603+0000","last_peered":"2024-04-22T19:58:49.781603+0000","last_clean":"2024-04-22T19:58:49.781603+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781603+0000","last_undegraded":"2024-04-22T19:58:49.781603+0000","last_fullsized":"2024-04-22T19:58:49.781603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780468+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:49.780468+0000","last_peered":"2024-04-22T19:58:49.780468+0000","last_clean":"2024-04-22T19:58:49.780468+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:49.780468+0000","last_undegraded":"2024-04-22T19:58:49.780468+0000","last_fullsized":"2024-04-22T19:58:49.780468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720731+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720731+0000","last_peered":"2024-04-22T19:58:49.720731+0000","last_clean":"2024-04-22T19:58:49.720731+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720731+0000","last_undegraded":"2024-04-22T19:58:49.720731+0000","last_fullsized":"2024-04-22T19:58:49.720731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784728+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784728+0000","last_peered":"2024-04-22T19:58:49.784728+0000","last_clean":"2024-04-22T19:58:49.784728+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784728+0000","last_undegraded":"2024-04-22T19:58:49.784728+0000","last_fullsized":"2024-04-22T19:58:49.784728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729545+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729545+0000","last_peered":"2024-04-22T19:58:49.729545+0000","last_clean":"2024-04-22T19:58:49.729545+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729545+0000","last_undegraded":"2024-04-22T19:58:49.729545+0000","last_fullsized":"2024-04-22T19:58:49.729545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781475+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781475+0000","last_peered":"2024-04-22T19:58:49.781475+0000","last_clean":"2024-04-22T19:58:49.781475+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781475+0000","last_undegraded":"2024-04-22T19:58:49.781475+0000","last_fullsized":"2024-04-22T19:58:49.781475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730855+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730855+0000","last_peered":"2024-04-22T19:58:49.730855+0000","last_clean":"2024-04-22T19:58:49.730855+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730855+0000","last_undegraded":"2024-04-22T19:58:49.730855+0000","last_fullsized":"2024-04-22T19:58:49.730855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":338,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783265+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783265+0000","last_peered":"2024-04-22T19:58:49.783265+0000","last_clean":"2024-04-22T19:58:49.783265+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783265+0000","last_undegraded":"2024-04-22T19:58:49.783265+0000","last_fullsized":"2024-04-22T19:58:49.783265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725143+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725143+0000","last_peered":"2024-04-22T19:58:49.725143+0000","last_clean":"2024-04-22T19:58:49.725143+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725143+0000","last_undegraded":"2024-04-22T19:58:49.725143+0000","last_fullsized":"2024-04-22T19:58:49.725143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777694+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777694+0000","last_peered":"2024-04-22T19:58:49.777694+0000","last_clean":"2024-04-22T19:58:49.777694+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777694+0000","last_undegraded":"2024-04-22T19:58:49.777694+0000","last_fullsized":"2024-04-22T19:58:49.777694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725613+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725613+0000","last_peered":"2024-04-22T19:58:49.725613+0000","last_clean":"2024-04-22T19:58:49.725613+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725613+0000","last_undegraded":"2024-04-22T19:58:49.725613+0000","last_fullsized":"2024-04-22T19:58:49.725613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729291+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729291+0000","last_peered":"2024-04-22T19:58:49.729291+0000","last_clean":"2024-04-22T19:58:49.729291+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729291+0000","last_undegraded":"2024-04-22T19:58:49.729291+0000","last_fullsized":"2024-04-22T19:58:49.729291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718816+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718816+0000","last_peered":"2024-04-22T19:58:49.718816+0000","last_clean":"2024-04-22T19:58:49.718816+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718816+0000","last_undegraded":"2024-04-22T19:58:49.718816+0000","last_fullsized":"2024-04-22T19:58:49.718816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784820+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784820+0000","last_peered":"2024-04-22T19:58:49.784820+0000","last_clean":"2024-04-22T19:58:49.784820+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784820+0000","last_undegraded":"2024-04-22T19:58:49.784820+0000","last_fullsized":"2024-04-22T19:58:49.784820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":503,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721143+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721143+0000","last_peered":"2024-04-22T19:58:49.721143+0000","last_clean":"2024-04-22T19:58:49.721143+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721143+0000","last_undegraded":"2024-04-22T19:58:49.721143+0000","last_fullsized":"2024-04-22T19:58:49.721143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730831+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730831+0000","last_peered":"2024-04-22T19:58:49.730831+0000","last_clean":"2024-04-22T19:58:49.730831+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730831+0000","last_undegraded":"2024-04-22T19:58:49.730831+0000","last_fullsized":"2024-04-22T19:58:49.730831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720365+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720365+0000","last_peered":"2024-04-22T19:58:49.720365+0000","last_clean":"2024-04-22T19:58:49.720365+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720365+0000","last_undegraded":"2024-04-22T19:58:49.720365+0000","last_fullsized":"2024-04-22T19:58:49.720365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723513+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723513+0000","last_peered":"2024-04-22T19:58:49.723513+0000","last_clean":"2024-04-22T19:58:49.723513+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723513+0000","last_undegraded":"2024-04-22T19:58:49.723513+0000","last_fullsized":"2024-04-22T19:58:49.723513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727710+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727710+0000","last_peered":"2024-04-22T19:58:49.727710+0000","last_clean":"2024-04-22T19:58:49.727710+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727710+0000","last_undegraded":"2024-04-22T19:58:49.727710+0000","last_fullsized":"2024-04-22T19:58:49.727710+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720445+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720445+0000","last_peered":"2024-04-22T19:58:49.720445+0000","last_clean":"2024-04-22T19:58:49.720445+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720445+0000","last_undegraded":"2024-04-22T19:58:49.720445+0000","last_fullsized":"2024-04-22T19:58:49.720445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":325,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729218+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729218+0000","last_peered":"2024-04-22T19:58:49.729218+0000","last_clean":"2024-04-22T19:58:49.729218+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729218+0000","last_undegraded":"2024-04-22T19:58:49.729218+0000","last_fullsized":"2024-04-22T19:58:49.729218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731596+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731596+0000","last_peered":"2024-04-22T19:58:49.731596+0000","last_clean":"2024-04-22T19:58:49.731596+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731596+0000","last_undegraded":"2024-04-22T19:58:49.731596+0000","last_fullsized":"2024-04-22T19:58:49.731596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723336+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723336+0000","last_peered":"2024-04-22T19:58:49.723336+0000","last_clean":"2024-04-22T19:58:49.723336+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723336+0000","last_undegraded":"2024-04-22T19:58:49.723336+0000","last_fullsized":"2024-04-22T19:58:49.723336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783753+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783753+0000","last_peered":"2024-04-22T19:58:49.783753+0000","last_clean":"2024-04-22T19:58:49.783753+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783753+0000","last_undegraded":"2024-04-22T19:58:49.783753+0000","last_fullsized":"2024-04-22T19:58:49.783753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721618+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721618+0000","last_peered":"2024-04-22T19:58:49.721618+0000","last_clean":"2024-04-22T19:58:49.721618+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721618+0000","last_undegraded":"2024-04-22T19:58:49.721618+0000","last_fullsized":"2024-04-22T19:58:49.721618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781547+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781547+0000","last_peered":"2024-04-22T19:58:49.781547+0000","last_clean":"2024-04-22T19:58:49.781547+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781547+0000","last_undegraded":"2024-04-22T19:58:49.781547+0000","last_fullsized":"2024-04-22T19:58:49.781547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719703+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719703+0000","last_peered":"2024-04-22T19:58:49.719703+0000","last_clean":"2024-04-22T19:58:49.719703+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719703+0000","last_undegraded":"2024-04-22T19:58:49.719703+0000","last_fullsized":"2024-04-22T19:58:49.719703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724590+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724590+0000","last_peered":"2024-04-22T19:58:49.724590+0000","last_clean":"2024-04-22T19:58:49.724590+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724590+0000","last_undegraded":"2024-04-22T19:58:49.724590+0000","last_fullsized":"2024-04-22T19:58:49.724590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785785+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785785+0000","last_peered":"2024-04-22T19:58:49.785785+0000","last_clean":"2024-04-22T19:58:49.785785+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785785+0000","last_undegraded":"2024-04-22T19:58:49.785785+0000","last_fullsized":"2024-04-22T19:58:49.785785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778349+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778349+0000","last_peered":"2024-04-22T19:58:49.778349+0000","last_clean":"2024-04-22T19:58:49.778349+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778349+0000","last_undegraded":"2024-04-22T19:58:49.778349+0000","last_fullsized":"2024-04-22T19:58:49.778349+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720927+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720927+0000","last_peered":"2024-04-22T19:58:49.720927+0000","last_clean":"2024-04-22T19:58:49.720927+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720927+0000","last_undegraded":"2024-04-22T19:58:49.720927+0000","last_fullsized":"2024-04-22T19:58:49.720927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":331,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784400+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.784400+0000","last_peered":"2024-04-22T19:58:49.784400+0000","last_clean":"2024-04-22T19:58:49.784400+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.784400+0000","last_undegraded":"2024-04-22T19:58:49.784400+0000","last_fullsized":"2024-04-22T19:58:49.784400+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721907+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721907+0000","last_peered":"2024-04-22T19:58:49.721907+0000","last_clean":"2024-04-22T19:58:49.721907+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721907+0000","last_undegraded":"2024-04-22T19:58:49.721907+0000","last_fullsized":"2024-04-22T19:58:49.721907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720812+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720812+0000","last_peered":"2024-04-22T19:58:49.720812+0000","last_clean":"2024-04-22T19:58:49.720812+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720812+0000","last_undegraded":"2024-04-22T19:58:49.720812+0000","last_fullsized":"2024-04-22T19:58:49.720812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839511+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839511+0000","last_peered":"2024-04-22T19:58:52.839511+0000","last_clean":"2024-04-22T19:58:52.839511+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839511+0000","last_undegraded":"2024-04-22T19:58:52.839511+0000","last_fullsized":"2024-04-22T19:58:52.839511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718405+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718405+0000","last_peered":"2024-04-22T19:58:49.718405+0000","last_clean":"2024-04-22T19:58:49.718405+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718405+0000","last_undegraded":"2024-04-22T19:58:49.718405+0000","last_fullsized":"2024-04-22T19:58:49.718405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724418+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:49.724418+0000","last_peered":"2024-04-22T19:58:49.724418+0000","last_clean":"2024-04-22T19:58:49.724418+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:49.724418+0000","last_undegraded":"2024-04-22T19:58:49.724418+0000","last_fullsized":"2024-04-22T19:58:49.724418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722047+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.722047+0000","last_peered":"2024-04-22T19:58:49.722047+0000","last_clean":"2024-04-22T19:58:49.722047+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.722047+0000","last_undegraded":"2024-04-22T19:58:49.722047+0000","last_fullsized":"2024-04-22T19:58:49.722047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732453+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732453+0000","last_peered":"2024-04-22T19:58:49.732453+0000","last_clean":"2024-04-22T19:58:49.732453+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732453+0000","last_undegraded":"2024-04-22T19:58:49.732453+0000","last_fullsized":"2024-04-22T19:58:49.732453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778655+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778655+0000","last_peered":"2024-04-22T19:58:49.778655+0000","last_clean":"2024-04-22T19:58:49.778655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778655+0000","last_undegraded":"2024-04-22T19:58:49.778655+0000","last_fullsized":"2024-04-22T19:58:49.778655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720753+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720753+0000","last_peered":"2024-04-22T19:58:49.720753+0000","last_clean":"2024-04-22T19:58:49.720753+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720753+0000","last_undegraded":"2024-04-22T19:58:49.720753+0000","last_fullsized":"2024-04-22T19:58:49.720753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779292+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779292+0000","last_peered":"2024-04-22T19:58:49.779292+0000","last_clean":"2024-04-22T19:58:49.779292+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779292+0000","last_undegraded":"2024-04-22T19:58:49.779292+0000","last_fullsized":"2024-04-22T19:58:49.779292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787894+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787894+0000","last_peered":"2024-04-22T19:58:49.787894+0000","last_clean":"2024-04-22T19:58:49.787894+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787894+0000","last_undegraded":"2024-04-22T19:58:49.787894+0000","last_fullsized":"2024-04-22T19:58:49.787894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723854+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723854+0000","last_peered":"2024-04-22T19:58:49.723854+0000","last_clean":"2024-04-22T19:58:49.723854+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723854+0000","last_undegraded":"2024-04-22T19:58:49.723854+0000","last_fullsized":"2024-04-22T19:58:49.723854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718745+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718745+0000","last_peered":"2024-04-22T19:58:49.718745+0000","last_clean":"2024-04-22T19:58:49.718745+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718745+0000","last_undegraded":"2024-04-22T19:58:49.718745+0000","last_fullsized":"2024-04-22T19:58:49.718745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121529+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121529+0000","last_peered":"2024-04-22T19:58:53.121529+0000","last_clean":"2024-04-22T19:58:53.121529+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121529+0000","last_undegraded":"2024-04-22T19:58:53.121529+0000","last_fullsized":"2024-04-22T19:58:53.121529+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723591+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:49.723591+0000","last_peered":"2024-04-22T19:58:49.723591+0000","last_clean":"2024-04-22T19:58:49.723591+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:49.723591+0000","last_undegraded":"2024-04-22T19:58:49.723591+0000","last_fullsized":"2024-04-22T19:58:49.723591+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719083+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.719083+0000","last_peered":"2024-04-22T19:58:49.719083+0000","last_clean":"2024-04-22T19:58:49.719083+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.719083+0000","last_undegraded":"2024-04-22T19:58:49.719083+0000","last_fullsized":"2024-04-22T19:58:49.719083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725868+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725868+0000","last_peered":"2024-04-22T19:58:49.725868+0000","last_clean":"2024-04-22T19:58:49.725868+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725868+0000","last_undegraded":"2024-04-22T19:58:49.725868+0000","last_fullsized":"2024-04-22T19:58:49.725868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786647+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786647+0000","last_peered":"2024-04-22T19:58:49.786647+0000","last_clean":"2024-04-22T19:58:49.786647+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786647+0000","last_undegraded":"2024-04-22T19:58:49.786647+0000","last_fullsized":"2024-04-22T19:58:49.786647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":312,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730066+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.730066+0000","last_peered":"2024-04-22T19:58:49.730066+0000","last_clean":"2024-04-22T19:58:49.730066+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.730066+0000","last_undegraded":"2024-04-22T19:58:49.730066+0000","last_fullsized":"2024-04-22T19:58:49.730066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781281+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:49.781281+0000","last_peered":"2024-04-22T19:58:49.781281+0000","last_clean":"2024-04-22T19:58:49.781281+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:49.781281+0000","last_undegraded":"2024-04-22T19:58:49.781281+0000","last_fullsized":"2024-04-22T19:58:49.781281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724733+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724733+0000","last_peered":"2024-04-22T19:58:49.724733+0000","last_clean":"2024-04-22T19:58:49.724733+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724733+0000","last_undegraded":"2024-04-22T19:58:49.724733+0000","last_fullsized":"2024-04-22T19:58:49.724733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719230+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:49.719230+0000","last_peered":"2024-04-22T19:58:49.719230+0000","last_clean":"2024-04-22T19:58:49.719230+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:49.719230+0000","last_undegraded":"2024-04-22T19:58:49.719230+0000","last_fullsized":"2024-04-22T19:58:49.719230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719477+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:49.719477+0000","last_peered":"2024-04-22T19:58:49.719477+0000","last_clean":"2024-04-22T19:58:49.719477+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:49.719477+0000","last_undegraded":"2024-04-22T19:58:49.719477+0000","last_fullsized":"2024-04-22T19:58:49.719477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724083+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:49.724083+0000","last_peered":"2024-04-22T19:58:49.724083+0000","last_clean":"2024-04-22T19:58:49.724083+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:49.724083+0000","last_undegraded":"2024-04-22T19:58:49.724083+0000","last_fullsized":"2024-04-22T19:58:49.724083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778734+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778734+0000","last_peered":"2024-04-22T19:58:49.778734+0000","last_clean":"2024-04-22T19:58:49.778734+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778734+0000","last_undegraded":"2024-04-22T19:58:49.778734+0000","last_fullsized":"2024-04-22T19:58:49.778734+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781767+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.781767+0000","last_peered":"2024-04-22T19:58:49.781767+0000","last_clean":"2024-04-22T19:58:49.781767+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.781767+0000","last_undegraded":"2024-04-22T19:58:49.781767+0000","last_fullsized":"2024-04-22T19:58:49.781767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721303+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:49.721303+0000","last_peered":"2024-04-22T19:58:49.721303+0000","last_clean":"2024-04-22T19:58:49.721303+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:49.721303+0000","last_undegraded":"2024-04-22T19:58:49.721303+0000","last_fullsized":"2024-04-22T19:58:49.721303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821961+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821961+0000","last_peered":"2024-04-22T19:58:49.821961+0000","last_clean":"2024-04-22T19:58:49.821961+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821961+0000","last_undegraded":"2024-04-22T19:58:49.821961+0000","last_fullsized":"2024-04-22T19:58:49.821961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718236+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:49.718236+0000","last_peered":"2024-04-22T19:58:49.718236+0000","last_clean":"2024-04-22T19:58:49.718236+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:49.718236+0000","last_undegraded":"2024-04-22T19:58:49.718236+0000","last_fullsized":"2024-04-22T19:58:49.718236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729315+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:58:49.729315+0000","last_peered":"2024-04-22T19:58:49.729315+0000","last_clean":"2024-04-22T19:58:49.729315+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:58:49.729315+0000","last_undegraded":"2024-04-22T19:58:49.729315+0000","last_fullsized":"2024-04-22T19:58:49.729315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780035+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.780035+0000","last_peered":"2024-04-22T19:58:49.780035+0000","last_clean":"2024-04-22T19:58:49.780035+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.780035+0000","last_undegraded":"2024-04-22T19:58:49.780035+0000","last_fullsized":"2024-04-22T19:58:49.780035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728537+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:49.728537+0000","last_peered":"2024-04-22T19:58:49.728537+0000","last_clean":"2024-04-22T19:58:49.728537+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:49.728537+0000","last_undegraded":"2024-04-22T19:58:49.728537+0000","last_fullsized":"2024-04-22T19:58:49.728537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780166+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780166+0000","last_peered":"2024-04-22T19:58:49.780166+0000","last_clean":"2024-04-22T19:58:49.780166+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780166+0000","last_undegraded":"2024-04-22T19:58:49.780166+0000","last_fullsized":"2024-04-22T19:58:49.780166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778442+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:58:49.778442+0000","last_peered":"2024-04-22T19:58:49.778442+0000","last_clean":"2024-04-22T19:58:49.778442+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:58:49.778442+0000","last_undegraded":"2024-04-22T19:58:49.778442+0000","last_fullsized":"2024-04-22T19:58:49.778442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871339+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871339+0000","last_peered":"2024-04-22T19:58:50.871339+0000","last_clean":"2024-04-22T19:58:50.871339+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871339+0000","last_undegraded":"2024-04-22T19:58:50.871339+0000","last_fullsized":"2024-04-22T19:58:50.871339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778282+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:49.778282+0000","last_peered":"2024-04-22T19:58:49.778282+0000","last_clean":"2024-04-22T19:58:49.778282+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:49.778282+0000","last_undegraded":"2024-04-22T19:58:49.778282+0000","last_fullsized":"2024-04-22T19:58:49.778282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729402+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:49.729402+0000","last_peered":"2024-04-22T19:58:49.729402+0000","last_clean":"2024-04-22T19:58:49.729402+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:49.729402+0000","last_undegraded":"2024-04-22T19:58:49.729402+0000","last_fullsized":"2024-04-22T19:58:49.729402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719789+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:58:49.719789+0000","last_peered":"2024-04-22T19:58:49.719789+0000","last_clean":"2024-04-22T19:58:49.719789+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:58:49.719789+0000","last_undegraded":"2024-04-22T19:58:49.719789+0000","last_fullsized":"2024-04-22T19:58:49.719789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786228+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786228+0000","last_peered":"2024-04-22T19:58:49.786228+0000","last_clean":"2024-04-22T19:58:49.786228+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786228+0000","last_undegraded":"2024-04-22T19:58:49.786228+0000","last_fullsized":"2024-04-22T19:58:49.786228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778906+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778906+0000","last_peered":"2024-04-22T19:58:49.778906+0000","last_clean":"2024-04-22T19:58:49.778906+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778906+0000","last_undegraded":"2024-04-22T19:58:49.778906+0000","last_fullsized":"2024-04-22T19:58:49.778906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725206+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725206+0000","last_peered":"2024-04-22T19:58:49.725206+0000","last_clean":"2024-04-22T19:58:49.725206+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725206+0000","last_undegraded":"2024-04-22T19:58:49.725206+0000","last_fullsized":"2024-04-22T19:58:49.725206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781415+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781415+0000","last_peered":"2024-04-22T19:58:49.781415+0000","last_clean":"2024-04-22T19:58:49.781415+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781415+0000","last_undegraded":"2024-04-22T19:58:49.781415+0000","last_fullsized":"2024-04-22T19:58:49.781415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725477+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725477+0000","last_peered":"2024-04-22T19:58:49.725477+0000","last_clean":"2024-04-22T19:58:49.725477+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725477+0000","last_undegraded":"2024-04-22T19:58:49.725477+0000","last_fullsized":"2024-04-22T19:58:49.725477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785788+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785788+0000","last_peered":"2024-04-22T19:58:49.785788+0000","last_clean":"2024-04-22T19:58:49.785788+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785788+0000","last_undegraded":"2024-04-22T19:58:49.785788+0000","last_fullsized":"2024-04-22T19:58:49.785788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778164+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:58:49.778164+0000","last_peered":"2024-04-22T19:58:49.778164+0000","last_clean":"2024-04-22T19:58:49.778164+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:58:49.778164+0000","last_undegraded":"2024-04-22T19:58:49.778164+0000","last_fullsized":"2024-04-22T19:58:49.778164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779914+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779914+0000","last_peered":"2024-04-22T19:58:49.779914+0000","last_clean":"2024-04-22T19:58:49.779914+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779914+0000","last_undegraded":"2024-04-22T19:58:49.779914+0000","last_fullsized":"2024-04-22T19:58:49.779914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722495+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722495+0000","last_peered":"2024-04-22T19:58:49.722495+0000","last_clean":"2024-04-22T19:58:49.722495+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722495+0000","last_undegraded":"2024-04-22T19:58:49.722495+0000","last_fullsized":"2024-04-22T19:58:49.722495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779017+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:58:49.779017+0000","last_peered":"2024-04-22T19:58:49.779017+0000","last_clean":"2024-04-22T19:58:49.779017+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:58:49.779017+0000","last_undegraded":"2024-04-22T19:58:49.779017+0000","last_fullsized":"2024-04-22T19:58:49.779017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720078+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.720078+0000","last_peered":"2024-04-22T19:58:49.720078+0000","last_clean":"2024-04-22T19:58:49.720078+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.720078+0000","last_undegraded":"2024-04-22T19:58:49.720078+0000","last_fullsized":"2024-04-22T19:58:49.720078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":435,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785100+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.785100+0000","last_peered":"2024-04-22T19:58:49.785100+0000","last_clean":"2024-04-22T19:58:49.785100+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.785100+0000","last_undegraded":"2024-04-22T19:58:49.785100+0000","last_fullsized":"2024-04-22T19:58:49.785100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728528+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:58:49.728528+0000","last_peered":"2024-04-22T19:58:49.728528+0000","last_clean":"2024-04-22T19:58:49.728528+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:58:49.728528+0000","last_undegraded":"2024-04-22T19:58:49.728528+0000","last_fullsized":"2024-04-22T19:58:49.728528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779236+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779236+0000","last_peered":"2024-04-22T19:58:49.779236+0000","last_clean":"2024-04-22T19:58:49.779236+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779236+0000","last_undegraded":"2024-04-22T19:58:49.779236+0000","last_fullsized":"2024-04-22T19:58:49.779236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778873+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778873+0000","last_peered":"2024-04-22T19:58:49.778873+0000","last_clean":"2024-04-22T19:58:49.778873+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778873+0000","last_undegraded":"2024-04-22T19:58:49.778873+0000","last_fullsized":"2024-04-22T19:58:49.778873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":66,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783540+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783540+0000","last_peered":"2024-04-22T19:58:49.783540+0000","last_clean":"2024-04-22T19:58:49.783540+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783540+0000","last_undegraded":"2024-04-22T19:58:49.783540+0000","last_fullsized":"2024-04-22T19:58:49.783540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725683+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725683+0000","last_peered":"2024-04-22T19:58:49.725683+0000","last_clean":"2024-04-22T19:58:49.725683+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725683+0000","last_undegraded":"2024-04-22T19:58:49.725683+0000","last_fullsized":"2024-04-22T19:58:49.725683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723301+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723301+0000","last_peered":"2024-04-22T19:58:49.723301+0000","last_clean":"2024-04-22T19:58:49.723301+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723301+0000","last_undegraded":"2024-04-22T19:58:49.723301+0000","last_fullsized":"2024-04-22T19:58:49.723301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777755+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777755+0000","last_peered":"2024-04-22T19:58:49.777755+0000","last_clean":"2024-04-22T19:58:49.777755+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777755+0000","last_undegraded":"2024-04-22T19:58:49.777755+0000","last_fullsized":"2024-04-22T19:58:49.777755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723195+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723195+0000","last_peered":"2024-04-22T19:58:49.723195+0000","last_clean":"2024-04-22T19:58:49.723195+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723195+0000","last_undegraded":"2024-04-22T19:58:49.723195+0000","last_fullsized":"2024-04-22T19:58:49.723195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727305+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727305+0000","last_peered":"2024-04-22T19:58:49.727305+0000","last_clean":"2024-04-22T19:58:49.727305+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727305+0000","last_undegraded":"2024-04-22T19:58:49.727305+0000","last_fullsized":"2024-04-22T19:58:49.727305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783167+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783167+0000","last_peered":"2024-04-22T19:58:49.783167+0000","last_clean":"2024-04-22T19:58:49.783167+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783167+0000","last_undegraded":"2024-04-22T19:58:49.783167+0000","last_fullsized":"2024-04-22T19:58:49.783167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":356,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617855+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617855+0000","last_peered":"2024-04-22T19:58:50.617855+0000","last_clean":"2024-04-22T19:58:50.617855+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617855+0000","last_undegraded":"2024-04-22T19:58:50.617855+0000","last_fullsized":"2024-04-22T19:58:50.617855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721858+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721858+0000","last_peered":"2024-04-22T19:58:49.721858+0000","last_clean":"2024-04-22T19:58:49.721858+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721858+0000","last_undegraded":"2024-04-22T19:58:49.721858+0000","last_fullsized":"2024-04-22T19:58:49.721858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869837+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869837+0000","last_peered":"2024-04-22T19:58:51.869837+0000","last_clean":"2024-04-22T19:58:51.869837+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869837+0000","last_undegraded":"2024-04-22T19:58:51.869837+0000","last_fullsized":"2024-04-22T19:58:51.869837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687726+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:50.687726+0000","last_peered":"2024-04-22T19:58:50.687726+0000","last_clean":"2024-04-22T19:58:50.687726+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:50.687726+0000","last_undegraded":"2024-04-22T19:58:50.687726+0000","last_fullsized":"2024-04-22T19:58:50.687726+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720641+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720641+0000","last_peered":"2024-04-22T19:58:49.720641+0000","last_clean":"2024-04-22T19:58:49.720641+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720641+0000","last_undegraded":"2024-04-22T19:58:49.720641+0000","last_fullsized":"2024-04-22T19:58:49.720641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":335,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722992+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722992+0000","last_peered":"2024-04-22T19:58:49.722992+0000","last_clean":"2024-04-22T19:58:49.722992+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722992+0000","last_undegraded":"2024-04-22T19:58:49.722992+0000","last_fullsized":"2024-04-22T19:58:49.722992+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785909+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785909+0000","last_peered":"2024-04-22T19:58:49.785909+0000","last_clean":"2024-04-22T19:58:49.785909+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785909+0000","last_undegraded":"2024-04-22T19:58:49.785909+0000","last_fullsized":"2024-04-22T19:58:49.785909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777695+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777695+0000","last_peered":"2024-04-22T19:58:49.777695+0000","last_clean":"2024-04-22T19:58:49.777695+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777695+0000","last_undegraded":"2024-04-22T19:58:49.777695+0000","last_fullsized":"2024-04-22T19:58:49.777695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871862+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871862+0000","last_peered":"2024-04-22T19:58:53.871862+0000","last_clean":"2024-04-22T19:58:53.871862+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871862+0000","last_undegraded":"2024-04-22T19:58:53.871862+0000","last_fullsized":"2024-04-22T19:58:53.871862+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":367,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628061+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628061+0000","last_peered":"2024-04-22T19:58:53.628061+0000","last_clean":"2024-04-22T19:58:53.628061+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628061+0000","last_undegraded":"2024-04-22T19:58:53.628061+0000","last_fullsized":"2024-04-22T19:58:53.628061+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720783+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:49.720783+0000","last_peered":"2024-04-22T19:58:49.720783+0000","last_clean":"2024-04-22T19:58:49.720783+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:49.720783+0000","last_undegraded":"2024-04-22T19:58:49.720783+0000","last_fullsized":"2024-04-22T19:58:49.720783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":156,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782158+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782158+0000","last_peered":"2024-04-22T19:58:49.782158+0000","last_clean":"2024-04-22T19:58:49.782158+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782158+0000","last_undegraded":"2024-04-22T19:58:49.782158+0000","last_fullsized":"2024-04-22T19:58:49.782158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729647+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729647+0000","last_peered":"2024-04-22T19:58:49.729647+0000","last_clean":"2024-04-22T19:58:49.729647+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729647+0000","last_undegraded":"2024-04-22T19:58:49.729647+0000","last_fullsized":"2024-04-22T19:58:49.729647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781013+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.781013+0000","last_peered":"2024-04-22T19:58:49.781013+0000","last_clean":"2024-04-22T19:58:49.781013+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.781013+0000","last_undegraded":"2024-04-22T19:58:49.781013+0000","last_fullsized":"2024-04-22T19:58:49.781013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721225+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721225+0000","last_peered":"2024-04-22T19:58:49.721225+0000","last_clean":"2024-04-22T19:58:49.721225+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721225+0000","last_undegraded":"2024-04-22T19:58:49.721225+0000","last_fullsized":"2024-04-22T19:58:49.721225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":74,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.843342+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:49.843342+0000","last_peered":"2024-04-22T19:58:49.843342+0000","last_clean":"2024-04-22T19:58:49.843342+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:49.843342+0000","last_undegraded":"2024-04-22T19:58:49.843342+0000","last_fullsized":"2024-04-22T19:58:49.843342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369242+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369242+0000","last_peered":"2024-04-22T19:58:52.369242+0000","last_clean":"2024-04-22T19:58:52.369242+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369242+0000","last_undegraded":"2024-04-22T19:58:52.369242+0000","last_fullsized":"2024-04-22T19:58:52.369242+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781363+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781363+0000","last_peered":"2024-04-22T19:58:49.781363+0000","last_clean":"2024-04-22T19:58:49.781363+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781363+0000","last_undegraded":"2024-04-22T19:58:49.781363+0000","last_fullsized":"2024-04-22T19:58:49.781363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719016+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.719016+0000","last_peered":"2024-04-22T19:58:49.719016+0000","last_clean":"2024-04-22T19:58:49.719016+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.719016+0000","last_undegraded":"2024-04-22T19:58:49.719016+0000","last_fullsized":"2024-04-22T19:58:49.719016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732474+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732474+0000","last_peered":"2024-04-22T19:58:49.732474+0000","last_clean":"2024-04-22T19:58:49.732474+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732474+0000","last_undegraded":"2024-04-22T19:58:49.732474+0000","last_fullsized":"2024-04-22T19:58:49.732474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729438+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:49.729438+0000","last_peered":"2024-04-22T19:58:49.729438+0000","last_clean":"2024-04-22T19:58:49.729438+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:49.729438+0000","last_undegraded":"2024-04-22T19:58:49.729438+0000","last_fullsized":"2024-04-22T19:58:49.729438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357646+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357646+0000","last_peered":"2024-04-22T19:58:51.357646+0000","last_clean":"2024-04-22T19:58:51.357646+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357646+0000","last_undegraded":"2024-04-22T19:58:51.357646+0000","last_fullsized":"2024-04-22T19:58:51.357646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779849+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:49.779849+0000","last_peered":"2024-04-22T19:58:49.779849+0000","last_clean":"2024-04-22T19:58:49.779849+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:49.779849+0000","last_undegraded":"2024-04-22T19:58:49.779849+0000","last_fullsized":"2024-04-22T19:58:49.779849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724352+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:49.724352+0000","last_peered":"2024-04-22T19:58:49.724352+0000","last_clean":"2024-04-22T19:58:49.724352+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:49.724352+0000","last_undegraded":"2024-04-22T19:58:49.724352+0000","last_fullsized":"2024-04-22T19:58:49.724352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783301+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783301+0000","last_peered":"2024-04-22T19:58:49.783301+0000","last_clean":"2024-04-22T19:58:49.783301+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783301+0000","last_undegraded":"2024-04-22T19:58:49.783301+0000","last_fullsized":"2024-04-22T19:58:49.783301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:01:01.949 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T20:01:01.949 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:01:21.950 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:01:22.305 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:01:22.311 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:01:22.322 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-04-22T20:01:21.528326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005840"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731664+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731664+0000","last_peered":"2024-04-22T19:58:49.731664+0000","last_clean":"2024-04-22T19:58:49.731664+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731664+0000","last_undegraded":"2024-04-22T19:58:49.731664+0000","last_fullsized":"2024-04-22T19:58:49.731664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779035+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:58:49.779035+0000","last_peered":"2024-04-22T19:58:49.779035+0000","last_clean":"2024-04-22T19:58:49.779035+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:58:49.779035+0000","last_undegraded":"2024-04-22T19:58:49.779035+0000","last_fullsized":"2024-04-22T19:58:49.779035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723614+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723614+0000","last_peered":"2024-04-22T19:58:49.723614+0000","last_clean":"2024-04-22T19:58:49.723614+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723614+0000","last_undegraded":"2024-04-22T19:58:49.723614+0000","last_fullsized":"2024-04-22T19:58:49.723614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729229+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:58:49.729229+0000","last_peered":"2024-04-22T19:58:49.729229+0000","last_clean":"2024-04-22T19:58:49.729229+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:58:49.729229+0000","last_undegraded":"2024-04-22T19:58:49.729229+0000","last_fullsized":"2024-04-22T19:58:49.729229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725001+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.725001+0000","last_peered":"2024-04-22T19:58:49.725001+0000","last_clean":"2024-04-22T19:58:49.725001+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.725001+0000","last_undegraded":"2024-04-22T19:58:49.725001+0000","last_fullsized":"2024-04-22T19:58:49.725001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719496+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:58:49.719496+0000","last_peered":"2024-04-22T19:58:49.719496+0000","last_clean":"2024-04-22T19:58:49.719496+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:58:49.719496+0000","last_undegraded":"2024-04-22T19:58:49.719496+0000","last_fullsized":"2024-04-22T19:58:49.719496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":347,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601604+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601604+0000","last_peered":"2024-04-22T19:58:52.601604+0000","last_clean":"2024-04-22T19:58:52.601604+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601604+0000","last_undegraded":"2024-04-22T19:58:52.601604+0000","last_fullsized":"2024-04-22T19:58:52.601604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.848092+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:58:50.848092+0000","last_peered":"2024-04-22T19:58:50.848092+0000","last_clean":"2024-04-22T19:58:50.848092+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:58:50.848092+0000","last_undegraded":"2024-04-22T19:58:50.848092+0000","last_fullsized":"2024-04-22T19:58:50.848092+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730771+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:58:49.730771+0000","last_peered":"2024-04-22T19:58:49.730771+0000","last_clean":"2024-04-22T19:58:49.730771+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:58:49.730771+0000","last_undegraded":"2024-04-22T19:58:49.730771+0000","last_fullsized":"2024-04-22T19:58:49.730771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780957+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780957+0000","last_peered":"2024-04-22T19:58:49.780957+0000","last_clean":"2024-04-22T19:58:49.780957+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780957+0000","last_undegraded":"2024-04-22T19:58:49.780957+0000","last_fullsized":"2024-04-22T19:58:49.780957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780376+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:58:49.780376+0000","last_peered":"2024-04-22T19:58:49.780376+0000","last_clean":"2024-04-22T19:58:49.780376+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:58:49.780376+0000","last_undegraded":"2024-04-22T19:58:49.780376+0000","last_fullsized":"2024-04-22T19:58:49.780376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720074+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.720074+0000","last_peered":"2024-04-22T19:58:49.720074+0000","last_clean":"2024-04-22T19:58:49.720074+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.720074+0000","last_undegraded":"2024-04-22T19:58:49.720074+0000","last_fullsized":"2024-04-22T19:58:49.720074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729572+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:58:49.729572+0000","last_peered":"2024-04-22T19:58:49.729572+0000","last_clean":"2024-04-22T19:58:49.729572+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:58:49.729572+0000","last_undegraded":"2024-04-22T19:58:49.729572+0000","last_fullsized":"2024-04-22T19:58:49.729572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783725+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783725+0000","last_peered":"2024-04-22T19:58:49.783725+0000","last_clean":"2024-04-22T19:58:49.783725+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783725+0000","last_undegraded":"2024-04-22T19:58:49.783725+0000","last_fullsized":"2024-04-22T19:58:49.783725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780819+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.780819+0000","last_peered":"2024-04-22T19:58:49.780819+0000","last_clean":"2024-04-22T19:58:49.780819+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.780819+0000","last_undegraded":"2024-04-22T19:58:49.780819+0000","last_fullsized":"2024-04-22T19:58:49.780819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729828+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729828+0000","last_peered":"2024-04-22T19:58:49.729828+0000","last_clean":"2024-04-22T19:58:49.729828+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729828+0000","last_undegraded":"2024-04-22T19:58:49.729828+0000","last_fullsized":"2024-04-22T19:58:49.729828+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.703892+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:50.703892+0000","last_peered":"2024-04-22T19:58:50.703892+0000","last_clean":"2024-04-22T19:58:50.703892+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:50.703892+0000","last_undegraded":"2024-04-22T19:58:50.703892+0000","last_fullsized":"2024-04-22T19:58:50.703892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":159,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730944+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730944+0000","last_peered":"2024-04-22T19:58:49.730944+0000","last_clean":"2024-04-22T19:58:49.730944+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730944+0000","last_undegraded":"2024-04-22T19:58:49.730944+0000","last_fullsized":"2024-04-22T19:58:49.730944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704725+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:50.704725+0000","last_peered":"2024-04-22T19:58:50.704725+0000","last_clean":"2024-04-22T19:58:50.704725+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:50.704725+0000","last_undegraded":"2024-04-22T19:58:50.704725+0000","last_fullsized":"2024-04-22T19:58:50.704725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785691+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:58:49.785691+0000","last_peered":"2024-04-22T19:58:49.785691+0000","last_clean":"2024-04-22T19:58:49.785691+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:58:49.785691+0000","last_undegraded":"2024-04-22T19:58:49.785691+0000","last_fullsized":"2024-04-22T19:58:49.785691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728180+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:50.728180+0000","last_peered":"2024-04-22T19:58:50.728180+0000","last_clean":"2024-04-22T19:58:50.728180+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:50.728180+0000","last_undegraded":"2024-04-22T19:58:50.728180+0000","last_fullsized":"2024-04-22T19:58:50.728180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785160+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:58:49.785160+0000","last_peered":"2024-04-22T19:58:49.785160+0000","last_clean":"2024-04-22T19:58:49.785160+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:58:49.785160+0000","last_undegraded":"2024-04-22T19:58:49.785160+0000","last_fullsized":"2024-04-22T19:58:49.785160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728472+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:58:49.728472+0000","last_peered":"2024-04-22T19:58:49.728472+0000","last_clean":"2024-04-22T19:58:49.728472+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:58:49.728472+0000","last_undegraded":"2024-04-22T19:58:49.728472+0000","last_fullsized":"2024-04-22T19:58:49.728472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719575+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:58:49.719575+0000","last_peered":"2024-04-22T19:58:49.719575+0000","last_clean":"2024-04-22T19:58:49.719575+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:58:49.719575+0000","last_undegraded":"2024-04-22T19:58:49.719575+0000","last_fullsized":"2024-04-22T19:58:49.719575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729479+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:58:49.729479+0000","last_peered":"2024-04-22T19:58:49.729479+0000","last_clean":"2024-04-22T19:58:49.729479+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:58:49.729479+0000","last_undegraded":"2024-04-22T19:58:49.729479+0000","last_fullsized":"2024-04-22T19:58:49.729479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781166+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781166+0000","last_peered":"2024-04-22T19:58:49.781166+0000","last_clean":"2024-04-22T19:58:49.781166+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781166+0000","last_undegraded":"2024-04-22T19:58:49.781166+0000","last_fullsized":"2024-04-22T19:58:49.781166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720176+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:58:49.720176+0000","last_peered":"2024-04-22T19:58:49.720176+0000","last_clean":"2024-04-22T19:58:49.720176+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:58:49.720176+0000","last_undegraded":"2024-04-22T19:58:49.720176+0000","last_fullsized":"2024-04-22T19:58:49.720176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693474+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:50.693474+0000","last_peered":"2024-04-22T19:58:50.693474+0000","last_clean":"2024-04-22T19:58:50.693474+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:50.693474+0000","last_undegraded":"2024-04-22T19:58:50.693474+0000","last_fullsized":"2024-04-22T19:58:50.693474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718182+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:58:49.718182+0000","last_peered":"2024-04-22T19:58:49.718182+0000","last_clean":"2024-04-22T19:58:49.718182+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:58:49.718182+0000","last_undegraded":"2024-04-22T19:58:49.718182+0000","last_fullsized":"2024-04-22T19:58:49.718182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780652+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780652+0000","last_peered":"2024-04-22T19:58:49.780652+0000","last_clean":"2024-04-22T19:58:49.780652+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780652+0000","last_undegraded":"2024-04-22T19:58:49.780652+0000","last_fullsized":"2024-04-22T19:58:49.780652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704833+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:50.704833+0000","last_peered":"2024-04-22T19:58:50.704833+0000","last_clean":"2024-04-22T19:58:50.704833+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:50.704833+0000","last_undegraded":"2024-04-22T19:58:50.704833+0000","last_fullsized":"2024-04-22T19:58:50.704833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781653+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:58:49.781653+0000","last_peered":"2024-04-22T19:58:49.781653+0000","last_clean":"2024-04-22T19:58:49.781653+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:58:49.781653+0000","last_undegraded":"2024-04-22T19:58:49.781653+0000","last_fullsized":"2024-04-22T19:58:49.781653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724870+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:58:49.724870+0000","last_peered":"2024-04-22T19:58:49.724870+0000","last_clean":"2024-04-22T19:58:49.724870+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:58:49.724870+0000","last_undegraded":"2024-04-22T19:58:49.724870+0000","last_fullsized":"2024-04-22T19:58:49.724870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731244+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:58:49.731244+0000","last_peered":"2024-04-22T19:58:49.731244+0000","last_clean":"2024-04-22T19:58:49.731244+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:58:49.731244+0000","last_undegraded":"2024-04-22T19:58:49.731244+0000","last_fullsized":"2024-04-22T19:58:49.731244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778742+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:58:49.778742+0000","last_peered":"2024-04-22T19:58:49.778742+0000","last_clean":"2024-04-22T19:58:49.778742+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:58:49.778742+0000","last_undegraded":"2024-04-22T19:58:49.778742+0000","last_fullsized":"2024-04-22T19:58:49.778742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784524+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:58:49.784524+0000","last_peered":"2024-04-22T19:58:49.784524+0000","last_clean":"2024-04-22T19:58:49.784524+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:58:49.784524+0000","last_undegraded":"2024-04-22T19:58:49.784524+0000","last_fullsized":"2024-04-22T19:58:49.784524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693513+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:50.693513+0000","last_peered":"2024-04-22T19:58:50.693513+0000","last_clean":"2024-04-22T19:58:50.693513+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:50.693513+0000","last_undegraded":"2024-04-22T19:58:50.693513+0000","last_fullsized":"2024-04-22T19:58:50.693513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":59,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780876+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780876+0000","last_peered":"2024-04-22T19:58:49.780876+0000","last_clean":"2024-04-22T19:58:49.780876+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780876+0000","last_undegraded":"2024-04-22T19:58:49.780876+0000","last_fullsized":"2024-04-22T19:58:49.780876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720282+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:58:49.720282+0000","last_peered":"2024-04-22T19:58:49.720282+0000","last_clean":"2024-04-22T19:58:49.720282+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:58:49.720282+0000","last_undegraded":"2024-04-22T19:58:49.720282+0000","last_fullsized":"2024-04-22T19:58:49.720282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719810+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:58:49.719810+0000","last_peered":"2024-04-22T19:58:49.719810+0000","last_clean":"2024-04-22T19:58:49.719810+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:58:49.719810+0000","last_undegraded":"2024-04-22T19:58:49.719810+0000","last_fullsized":"2024-04-22T19:58:49.719810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725851+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:58:49.725851+0000","last_peered":"2024-04-22T19:58:49.725851+0000","last_clean":"2024-04-22T19:58:49.725851+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:58:49.725851+0000","last_undegraded":"2024-04-22T19:58:49.725851+0000","last_fullsized":"2024-04-22T19:58:49.725851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704789+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:50.704789+0000","last_peered":"2024-04-22T19:58:50.704789+0000","last_clean":"2024-04-22T19:58:50.704789+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:50.704789+0000","last_undegraded":"2024-04-22T19:58:50.704789+0000","last_fullsized":"2024-04-22T19:58:50.704789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787770+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787770+0000","last_peered":"2024-04-22T19:58:49.787770+0000","last_clean":"2024-04-22T19:58:49.787770+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787770+0000","last_undegraded":"2024-04-22T19:58:49.787770+0000","last_fullsized":"2024-04-22T19:58:49.787770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.688701+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:55.688701+0000","last_peered":"2024-04-22T19:58:55.688701+0000","last_clean":"2024-04-22T19:58:55.688701+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:55.688701+0000","last_undegraded":"2024-04-22T19:58:55.688701+0000","last_fullsized":"2024-04-22T19:58:55.688701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730464+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:58:49.730464+0000","last_peered":"2024-04-22T19:58:49.730464+0000","last_clean":"2024-04-22T19:58:49.730464+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:58:49.730464+0000","last_undegraded":"2024-04-22T19:58:49.730464+0000","last_fullsized":"2024-04-22T19:58:49.730464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823797+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823797+0000","last_peered":"2024-04-22T19:58:54.823797+0000","last_clean":"2024-04-22T19:58:54.823797+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823797+0000","last_undegraded":"2024-04-22T19:58:54.823797+0000","last_fullsized":"2024-04-22T19:58:54.823797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.698994+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:50.698994+0000","last_peered":"2024-04-22T19:58:50.698994+0000","last_clean":"2024-04-22T19:58:50.698994+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:50.698994+0000","last_undegraded":"2024-04-22T19:58:50.698994+0000","last_fullsized":"2024-04-22T19:58:50.698994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782646+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:58:49.782646+0000","last_peered":"2024-04-22T19:58:49.782646+0000","last_clean":"2024-04-22T19:58:49.782646+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:58:49.782646+0000","last_undegraded":"2024-04-22T19:58:49.782646+0000","last_fullsized":"2024-04-22T19:58:49.782646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731245+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:58:49.731245+0000","last_peered":"2024-04-22T19:58:49.731245+0000","last_clean":"2024-04-22T19:58:49.731245+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:58:49.731245+0000","last_undegraded":"2024-04-22T19:58:49.731245+0000","last_fullsized":"2024-04-22T19:58:49.731245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872374+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872374+0000","last_peered":"2024-04-22T19:58:52.872374+0000","last_clean":"2024-04-22T19:58:52.872374+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872374+0000","last_undegraded":"2024-04-22T19:58:52.872374+0000","last_fullsized":"2024-04-22T19:58:52.872374+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779647+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779647+0000","last_peered":"2024-04-22T19:58:49.779647+0000","last_clean":"2024-04-22T19:58:49.779647+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779647+0000","last_undegraded":"2024-04-22T19:58:49.779647+0000","last_fullsized":"2024-04-22T19:58:49.779647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731757+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731757+0000","last_peered":"2024-04-22T19:58:49.731757+0000","last_clean":"2024-04-22T19:58:49.731757+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731757+0000","last_undegraded":"2024-04-22T19:58:49.731757+0000","last_fullsized":"2024-04-22T19:58:49.731757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728959+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728959+0000","last_peered":"2024-04-22T19:58:49.728959+0000","last_clean":"2024-04-22T19:58:49.728959+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728959+0000","last_undegraded":"2024-04-22T19:58:49.728959+0000","last_fullsized":"2024-04-22T19:58:49.728959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778574+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778574+0000","last_peered":"2024-04-22T19:58:49.778574+0000","last_clean":"2024-04-22T19:58:49.778574+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778574+0000","last_undegraded":"2024-04-22T19:58:49.778574+0000","last_fullsized":"2024-04-22T19:58:49.778574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687789+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:50.687789+0000","last_peered":"2024-04-22T19:58:50.687789+0000","last_clean":"2024-04-22T19:58:50.687789+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:50.687789+0000","last_undegraded":"2024-04-22T19:58:50.687789+0000","last_fullsized":"2024-04-22T19:58:50.687789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781981+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781981+0000","last_peered":"2024-04-22T19:58:49.781981+0000","last_clean":"2024-04-22T19:58:49.781981+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781981+0000","last_undegraded":"2024-04-22T19:58:49.781981+0000","last_fullsized":"2024-04-22T19:58:49.781981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718925+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718925+0000","last_peered":"2024-04-22T19:58:49.718925+0000","last_clean":"2024-04-22T19:58:49.718925+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718925+0000","last_undegraded":"2024-04-22T19:58:49.718925+0000","last_fullsized":"2024-04-22T19:58:49.718925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731844+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731844+0000","last_peered":"2024-04-22T19:58:49.731844+0000","last_clean":"2024-04-22T19:58:49.731844+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731844+0000","last_undegraded":"2024-04-22T19:58:49.731844+0000","last_fullsized":"2024-04-22T19:58:49.731844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727106+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.727106+0000","last_peered":"2024-04-22T19:58:49.727106+0000","last_clean":"2024-04-22T19:58:49.727106+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.727106+0000","last_undegraded":"2024-04-22T19:58:49.727106+0000","last_fullsized":"2024-04-22T19:58:49.727106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780496+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780496+0000","last_peered":"2024-04-22T19:58:49.780496+0000","last_clean":"2024-04-22T19:58:49.780496+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780496+0000","last_undegraded":"2024-04-22T19:58:49.780496+0000","last_fullsized":"2024-04-22T19:58:49.780496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780807+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780807+0000","last_peered":"2024-04-22T19:58:49.780807+0000","last_clean":"2024-04-22T19:58:49.780807+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780807+0000","last_undegraded":"2024-04-22T19:58:49.780807+0000","last_fullsized":"2024-04-22T19:58:49.780807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732174+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732174+0000","last_peered":"2024-04-22T19:58:49.732174+0000","last_clean":"2024-04-22T19:58:49.732174+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732174+0000","last_undegraded":"2024-04-22T19:58:49.732174+0000","last_fullsized":"2024-04-22T19:58:49.732174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729122+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729122+0000","last_peered":"2024-04-22T19:58:49.729122+0000","last_clean":"2024-04-22T19:58:49.729122+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729122+0000","last_undegraded":"2024-04-22T19:58:49.729122+0000","last_fullsized":"2024-04-22T19:58:49.729122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729394+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729394+0000","last_peered":"2024-04-22T19:58:49.729394+0000","last_clean":"2024-04-22T19:58:49.729394+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729394+0000","last_undegraded":"2024-04-22T19:58:49.729394+0000","last_fullsized":"2024-04-22T19:58:49.729394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":408,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718103+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.718103+0000","last_peered":"2024-04-22T19:58:49.718103+0000","last_clean":"2024-04-22T19:58:49.718103+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.718103+0000","last_undegraded":"2024-04-22T19:58:49.718103+0000","last_fullsized":"2024-04-22T19:58:49.718103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724964+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724964+0000","last_peered":"2024-04-22T19:58:49.724964+0000","last_clean":"2024-04-22T19:58:49.724964+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724964+0000","last_undegraded":"2024-04-22T19:58:49.724964+0000","last_fullsized":"2024-04-22T19:58:49.724964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722262+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722262+0000","last_peered":"2024-04-22T19:58:49.722262+0000","last_clean":"2024-04-22T19:58:49.722262+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722262+0000","last_undegraded":"2024-04-22T19:58:49.722262+0000","last_fullsized":"2024-04-22T19:58:49.722262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":358,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577277+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577277+0000","last_peered":"2024-04-22T19:58:51.577277+0000","last_clean":"2024-04-22T19:58:51.577277+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577277+0000","last_undegraded":"2024-04-22T19:58:51.577277+0000","last_fullsized":"2024-04-22T19:58:51.577277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728084+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.728084+0000","last_peered":"2024-04-22T19:58:49.728084+0000","last_clean":"2024-04-22T19:58:49.728084+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.728084+0000","last_undegraded":"2024-04-22T19:58:49.728084+0000","last_fullsized":"2024-04-22T19:58:49.728084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718802+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718802+0000","last_peered":"2024-04-22T19:58:49.718802+0000","last_clean":"2024-04-22T19:58:49.718802+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718802+0000","last_undegraded":"2024-04-22T19:58:49.718802+0000","last_fullsized":"2024-04-22T19:58:49.718802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726829+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726829+0000","last_peered":"2024-04-22T19:58:49.726829+0000","last_clean":"2024-04-22T19:58:49.726829+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726829+0000","last_undegraded":"2024-04-22T19:58:49.726829+0000","last_fullsized":"2024-04-22T19:58:49.726829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722850+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722850+0000","last_peered":"2024-04-22T19:58:49.722850+0000","last_clean":"2024-04-22T19:58:49.722850+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722850+0000","last_undegraded":"2024-04-22T19:58:49.722850+0000","last_fullsized":"2024-04-22T19:58:49.722850+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103567+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103567+0000","last_peered":"2024-04-22T19:58:52.103567+0000","last_clean":"2024-04-22T19:58:52.103567+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103567+0000","last_undegraded":"2024-04-22T19:58:52.103567+0000","last_fullsized":"2024-04-22T19:58:52.103567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779442+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779442+0000","last_peered":"2024-04-22T19:58:49.779442+0000","last_clean":"2024-04-22T19:58:49.779442+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779442+0000","last_undegraded":"2024-04-22T19:58:49.779442+0000","last_fullsized":"2024-04-22T19:58:49.779442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728665+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728665+0000","last_peered":"2024-04-22T19:58:49.728665+0000","last_clean":"2024-04-22T19:58:49.728665+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728665+0000","last_undegraded":"2024-04-22T19:58:49.728665+0000","last_fullsized":"2024-04-22T19:58:49.728665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719970+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719970+0000","last_peered":"2024-04-22T19:58:49.719970+0000","last_clean":"2024-04-22T19:58:49.719970+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719970+0000","last_undegraded":"2024-04-22T19:58:49.719970+0000","last_fullsized":"2024-04-22T19:58:49.719970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693650+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:50.693650+0000","last_peered":"2024-04-22T19:58:50.693650+0000","last_clean":"2024-04-22T19:58:50.693650+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:50.693650+0000","last_undegraded":"2024-04-22T19:58:50.693650+0000","last_fullsized":"2024-04-22T19:58:50.693650+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720329+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720329+0000","last_peered":"2024-04-22T19:58:49.720329+0000","last_clean":"2024-04-22T19:58:49.720329+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720329+0000","last_undegraded":"2024-04-22T19:58:49.720329+0000","last_fullsized":"2024-04-22T19:58:49.720329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779333+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779333+0000","last_peered":"2024-04-22T19:58:49.779333+0000","last_clean":"2024-04-22T19:58:49.779333+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779333+0000","last_undegraded":"2024-04-22T19:58:49.779333+0000","last_fullsized":"2024-04-22T19:58:49.779333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721241+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721241+0000","last_peered":"2024-04-22T19:58:49.721241+0000","last_clean":"2024-04-22T19:58:49.721241+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721241+0000","last_undegraded":"2024-04-22T19:58:49.721241+0000","last_fullsized":"2024-04-22T19:58:49.721241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729783+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729783+0000","last_peered":"2024-04-22T19:58:49.729783+0000","last_clean":"2024-04-22T19:58:49.729783+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729783+0000","last_undegraded":"2024-04-22T19:58:49.729783+0000","last_fullsized":"2024-04-22T19:58:49.729783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":421,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687784+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:50.687784+0000","last_peered":"2024-04-22T19:58:50.687784+0000","last_clean":"2024-04-22T19:58:50.687784+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:50.687784+0000","last_undegraded":"2024-04-22T19:58:50.687784+0000","last_fullsized":"2024-04-22T19:58:50.687784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721254+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721254+0000","last_peered":"2024-04-22T19:58:49.721254+0000","last_clean":"2024-04-22T19:58:49.721254+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721254+0000","last_undegraded":"2024-04-22T19:58:49.721254+0000","last_fullsized":"2024-04-22T19:58:49.721254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720538+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720538+0000","last_peered":"2024-04-22T19:58:49.720538+0000","last_clean":"2024-04-22T19:58:49.720538+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720538+0000","last_undegraded":"2024-04-22T19:58:49.720538+0000","last_fullsized":"2024-04-22T19:58:49.720538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":305,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719766+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719766+0000","last_peered":"2024-04-22T19:58:49.719766+0000","last_clean":"2024-04-22T19:58:49.719766+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719766+0000","last_undegraded":"2024-04-22T19:58:49.719766+0000","last_fullsized":"2024-04-22T19:58:49.719766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":417,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782671+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782671+0000","last_peered":"2024-04-22T19:58:49.782671+0000","last_clean":"2024-04-22T19:58:49.782671+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782671+0000","last_undegraded":"2024-04-22T19:58:49.782671+0000","last_fullsized":"2024-04-22T19:58:49.782671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":69,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781463+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781463+0000","last_peered":"2024-04-22T19:58:49.781463+0000","last_clean":"2024-04-22T19:58:49.781463+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781463+0000","last_undegraded":"2024-04-22T19:58:49.781463+0000","last_fullsized":"2024-04-22T19:58:49.781463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":453,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.699101+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:50.699101+0000","last_peered":"2024-04-22T19:58:50.699101+0000","last_clean":"2024-04-22T19:58:50.699101+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:50.699101+0000","last_undegraded":"2024-04-22T19:58:50.699101+0000","last_fullsized":"2024-04-22T19:58:50.699101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719225+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719225+0000","last_peered":"2024-04-22T19:58:49.719225+0000","last_clean":"2024-04-22T19:58:49.719225+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719225+0000","last_undegraded":"2024-04-22T19:58:49.719225+0000","last_fullsized":"2024-04-22T19:58:49.719225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729466+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:58:49.729466+0000","last_peered":"2024-04-22T19:58:49.729466+0000","last_clean":"2024-04-22T19:58:49.729466+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:58:49.729466+0000","last_undegraded":"2024-04-22T19:58:49.729466+0000","last_fullsized":"2024-04-22T19:58:49.729466+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720244+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720244+0000","last_peered":"2024-04-22T19:58:49.720244+0000","last_clean":"2024-04-22T19:58:49.720244+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720244+0000","last_undegraded":"2024-04-22T19:58:49.720244+0000","last_fullsized":"2024-04-22T19:58:49.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781603+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781603+0000","last_peered":"2024-04-22T19:58:49.781603+0000","last_clean":"2024-04-22T19:58:49.781603+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781603+0000","last_undegraded":"2024-04-22T19:58:49.781603+0000","last_fullsized":"2024-04-22T19:58:49.781603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.699066+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:50.699066+0000","last_peered":"2024-04-22T19:58:50.699066+0000","last_clean":"2024-04-22T19:58:50.699066+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:50.699066+0000","last_undegraded":"2024-04-22T19:58:50.699066+0000","last_fullsized":"2024-04-22T19:58:50.699066+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720731+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720731+0000","last_peered":"2024-04-22T19:58:49.720731+0000","last_clean":"2024-04-22T19:58:49.720731+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720731+0000","last_undegraded":"2024-04-22T19:58:49.720731+0000","last_fullsized":"2024-04-22T19:58:49.720731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784728+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784728+0000","last_peered":"2024-04-22T19:58:49.784728+0000","last_clean":"2024-04-22T19:58:49.784728+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784728+0000","last_undegraded":"2024-04-22T19:58:49.784728+0000","last_fullsized":"2024-04-22T19:58:49.784728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729545+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729545+0000","last_peered":"2024-04-22T19:58:49.729545+0000","last_clean":"2024-04-22T19:58:49.729545+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729545+0000","last_undegraded":"2024-04-22T19:58:49.729545+0000","last_fullsized":"2024-04-22T19:58:49.729545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781475+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781475+0000","last_peered":"2024-04-22T19:58:49.781475+0000","last_clean":"2024-04-22T19:58:49.781475+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781475+0000","last_undegraded":"2024-04-22T19:58:49.781475+0000","last_fullsized":"2024-04-22T19:58:49.781475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730855+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730855+0000","last_peered":"2024-04-22T19:58:49.730855+0000","last_clean":"2024-04-22T19:58:49.730855+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730855+0000","last_undegraded":"2024-04-22T19:58:49.730855+0000","last_fullsized":"2024-04-22T19:58:49.730855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":338,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783265+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783265+0000","last_peered":"2024-04-22T19:58:49.783265+0000","last_clean":"2024-04-22T19:58:49.783265+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783265+0000","last_undegraded":"2024-04-22T19:58:49.783265+0000","last_fullsized":"2024-04-22T19:58:49.783265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725143+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725143+0000","last_peered":"2024-04-22T19:58:49.725143+0000","last_clean":"2024-04-22T19:58:49.725143+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725143+0000","last_undegraded":"2024-04-22T19:58:49.725143+0000","last_fullsized":"2024-04-22T19:58:49.725143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777694+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777694+0000","last_peered":"2024-04-22T19:58:49.777694+0000","last_clean":"2024-04-22T19:58:49.777694+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777694+0000","last_undegraded":"2024-04-22T19:58:49.777694+0000","last_fullsized":"2024-04-22T19:58:49.777694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725613+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725613+0000","last_peered":"2024-04-22T19:58:49.725613+0000","last_clean":"2024-04-22T19:58:49.725613+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725613+0000","last_undegraded":"2024-04-22T19:58:49.725613+0000","last_fullsized":"2024-04-22T19:58:49.725613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729291+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729291+0000","last_peered":"2024-04-22T19:58:49.729291+0000","last_clean":"2024-04-22T19:58:49.729291+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729291+0000","last_undegraded":"2024-04-22T19:58:49.729291+0000","last_fullsized":"2024-04-22T19:58:49.729291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718816+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718816+0000","last_peered":"2024-04-22T19:58:49.718816+0000","last_clean":"2024-04-22T19:58:49.718816+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718816+0000","last_undegraded":"2024-04-22T19:58:49.718816+0000","last_fullsized":"2024-04-22T19:58:49.718816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784820+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784820+0000","last_peered":"2024-04-22T19:58:49.784820+0000","last_clean":"2024-04-22T19:58:49.784820+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784820+0000","last_undegraded":"2024-04-22T19:58:49.784820+0000","last_fullsized":"2024-04-22T19:58:49.784820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":503,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721143+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721143+0000","last_peered":"2024-04-22T19:58:49.721143+0000","last_clean":"2024-04-22T19:58:49.721143+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721143+0000","last_undegraded":"2024-04-22T19:58:49.721143+0000","last_fullsized":"2024-04-22T19:58:49.721143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730831+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730831+0000","last_peered":"2024-04-22T19:58:49.730831+0000","last_clean":"2024-04-22T19:58:49.730831+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730831+0000","last_undegraded":"2024-04-22T19:58:49.730831+0000","last_fullsized":"2024-04-22T19:58:49.730831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720365+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720365+0000","last_peered":"2024-04-22T19:58:49.720365+0000","last_clean":"2024-04-22T19:58:49.720365+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720365+0000","last_undegraded":"2024-04-22T19:58:49.720365+0000","last_fullsized":"2024-04-22T19:58:49.720365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723513+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723513+0000","last_peered":"2024-04-22T19:58:49.723513+0000","last_clean":"2024-04-22T19:58:49.723513+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723513+0000","last_undegraded":"2024-04-22T19:58:49.723513+0000","last_fullsized":"2024-04-22T19:58:49.723513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727710+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727710+0000","last_peered":"2024-04-22T19:58:49.727710+0000","last_clean":"2024-04-22T19:58:49.727710+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727710+0000","last_undegraded":"2024-04-22T19:58:49.727710+0000","last_fullsized":"2024-04-22T19:58:49.727710+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720445+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720445+0000","last_peered":"2024-04-22T19:58:49.720445+0000","last_clean":"2024-04-22T19:58:49.720445+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720445+0000","last_undegraded":"2024-04-22T19:58:49.720445+0000","last_fullsized":"2024-04-22T19:58:49.720445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":325,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729218+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729218+0000","last_peered":"2024-04-22T19:58:49.729218+0000","last_clean":"2024-04-22T19:58:49.729218+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729218+0000","last_undegraded":"2024-04-22T19:58:49.729218+0000","last_fullsized":"2024-04-22T19:58:49.729218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731596+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731596+0000","last_peered":"2024-04-22T19:58:49.731596+0000","last_clean":"2024-04-22T19:58:49.731596+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731596+0000","last_undegraded":"2024-04-22T19:58:49.731596+0000","last_fullsized":"2024-04-22T19:58:49.731596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723336+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723336+0000","last_peered":"2024-04-22T19:58:49.723336+0000","last_clean":"2024-04-22T19:58:49.723336+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723336+0000","last_undegraded":"2024-04-22T19:58:49.723336+0000","last_fullsized":"2024-04-22T19:58:49.723336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783753+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783753+0000","last_peered":"2024-04-22T19:58:49.783753+0000","last_clean":"2024-04-22T19:58:49.783753+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783753+0000","last_undegraded":"2024-04-22T19:58:49.783753+0000","last_fullsized":"2024-04-22T19:58:49.783753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721618+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721618+0000","last_peered":"2024-04-22T19:58:49.721618+0000","last_clean":"2024-04-22T19:58:49.721618+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721618+0000","last_undegraded":"2024-04-22T19:58:49.721618+0000","last_fullsized":"2024-04-22T19:58:49.721618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781547+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781547+0000","last_peered":"2024-04-22T19:58:49.781547+0000","last_clean":"2024-04-22T19:58:49.781547+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781547+0000","last_undegraded":"2024-04-22T19:58:49.781547+0000","last_fullsized":"2024-04-22T19:58:49.781547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719703+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719703+0000","last_peered":"2024-04-22T19:58:49.719703+0000","last_clean":"2024-04-22T19:58:49.719703+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719703+0000","last_undegraded":"2024-04-22T19:58:49.719703+0000","last_fullsized":"2024-04-22T19:58:49.719703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724590+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724590+0000","last_peered":"2024-04-22T19:58:49.724590+0000","last_clean":"2024-04-22T19:58:49.724590+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724590+0000","last_undegraded":"2024-04-22T19:58:49.724590+0000","last_fullsized":"2024-04-22T19:58:49.724590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785785+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785785+0000","last_peered":"2024-04-22T19:58:49.785785+0000","last_clean":"2024-04-22T19:58:49.785785+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785785+0000","last_undegraded":"2024-04-22T19:58:49.785785+0000","last_fullsized":"2024-04-22T19:58:49.785785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778349+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778349+0000","last_peered":"2024-04-22T19:58:49.778349+0000","last_clean":"2024-04-22T19:58:49.778349+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778349+0000","last_undegraded":"2024-04-22T19:58:49.778349+0000","last_fullsized":"2024-04-22T19:58:49.778349+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720927+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720927+0000","last_peered":"2024-04-22T19:58:49.720927+0000","last_clean":"2024-04-22T19:58:49.720927+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720927+0000","last_undegraded":"2024-04-22T19:58:49.720927+0000","last_fullsized":"2024-04-22T19:58:49.720927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":331,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784400+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.784400+0000","last_peered":"2024-04-22T19:58:49.784400+0000","last_clean":"2024-04-22T19:58:49.784400+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.784400+0000","last_undegraded":"2024-04-22T19:58:49.784400+0000","last_fullsized":"2024-04-22T19:58:49.784400+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721907+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721907+0000","last_peered":"2024-04-22T19:58:49.721907+0000","last_clean":"2024-04-22T19:58:49.721907+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721907+0000","last_undegraded":"2024-04-22T19:58:49.721907+0000","last_fullsized":"2024-04-22T19:58:49.721907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720812+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720812+0000","last_peered":"2024-04-22T19:58:49.720812+0000","last_clean":"2024-04-22T19:58:49.720812+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720812+0000","last_undegraded":"2024-04-22T19:58:49.720812+0000","last_fullsized":"2024-04-22T19:58:49.720812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839511+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839511+0000","last_peered":"2024-04-22T19:58:52.839511+0000","last_clean":"2024-04-22T19:58:52.839511+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839511+0000","last_undegraded":"2024-04-22T19:58:52.839511+0000","last_fullsized":"2024-04-22T19:58:52.839511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718405+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718405+0000","last_peered":"2024-04-22T19:58:49.718405+0000","last_clean":"2024-04-22T19:58:49.718405+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718405+0000","last_undegraded":"2024-04-22T19:58:49.718405+0000","last_fullsized":"2024-04-22T19:58:49.718405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693598+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:50.693598+0000","last_peered":"2024-04-22T19:58:50.693598+0000","last_clean":"2024-04-22T19:58:50.693598+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:50.693598+0000","last_undegraded":"2024-04-22T19:58:50.693598+0000","last_fullsized":"2024-04-22T19:58:50.693598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722047+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.722047+0000","last_peered":"2024-04-22T19:58:49.722047+0000","last_clean":"2024-04-22T19:58:49.722047+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.722047+0000","last_undegraded":"2024-04-22T19:58:49.722047+0000","last_fullsized":"2024-04-22T19:58:49.722047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732453+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732453+0000","last_peered":"2024-04-22T19:58:49.732453+0000","last_clean":"2024-04-22T19:58:49.732453+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732453+0000","last_undegraded":"2024-04-22T19:58:49.732453+0000","last_fullsized":"2024-04-22T19:58:49.732453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778655+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778655+0000","last_peered":"2024-04-22T19:58:49.778655+0000","last_clean":"2024-04-22T19:58:49.778655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778655+0000","last_undegraded":"2024-04-22T19:58:49.778655+0000","last_fullsized":"2024-04-22T19:58:49.778655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720753+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720753+0000","last_peered":"2024-04-22T19:58:49.720753+0000","last_clean":"2024-04-22T19:58:49.720753+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720753+0000","last_undegraded":"2024-04-22T19:58:49.720753+0000","last_fullsized":"2024-04-22T19:58:49.720753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779292+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779292+0000","last_peered":"2024-04-22T19:58:49.779292+0000","last_clean":"2024-04-22T19:58:49.779292+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779292+0000","last_undegraded":"2024-04-22T19:58:49.779292+0000","last_fullsized":"2024-04-22T19:58:49.779292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787894+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787894+0000","last_peered":"2024-04-22T19:58:49.787894+0000","last_clean":"2024-04-22T19:58:49.787894+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787894+0000","last_undegraded":"2024-04-22T19:58:49.787894+0000","last_fullsized":"2024-04-22T19:58:49.787894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723854+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723854+0000","last_peered":"2024-04-22T19:58:49.723854+0000","last_clean":"2024-04-22T19:58:49.723854+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723854+0000","last_undegraded":"2024-04-22T19:58:49.723854+0000","last_fullsized":"2024-04-22T19:58:49.723854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718745+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718745+0000","last_peered":"2024-04-22T19:58:49.718745+0000","last_clean":"2024-04-22T19:58:49.718745+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718745+0000","last_undegraded":"2024-04-22T19:58:49.718745+0000","last_fullsized":"2024-04-22T19:58:49.718745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121529+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121529+0000","last_peered":"2024-04-22T19:58:53.121529+0000","last_clean":"2024-04-22T19:58:53.121529+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121529+0000","last_undegraded":"2024-04-22T19:58:53.121529+0000","last_fullsized":"2024-04-22T19:58:53.121529+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693564+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:50.693564+0000","last_peered":"2024-04-22T19:58:50.693564+0000","last_clean":"2024-04-22T19:58:50.693564+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:50.693564+0000","last_undegraded":"2024-04-22T19:58:50.693564+0000","last_fullsized":"2024-04-22T19:58:50.693564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719083+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.719083+0000","last_peered":"2024-04-22T19:58:49.719083+0000","last_clean":"2024-04-22T19:58:49.719083+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.719083+0000","last_undegraded":"2024-04-22T19:58:49.719083+0000","last_fullsized":"2024-04-22T19:58:49.719083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725868+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725868+0000","last_peered":"2024-04-22T19:58:49.725868+0000","last_clean":"2024-04-22T19:58:49.725868+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725868+0000","last_undegraded":"2024-04-22T19:58:49.725868+0000","last_fullsized":"2024-04-22T19:58:49.725868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786647+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786647+0000","last_peered":"2024-04-22T19:58:49.786647+0000","last_clean":"2024-04-22T19:58:49.786647+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786647+0000","last_undegraded":"2024-04-22T19:58:49.786647+0000","last_fullsized":"2024-04-22T19:58:49.786647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":312,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730066+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.730066+0000","last_peered":"2024-04-22T19:58:49.730066+0000","last_clean":"2024-04-22T19:58:49.730066+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.730066+0000","last_undegraded":"2024-04-22T19:58:49.730066+0000","last_fullsized":"2024-04-22T19:58:49.730066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728275+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:50.728275+0000","last_peered":"2024-04-22T19:58:50.728275+0000","last_clean":"2024-04-22T19:58:50.728275+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:50.728275+0000","last_undegraded":"2024-04-22T19:58:50.728275+0000","last_fullsized":"2024-04-22T19:58:50.728275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724733+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724733+0000","last_peered":"2024-04-22T19:58:49.724733+0000","last_clean":"2024-04-22T19:58:49.724733+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724733+0000","last_undegraded":"2024-04-22T19:58:49.724733+0000","last_fullsized":"2024-04-22T19:58:49.724733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704025+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:50.704025+0000","last_peered":"2024-04-22T19:58:50.704025+0000","last_clean":"2024-04-22T19:58:50.704025+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:50.704025+0000","last_undegraded":"2024-04-22T19:58:50.704025+0000","last_fullsized":"2024-04-22T19:58:50.704025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704077+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:50.704077+0000","last_peered":"2024-04-22T19:58:50.704077+0000","last_clean":"2024-04-22T19:58:50.704077+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:50.704077+0000","last_undegraded":"2024-04-22T19:58:50.704077+0000","last_fullsized":"2024-04-22T19:58:50.704077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.688798+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:55.688798+0000","last_peered":"2024-04-22T19:58:55.688798+0000","last_clean":"2024-04-22T19:58:55.688798+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:55.688798+0000","last_undegraded":"2024-04-22T19:58:55.688798+0000","last_fullsized":"2024-04-22T19:58:55.688798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778734+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778734+0000","last_peered":"2024-04-22T19:58:49.778734+0000","last_clean":"2024-04-22T19:58:49.778734+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778734+0000","last_undegraded":"2024-04-22T19:58:49.778734+0000","last_fullsized":"2024-04-22T19:58:49.778734+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781767+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.781767+0000","last_peered":"2024-04-22T19:58:49.781767+0000","last_clean":"2024-04-22T19:58:49.781767+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.781767+0000","last_undegraded":"2024-04-22T19:58:49.781767+0000","last_fullsized":"2024-04-22T19:58:49.781767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687755+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:50.687755+0000","last_peered":"2024-04-22T19:58:50.687755+0000","last_clean":"2024-04-22T19:58:50.687755+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:50.687755+0000","last_undegraded":"2024-04-22T19:58:50.687755+0000","last_fullsized":"2024-04-22T19:58:50.687755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":378,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.386788+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:58:50.386788+0000","last_peered":"2024-04-22T19:58:50.386788+0000","last_clean":"2024-04-22T19:58:50.386788+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:58:50.386788+0000","last_undegraded":"2024-04-22T19:58:50.386788+0000","last_fullsized":"2024-04-22T19:58:50.386788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821961+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821961+0000","last_peered":"2024-04-22T19:58:49.821961+0000","last_clean":"2024-04-22T19:58:49.821961+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821961+0000","last_undegraded":"2024-04-22T19:58:49.821961+0000","last_fullsized":"2024-04-22T19:58:49.821961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.694413+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:55.694413+0000","last_peered":"2024-04-22T19:58:55.694413+0000","last_clean":"2024-04-22T19:58:55.694413+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:55.694413+0000","last_undegraded":"2024-04-22T19:58:55.694413+0000","last_fullsized":"2024-04-22T19:58:55.694413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706836+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:59:00.706836+0000","last_peered":"2024-04-22T19:59:00.706836+0000","last_clean":"2024-04-22T19:59:00.706836+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:59:00.706836+0000","last_undegraded":"2024-04-22T19:59:00.706836+0000","last_fullsized":"2024-04-22T19:59:00.706836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780035+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.780035+0000","last_peered":"2024-04-22T19:58:49.780035+0000","last_clean":"2024-04-22T19:58:49.780035+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.780035+0000","last_undegraded":"2024-04-22T19:58:49.780035+0000","last_fullsized":"2024-04-22T19:58:49.780035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785388+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:58:49.785388+0000","last_peered":"2024-04-22T19:58:49.785388+0000","last_clean":"2024-04-22T19:58:49.785388+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:58:49.785388+0000","last_undegraded":"2024-04-22T19:58:49.785388+0000","last_fullsized":"2024-04-22T19:58:49.785388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.705730+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:55.705730+0000","last_peered":"2024-04-22T19:58:55.705730+0000","last_clean":"2024-04-22T19:58:55.705730+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:55.705730+0000","last_undegraded":"2024-04-22T19:58:55.705730+0000","last_fullsized":"2024-04-22T19:58:55.705730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780166+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780166+0000","last_peered":"2024-04-22T19:58:49.780166+0000","last_clean":"2024-04-22T19:58:49.780166+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780166+0000","last_undegraded":"2024-04-22T19:58:49.780166+0000","last_fullsized":"2024-04-22T19:58:49.780166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700849+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:59:00.700849+0000","last_peered":"2024-04-22T19:59:00.700849+0000","last_clean":"2024-04-22T19:59:00.700849+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:59:00.700849+0000","last_undegraded":"2024-04-22T19:59:00.700849+0000","last_fullsized":"2024-04-22T19:59:00.700849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871339+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871339+0000","last_peered":"2024-04-22T19:58:50.871339+0000","last_clean":"2024-04-22T19:58:50.871339+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871339+0000","last_undegraded":"2024-04-22T19:58:50.871339+0000","last_fullsized":"2024-04-22T19:58:50.871339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725450+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:58:49.725450+0000","last_peered":"2024-04-22T19:58:49.725450+0000","last_clean":"2024-04-22T19:58:49.725450+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:58:49.725450+0000","last_undegraded":"2024-04-22T19:58:49.725450+0000","last_fullsized":"2024-04-22T19:58:49.725450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.699925+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:55.699925+0000","last_peered":"2024-04-22T19:58:55.699925+0000","last_clean":"2024-04-22T19:58:55.699925+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:55.699925+0000","last_undegraded":"2024-04-22T19:58:55.699925+0000","last_fullsized":"2024-04-22T19:58:55.699925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.705839+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:55.705839+0000","last_peered":"2024-04-22T19:58:55.705839+0000","last_clean":"2024-04-22T19:58:55.705839+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:55.705839+0000","last_undegraded":"2024-04-22T19:58:55.705839+0000","last_fullsized":"2024-04-22T19:58:55.705839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.695296+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:59:00.695296+0000","last_peered":"2024-04-22T19:59:00.695296+0000","last_clean":"2024-04-22T19:59:00.695296+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:59:00.695296+0000","last_undegraded":"2024-04-22T19:59:00.695296+0000","last_fullsized":"2024-04-22T19:59:00.695296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786228+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786228+0000","last_peered":"2024-04-22T19:58:49.786228+0000","last_clean":"2024-04-22T19:58:49.786228+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786228+0000","last_undegraded":"2024-04-22T19:58:49.786228+0000","last_fullsized":"2024-04-22T19:58:49.786228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778906+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778906+0000","last_peered":"2024-04-22T19:58:49.778906+0000","last_clean":"2024-04-22T19:58:49.778906+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778906+0000","last_undegraded":"2024-04-22T19:58:49.778906+0000","last_fullsized":"2024-04-22T19:58:49.778906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725206+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725206+0000","last_peered":"2024-04-22T19:58:49.725206+0000","last_clean":"2024-04-22T19:58:49.725206+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725206+0000","last_undegraded":"2024-04-22T19:58:49.725206+0000","last_fullsized":"2024-04-22T19:58:49.725206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781415+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781415+0000","last_peered":"2024-04-22T19:58:49.781415+0000","last_clean":"2024-04-22T19:58:49.781415+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781415+0000","last_undegraded":"2024-04-22T19:58:49.781415+0000","last_fullsized":"2024-04-22T19:58:49.781415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725477+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725477+0000","last_peered":"2024-04-22T19:58:49.725477+0000","last_clean":"2024-04-22T19:58:49.725477+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725477+0000","last_undegraded":"2024-04-22T19:58:49.725477+0000","last_fullsized":"2024-04-22T19:58:49.725477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":341,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723896+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:58:49.723896+0000","last_peered":"2024-04-22T19:58:49.723896+0000","last_clean":"2024-04-22T19:58:49.723896+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:58:49.723896+0000","last_undegraded":"2024-04-22T19:58:49.723896+0000","last_fullsized":"2024-04-22T19:58:49.723896+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785788+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785788+0000","last_peered":"2024-04-22T19:58:49.785788+0000","last_clean":"2024-04-22T19:58:49.785788+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785788+0000","last_undegraded":"2024-04-22T19:58:49.785788+0000","last_fullsized":"2024-04-22T19:58:49.785788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700807+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:59:00.700807+0000","last_peered":"2024-04-22T19:59:00.700807+0000","last_clean":"2024-04-22T19:59:00.700807+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:59:00.700807+0000","last_undegraded":"2024-04-22T19:59:00.700807+0000","last_fullsized":"2024-04-22T19:59:00.700807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779914+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779914+0000","last_peered":"2024-04-22T19:58:49.779914+0000","last_clean":"2024-04-22T19:58:49.779914+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779914+0000","last_undegraded":"2024-04-22T19:58:49.779914+0000","last_fullsized":"2024-04-22T19:58:49.779914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720702+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:58:49.720702+0000","last_peered":"2024-04-22T19:58:49.720702+0000","last_clean":"2024-04-22T19:58:49.720702+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:58:49.720702+0000","last_undegraded":"2024-04-22T19:58:49.720702+0000","last_fullsized":"2024-04-22T19:58:49.720702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722495+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722495+0000","last_peered":"2024-04-22T19:58:49.722495+0000","last_clean":"2024-04-22T19:58:49.722495+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722495+0000","last_undegraded":"2024-04-22T19:58:49.722495+0000","last_fullsized":"2024-04-22T19:58:49.722495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.730037+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:59:00.730037+0000","last_peered":"2024-04-22T19:59:00.730037+0000","last_clean":"2024-04-22T19:59:00.730037+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:59:00.730037+0000","last_undegraded":"2024-04-22T19:59:00.730037+0000","last_fullsized":"2024-04-22T19:59:00.730037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729174+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:58:49.729174+0000","last_peered":"2024-04-22T19:58:49.729174+0000","last_clean":"2024-04-22T19:58:49.729174+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:58:49.729174+0000","last_undegraded":"2024-04-22T19:58:49.729174+0000","last_fullsized":"2024-04-22T19:58:49.729174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720043+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:58:49.720043+0000","last_peered":"2024-04-22T19:58:49.720043+0000","last_clean":"2024-04-22T19:58:49.720043+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:58:49.720043+0000","last_undegraded":"2024-04-22T19:58:49.720043+0000","last_fullsized":"2024-04-22T19:58:49.720043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720078+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.720078+0000","last_peered":"2024-04-22T19:58:49.720078+0000","last_clean":"2024-04-22T19:58:49.720078+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.720078+0000","last_undegraded":"2024-04-22T19:58:49.720078+0000","last_fullsized":"2024-04-22T19:58:49.720078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":435,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785100+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.785100+0000","last_peered":"2024-04-22T19:58:49.785100+0000","last_clean":"2024-04-22T19:58:49.785100+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.785100+0000","last_undegraded":"2024-04-22T19:58:49.785100+0000","last_fullsized":"2024-04-22T19:58:49.785100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706775+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:59:00.706775+0000","last_peered":"2024-04-22T19:59:00.706775+0000","last_clean":"2024-04-22T19:59:00.706775+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:59:00.706775+0000","last_undegraded":"2024-04-22T19:59:00.706775+0000","last_fullsized":"2024-04-22T19:59:00.706775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.097933+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:58:50.097933+0000","last_peered":"2024-04-22T19:58:50.097933+0000","last_clean":"2024-04-22T19:58:50.097933+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:58:50.097933+0000","last_undegraded":"2024-04-22T19:58:50.097933+0000","last_fullsized":"2024-04-22T19:58:50.097933+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782271+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:58:49.782271+0000","last_peered":"2024-04-22T19:58:49.782271+0000","last_clean":"2024-04-22T19:58:49.782271+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:58:49.782271+0000","last_undegraded":"2024-04-22T19:58:49.782271+0000","last_fullsized":"2024-04-22T19:58:49.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779281+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:58:49.779281+0000","last_peered":"2024-04-22T19:58:49.779281+0000","last_clean":"2024-04-22T19:58:49.779281+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:58:49.779281+0000","last_undegraded":"2024-04-22T19:58:49.779281+0000","last_fullsized":"2024-04-22T19:58:49.779281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717813+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:58:49.717813+0000","last_peered":"2024-04-22T19:58:49.717813+0000","last_clean":"2024-04-22T19:58:49.717813+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:58:49.717813+0000","last_undegraded":"2024-04-22T19:58:49.717813+0000","last_fullsized":"2024-04-22T19:58:49.717813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731940+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:58:49.731940+0000","last_peered":"2024-04-22T19:58:49.731940+0000","last_clean":"2024-04-22T19:58:49.731940+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:58:49.731940+0000","last_undegraded":"2024-04-22T19:58:49.731940+0000","last_fullsized":"2024-04-22T19:58:49.731940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.131281+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:58:51.131281+0000","last_peered":"2024-04-22T19:58:51.131281+0000","last_clean":"2024-04-22T19:58:51.131281+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:58:51.131281+0000","last_undegraded":"2024-04-22T19:58:51.131281+0000","last_fullsized":"2024-04-22T19:58:51.131281+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783451+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:58:49.783451+0000","last_peered":"2024-04-22T19:58:49.783451+0000","last_clean":"2024-04-22T19:58:49.783451+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:58:49.783451+0000","last_undegraded":"2024-04-22T19:58:49.783451+0000","last_fullsized":"2024-04-22T19:58:49.783451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.717806+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:58:49.717806+0000","last_peered":"2024-04-22T19:58:49.717806+0000","last_clean":"2024-04-22T19:58:49.717806+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:58:49.717806+0000","last_undegraded":"2024-04-22T19:58:49.717806+0000","last_fullsized":"2024-04-22T19:58:49.717806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778313+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:58:49.778313+0000","last_peered":"2024-04-22T19:58:49.778313+0000","last_clean":"2024-04-22T19:58:49.778313+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:58:49.778313+0000","last_undegraded":"2024-04-22T19:58:49.778313+0000","last_fullsized":"2024-04-22T19:58:49.778313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779236+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779236+0000","last_peered":"2024-04-22T19:58:49.779236+0000","last_clean":"2024-04-22T19:58:49.779236+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779236+0000","last_undegraded":"2024-04-22T19:58:49.779236+0000","last_fullsized":"2024-04-22T19:58:49.779236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778873+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778873+0000","last_peered":"2024-04-22T19:58:49.778873+0000","last_clean":"2024-04-22T19:58:49.778873+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778873+0000","last_undegraded":"2024-04-22T19:58:49.778873+0000","last_fullsized":"2024-04-22T19:58:49.778873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718209+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:58:49.718209+0000","last_peered":"2024-04-22T19:58:49.718209+0000","last_clean":"2024-04-22T19:58:49.718209+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:58:49.718209+0000","last_undegraded":"2024-04-22T19:58:49.718209+0000","last_fullsized":"2024-04-22T19:58:49.718209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":66,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783540+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783540+0000","last_peered":"2024-04-22T19:58:49.783540+0000","last_clean":"2024-04-22T19:58:49.783540+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783540+0000","last_undegraded":"2024-04-22T19:58:49.783540+0000","last_fullsized":"2024-04-22T19:58:49.783540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731121+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:58:49.731121+0000","last_peered":"2024-04-22T19:58:49.731121+0000","last_clean":"2024-04-22T19:58:49.731121+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:58:49.731121+0000","last_undegraded":"2024-04-22T19:58:49.731121+0000","last_fullsized":"2024-04-22T19:58:49.731121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718680+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:58:49.718680+0000","last_peered":"2024-04-22T19:58:49.718680+0000","last_clean":"2024-04-22T19:58:49.718680+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:58:49.718680+0000","last_undegraded":"2024-04-22T19:58:49.718680+0000","last_fullsized":"2024-04-22T19:58:49.718680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725683+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725683+0000","last_peered":"2024-04-22T19:58:49.725683+0000","last_clean":"2024-04-22T19:58:49.725683+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725683+0000","last_undegraded":"2024-04-22T19:58:49.725683+0000","last_fullsized":"2024-04-22T19:58:49.725683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720760+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:58:49.720760+0000","last_peered":"2024-04-22T19:58:49.720760+0000","last_clean":"2024-04-22T19:58:49.720760+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:58:49.720760+0000","last_undegraded":"2024-04-22T19:58:49.720760+0000","last_fullsized":"2024-04-22T19:58:49.720760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706221+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:59:00.706221+0000","last_peered":"2024-04-22T19:59:00.706221+0000","last_clean":"2024-04-22T19:59:00.706221+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:59:00.706221+0000","last_undegraded":"2024-04-22T19:59:00.706221+0000","last_fullsized":"2024-04-22T19:59:00.706221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723301+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723301+0000","last_peered":"2024-04-22T19:58:49.723301+0000","last_clean":"2024-04-22T19:58:49.723301+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723301+0000","last_undegraded":"2024-04-22T19:58:49.723301+0000","last_fullsized":"2024-04-22T19:58:49.723301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777755+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777755+0000","last_peered":"2024-04-22T19:58:49.777755+0000","last_clean":"2024-04-22T19:58:49.777755+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777755+0000","last_undegraded":"2024-04-22T19:58:49.777755+0000","last_fullsized":"2024-04-22T19:58:49.777755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723195+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723195+0000","last_peered":"2024-04-22T19:58:49.723195+0000","last_clean":"2024-04-22T19:58:49.723195+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723195+0000","last_undegraded":"2024-04-22T19:58:49.723195+0000","last_fullsized":"2024-04-22T19:58:49.723195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727305+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727305+0000","last_peered":"2024-04-22T19:58:49.727305+0000","last_clean":"2024-04-22T19:58:49.727305+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727305+0000","last_undegraded":"2024-04-22T19:58:49.727305+0000","last_fullsized":"2024-04-22T19:58:49.727305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783167+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783167+0000","last_peered":"2024-04-22T19:58:49.783167+0000","last_clean":"2024-04-22T19:58:49.783167+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783167+0000","last_undegraded":"2024-04-22T19:58:49.783167+0000","last_fullsized":"2024-04-22T19:58:49.783167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":356,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617855+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617855+0000","last_peered":"2024-04-22T19:58:50.617855+0000","last_clean":"2024-04-22T19:58:50.617855+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617855+0000","last_undegraded":"2024-04-22T19:58:50.617855+0000","last_fullsized":"2024-04-22T19:58:50.617855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721858+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721858+0000","last_peered":"2024-04-22T19:58:49.721858+0000","last_clean":"2024-04-22T19:58:49.721858+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721858+0000","last_undegraded":"2024-04-22T19:58:49.721858+0000","last_fullsized":"2024-04-22T19:58:49.721858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869837+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869837+0000","last_peered":"2024-04-22T19:58:51.869837+0000","last_clean":"2024-04-22T19:58:51.869837+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869837+0000","last_undegraded":"2024-04-22T19:58:51.869837+0000","last_fullsized":"2024-04-22T19:58:51.869837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687726+0000","last_change":"2024-04-22T19:58:49.802934+0000","last_active":"2024-04-22T19:58:50.687726+0000","last_peered":"2024-04-22T19:58:50.687726+0000","last_clean":"2024-04-22T19:58:50.687726+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T19:58:50.687726+0000","last_undegraded":"2024-04-22T19:58:50.687726+0000","last_fullsized":"2024-04-22T19:58:50.687726+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:54:08.279006+0000","last_clean_scrub_stamp":"2024-04-22T19:54:08.279006+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:22:45.071532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720641+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720641+0000","last_peered":"2024-04-22T19:58:49.720641+0000","last_clean":"2024-04-22T19:58:49.720641+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720641+0000","last_undegraded":"2024-04-22T19:58:49.720641+0000","last_fullsized":"2024-04-22T19:58:49.720641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":335,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722992+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722992+0000","last_peered":"2024-04-22T19:58:49.722992+0000","last_clean":"2024-04-22T19:58:49.722992+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722992+0000","last_undegraded":"2024-04-22T19:58:49.722992+0000","last_fullsized":"2024-04-22T19:58:49.722992+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785909+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785909+0000","last_peered":"2024-04-22T19:58:49.785909+0000","last_clean":"2024-04-22T19:58:49.785909+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785909+0000","last_undegraded":"2024-04-22T19:58:49.785909+0000","last_fullsized":"2024-04-22T19:58:49.785909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777695+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777695+0000","last_peered":"2024-04-22T19:58:49.777695+0000","last_clean":"2024-04-22T19:58:49.777695+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777695+0000","last_undegraded":"2024-04-22T19:58:49.777695+0000","last_fullsized":"2024-04-22T19:58:49.777695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871926+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871926+0000","last_peered":"2024-04-22T19:58:53.871926+0000","last_clean":"2024-04-22T19:58:53.871926+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871926+0000","last_undegraded":"2024-04-22T19:58:53.871926+0000","last_fullsized":"2024-04-22T19:58:53.871926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":367,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628061+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628061+0000","last_peered":"2024-04-22T19:58:53.628061+0000","last_clean":"2024-04-22T19:58:53.628061+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628061+0000","last_undegraded":"2024-04-22T19:58:53.628061+0000","last_fullsized":"2024-04-22T19:58:53.628061+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704175+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:50.704175+0000","last_peered":"2024-04-22T19:58:50.704175+0000","last_clean":"2024-04-22T19:58:50.704175+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:50.704175+0000","last_undegraded":"2024-04-22T19:58:50.704175+0000","last_fullsized":"2024-04-22T19:58:50.704175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":156,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782158+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782158+0000","last_peered":"2024-04-22T19:58:49.782158+0000","last_clean":"2024-04-22T19:58:49.782158+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782158+0000","last_undegraded":"2024-04-22T19:58:49.782158+0000","last_fullsized":"2024-04-22T19:58:49.782158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729647+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729647+0000","last_peered":"2024-04-22T19:58:49.729647+0000","last_clean":"2024-04-22T19:58:49.729647+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729647+0000","last_undegraded":"2024-04-22T19:58:49.729647+0000","last_fullsized":"2024-04-22T19:58:49.729647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781013+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.781013+0000","last_peered":"2024-04-22T19:58:49.781013+0000","last_clean":"2024-04-22T19:58:49.781013+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.781013+0000","last_undegraded":"2024-04-22T19:58:49.781013+0000","last_fullsized":"2024-04-22T19:58:49.781013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721225+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721225+0000","last_peered":"2024-04-22T19:58:49.721225+0000","last_clean":"2024-04-22T19:58:49.721225+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721225+0000","last_undegraded":"2024-04-22T19:58:49.721225+0000","last_fullsized":"2024-04-22T19:58:49.721225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687662+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:50.687662+0000","last_peered":"2024-04-22T19:58:50.687662+0000","last_clean":"2024-04-22T19:58:50.687662+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:50.687662+0000","last_undegraded":"2024-04-22T19:58:50.687662+0000","last_fullsized":"2024-04-22T19:58:50.687662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369242+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369242+0000","last_peered":"2024-04-22T19:58:52.369242+0000","last_clean":"2024-04-22T19:58:52.369242+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369242+0000","last_undegraded":"2024-04-22T19:58:52.369242+0000","last_fullsized":"2024-04-22T19:58:52.369242+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781363+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781363+0000","last_peered":"2024-04-22T19:58:49.781363+0000","last_clean":"2024-04-22T19:58:49.781363+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781363+0000","last_undegraded":"2024-04-22T19:58:49.781363+0000","last_fullsized":"2024-04-22T19:58:49.781363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719016+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.719016+0000","last_peered":"2024-04-22T19:58:49.719016+0000","last_clean":"2024-04-22T19:58:49.719016+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.719016+0000","last_undegraded":"2024-04-22T19:58:49.719016+0000","last_fullsized":"2024-04-22T19:58:49.719016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732474+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732474+0000","last_peered":"2024-04-22T19:58:49.732474+0000","last_clean":"2024-04-22T19:58:49.732474+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732474+0000","last_undegraded":"2024-04-22T19:58:49.732474+0000","last_fullsized":"2024-04-22T19:58:49.732474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687825+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:50.687825+0000","last_peered":"2024-04-22T19:58:50.687825+0000","last_clean":"2024-04-22T19:58:50.687825+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:50.687825+0000","last_undegraded":"2024-04-22T19:58:50.687825+0000","last_fullsized":"2024-04-22T19:58:50.687825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357646+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357646+0000","last_peered":"2024-04-22T19:58:51.357646+0000","last_clean":"2024-04-22T19:58:51.357646+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357646+0000","last_undegraded":"2024-04-22T19:58:51.357646+0000","last_fullsized":"2024-04-22T19:58:51.357646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728080+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:50.728080+0000","last_peered":"2024-04-22T19:58:50.728080+0000","last_clean":"2024-04-22T19:58:50.728080+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:50.728080+0000","last_undegraded":"2024-04-22T19:58:50.728080+0000","last_fullsized":"2024-04-22T19:58:50.728080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.886608+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:58:54.886608+0000","last_peered":"2024-04-22T19:58:54.886608+0000","last_clean":"2024-04-22T19:58:54.886608+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:58:54.886608+0000","last_undegraded":"2024-04-22T19:58:54.886608+0000","last_fullsized":"2024-04-22T19:58:54.886608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687709+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:50.687709+0000","last_peered":"2024-04-22T19:58:50.687709+0000","last_clean":"2024-04-22T19:58:50.687709+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:50.687709+0000","last_undegraded":"2024-04-22T19:58:50.687709+0000","last_fullsized":"2024-04-22T19:58:50.687709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783301+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783301+0000","last_peered":"2024-04-22T19:58:49.783301+0000","last_clean":"2024-04-22T19:58:49.783301+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783301+0000","last_undegraded":"2024-04-22T19:58:49.783301+0000","last_fullsized":"2024-04-22T19:58:49.783301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574941,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:01:22.337 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T19:54:08.279006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=19, tm_min=58, tm_sec=13, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T20:01:22.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 3.24 deep-scrub 2024-04-22T20:01:22.510 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-22T20:01:22.510 INFO:teuthology.orchestra.run.smithi111.stdout: "deep": true, 2024-04-22T20:01:22.510 INFO:teuthology.orchestra.run.smithi111.stdout: "must": true, 2024-04-22T20:01:22.510 INFO:teuthology.orchestra.run.smithi111.stdout: "stamp": "0.000000" 2024-04-22T20:01:22.510 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-22T20:01:22.526 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T20:01:42.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T20:01:42.886 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-22T20:01:42.892 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-22T20:01:42.908 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-04-22T20:01:41.538880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4799,"num_read_kb":3702,"num_write":4429,"num_write_kb":6187920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":812,"num_bytes_recovered":2256539292,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304672,"kb_used_data":13656,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754670048,"statfs":{"total":773094113280,"available":772782129152,"internally_reserved":0,"allocated":13983744,"data_stored":8579756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005953"},"pg_stats":[{"pgid":"3.3f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731664+0000","last_change":"2024-04-22T19:58:42.423584+0000","last_active":"2024-04-22T19:58:49.731664+0000","last_peered":"2024-04-22T19:58:49.731664+0000","last_clean":"2024-04-22T19:58:49.731664+0000","last_became_active":"2024-04-22T19:54:09.352608+0000","last_became_peered":"2024-04-22T19:54:09.352608+0000","last_unstale":"2024-04-22T19:58:49.731664+0000","last_undegraded":"2024-04-22T19:58:49.731664+0000","last_fullsized":"2024-04-22T19:58:49.731664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:42.423330+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.423330+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:30:08.801715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"110'10","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.732110+0000","last_change":"2024-04-22T19:58:35.623503+0000","last_active":"2024-04-22T19:59:10.732110+0000","last_peered":"2024-04-22T19:59:10.732110+0000","last_clean":"2024-04-22T19:59:10.732110+0000","last_became_active":"2024-04-22T19:54:11.369751+0000","last_became_peered":"2024-04-22T19:54:11.369751+0000","last_unstale":"2024-04-22T19:59:10.732110+0000","last_undegraded":"2024-04-22T19:59:10.732110+0000","last_fullsized":"2024-04-22T19:59:10.732110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:35.623100+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.623100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:39.653997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"128'36","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723614+0000","last_change":"2024-04-22T19:58:31.399291+0000","last_active":"2024-04-22T19:58:49.723614+0000","last_peered":"2024-04-22T19:58:49.723614+0000","last_clean":"2024-04-22T19:58:49.723614+0000","last_became_active":"2024-04-22T19:54:09.312086+0000","last_became_peered":"2024-04-22T19:54:09.312086+0000","last_unstale":"2024-04-22T19:58:49.723614+0000","last_undegraded":"2024-04-22T19:58:49.723614+0000","last_fullsized":"2024-04-22T19:58:49.723614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:31.398886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.398886+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:35:04.396675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708955+0000","last_change":"2024-04-22T19:58:28.369008+0000","last_active":"2024-04-22T19:59:10.708955+0000","last_peered":"2024-04-22T19:59:10.708955+0000","last_clean":"2024-04-22T19:59:10.708955+0000","last_became_active":"2024-04-22T19:54:11.372759+0000","last_became_peered":"2024-04-22T19:54:11.372759+0000","last_unstale":"2024-04-22T19:59:10.708955+0000","last_undegraded":"2024-04-22T19:59:10.708955+0000","last_fullsized":"2024-04-22T19:59:10.708955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.368653+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.368653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:43.839396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725001+0000","last_change":"2024-04-22T19:58:41.847703+0000","last_active":"2024-04-22T19:58:49.725001+0000","last_peered":"2024-04-22T19:58:49.725001+0000","last_clean":"2024-04-22T19:58:49.725001+0000","last_became_active":"2024-04-22T19:54:09.311437+0000","last_became_peered":"2024-04-22T19:54:09.311437+0000","last_unstale":"2024-04-22T19:58:49.725001+0000","last_undegraded":"2024-04-22T19:58:49.725001+0000","last_fullsized":"2024-04-22T19:58:49.725001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:41.847426+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.847426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:22.545511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"102'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708252+0000","last_change":"2024-04-22T19:58:45.139360+0000","last_active":"2024-04-22T19:59:10.708252+0000","last_peered":"2024-04-22T19:59:10.708252+0000","last_clean":"2024-04-22T19:59:10.708252+0000","last_became_active":"2024-04-22T19:54:11.348560+0000","last_became_peered":"2024-04-22T19:54:11.348560+0000","last_unstale":"2024-04-22T19:59:10.708252+0000","last_undegraded":"2024-04-22T19:59:10.708252+0000","last_fullsized":"2024-04-22T19:59:10.708252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:45.139096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.139096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:25.837181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"128'46","reported_seq":347,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.601604+0000","last_change":"2024-04-22T19:58:52.601604+0000","last_active":"2024-04-22T19:58:52.601604+0000","last_peered":"2024-04-22T19:58:52.601604+0000","last_clean":"2024-04-22T19:58:52.601604+0000","last_became_active":"2024-04-22T19:57:45.786932+0000","last_became_peered":"2024-04-22T19:57:45.786932+0000","last_unstale":"2024-04-22T19:58:52.601604+0000","last_undegraded":"2024-04-22T19:58:52.601604+0000","last_fullsized":"2024-04-22T19:58:52.601604+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:52.601360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.601360+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:26.722906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"102'2","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.697233+0000","last_change":"2024-04-22T19:58:50.848092+0000","last_active":"2024-04-22T19:59:10.697233+0000","last_peered":"2024-04-22T19:59:10.697233+0000","last_clean":"2024-04-22T19:59:10.697233+0000","last_became_active":"2024-04-22T19:57:45.764903+0000","last_became_peered":"2024-04-22T19:57:45.764903+0000","last_unstale":"2024-04-22T19:59:10.697233+0000","last_undegraded":"2024-04-22T19:59:10.697233+0000","last_fullsized":"2024-04-22T19:59:10.697233+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:50.847817+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.847817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:43.531023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"128'56","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.709040+0000","last_change":"2024-04-22T19:58:41.458999+0000","last_active":"2024-04-22T19:59:10.709040+0000","last_peered":"2024-04-22T19:59:10.709040+0000","last_clean":"2024-04-22T19:59:10.709040+0000","last_became_active":"2024-04-22T19:54:09.352303+0000","last_became_peered":"2024-04-22T19:54:09.352303+0000","last_unstale":"2024-04-22T19:59:10.709040+0000","last_undegraded":"2024-04-22T19:59:10.709040+0000","last_fullsized":"2024-04-22T19:59:10.709040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:41.458727+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.458727+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:16.303503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"110'10","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780957+0000","last_change":"2024-04-22T19:58:20.058459+0000","last_active":"2024-04-22T19:58:49.780957+0000","last_peered":"2024-04-22T19:58:49.780957+0000","last_clean":"2024-04-22T19:58:49.780957+0000","last_became_active":"2024-04-22T19:54:11.365505+0000","last_became_peered":"2024-04-22T19:54:11.365505+0000","last_unstale":"2024-04-22T19:58:49.780957+0000","last_undegraded":"2024-04-22T19:58:49.780957+0000","last_fullsized":"2024-04-22T19:58:49.780957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:20.058202+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.058202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:39:45.877776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"128'22","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.732196+0000","last_change":"2024-04-22T19:58:41.537227+0000","last_active":"2024-04-22T19:59:10.732196+0000","last_peered":"2024-04-22T19:59:10.732196+0000","last_clean":"2024-04-22T19:59:10.732196+0000","last_became_active":"2024-04-22T19:54:09.324137+0000","last_became_peered":"2024-04-22T19:54:09.324137+0000","last_unstale":"2024-04-22T19:59:10.732196+0000","last_undegraded":"2024-04-22T19:59:10.732196+0000","last_fullsized":"2024-04-22T19:59:10.732196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:41.536984+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.536984+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:41.485901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720074+0000","last_change":"2024-04-22T19:58:44.124457+0000","last_active":"2024-04-22T19:58:49.720074+0000","last_peered":"2024-04-22T19:58:49.720074+0000","last_clean":"2024-04-22T19:58:49.720074+0000","last_became_active":"2024-04-22T19:54:11.346618+0000","last_became_peered":"2024-04-22T19:54:11.346618+0000","last_unstale":"2024-04-22T19:58:49.720074+0000","last_undegraded":"2024-04-22T19:58:49.720074+0000","last_fullsized":"2024-04-22T19:58:49.720074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:44.124165+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.124165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:23.318400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"128'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708995+0000","last_change":"2024-04-22T19:58:40.426258+0000","last_active":"2024-04-22T19:59:10.708995+0000","last_peered":"2024-04-22T19:59:10.708995+0000","last_clean":"2024-04-22T19:59:10.708995+0000","last_became_active":"2024-04-22T19:54:09.343354+0000","last_became_peered":"2024-04-22T19:54:09.343354+0000","last_unstale":"2024-04-22T19:59:10.708995+0000","last_undegraded":"2024-04-22T19:59:10.708995+0000","last_fullsized":"2024-04-22T19:59:10.708995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:40.426006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.426006+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:58.884067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"102'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783725+0000","last_change":"2024-04-22T19:58:37.597972+0000","last_active":"2024-04-22T19:58:49.783725+0000","last_peered":"2024-04-22T19:58:49.783725+0000","last_clean":"2024-04-22T19:58:49.783725+0000","last_became_active":"2024-04-22T19:54:11.359584+0000","last_became_peered":"2024-04-22T19:54:11.359584+0000","last_unstale":"2024-04-22T19:58:49.783725+0000","last_undegraded":"2024-04-22T19:58:49.783725+0000","last_fullsized":"2024-04-22T19:58:49.783725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:37.597725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.597725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:03.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780819+0000","last_change":"2024-04-22T19:58:24.835454+0000","last_active":"2024-04-22T19:58:49.780819+0000","last_peered":"2024-04-22T19:58:49.780819+0000","last_clean":"2024-04-22T19:58:49.780819+0000","last_became_active":"2024-04-22T19:57:45.776899+0000","last_became_peered":"2024-04-22T19:57:45.776899+0000","last_unstale":"2024-04-22T19:58:49.780819+0000","last_undegraded":"2024-04-22T19:58:49.780819+0000","last_fullsized":"2024-04-22T19:58:49.780819+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:24.835200+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.835200+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:55:54.112880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'4","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729828+0000","last_change":"2024-04-22T19:58:31.475764+0000","last_active":"2024-04-22T19:58:49.729828+0000","last_peered":"2024-04-22T19:58:49.729828+0000","last_clean":"2024-04-22T19:58:49.729828+0000","last_became_active":"2024-04-22T19:57:45.781379+0000","last_became_peered":"2024-04-22T19:57:45.781379+0000","last_unstale":"2024-04-22T19:58:49.729828+0000","last_undegraded":"2024-04-22T19:58:49.729828+0000","last_fullsized":"2024-04-22T19:58:49.729828+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.475501+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.475501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:17.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"94'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.703892+0000","last_change":"2024-04-22T19:58:43.173156+0000","last_active":"2024-04-22T19:58:50.703892+0000","last_peered":"2024-04-22T19:58:50.703892+0000","last_clean":"2024-04-22T19:58:50.703892+0000","last_became_active":"2024-04-22T19:54:11.343543+0000","last_became_peered":"2024-04-22T19:54:11.343543+0000","last_unstale":"2024-04-22T19:58:50.703892+0000","last_undegraded":"2024-04-22T19:58:50.703892+0000","last_fullsized":"2024-04-22T19:58:50.703892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:43.172784+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.172784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.985715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"128'32","reported_seq":159,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730944+0000","last_change":"2024-04-22T19:58:49.347707+0000","last_active":"2024-04-22T19:58:49.730944+0000","last_peered":"2024-04-22T19:58:49.730944+0000","last_clean":"2024-04-22T19:58:49.730944+0000","last_became_active":"2024-04-22T19:56:13.541240+0000","last_became_peered":"2024-04-22T19:56:13.541240+0000","last_unstale":"2024-04-22T19:58:49.730944+0000","last_undegraded":"2024-04-22T19:58:49.730944+0000","last_fullsized":"2024-04-22T19:58:49.730944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:49.347451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.347451+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:33.160383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"102'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704725+0000","last_change":"2024-04-22T19:58:26.412149+0000","last_active":"2024-04-22T19:58:50.704725+0000","last_peered":"2024-04-22T19:58:50.704725+0000","last_clean":"2024-04-22T19:58:50.704725+0000","last_became_active":"2024-04-22T19:54:11.377734+0000","last_became_peered":"2024-04-22T19:54:11.377734+0000","last_unstale":"2024-04-22T19:58:50.704725+0000","last_undegraded":"2024-04-22T19:58:50.704725+0000","last_fullsized":"2024-04-22T19:58:50.704725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.411728+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.411728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:03.204254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"128'50","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700929+0000","last_change":"2024-04-22T19:58:31.095266+0000","last_active":"2024-04-22T19:59:00.700929+0000","last_peered":"2024-04-22T19:59:00.700929+0000","last_clean":"2024-04-22T19:59:00.700929+0000","last_became_active":"2024-04-22T19:54:09.335708+0000","last_became_peered":"2024-04-22T19:54:09.335708+0000","last_unstale":"2024-04-22T19:59:00.700929+0000","last_undegraded":"2024-04-22T19:59:00.700929+0000","last_fullsized":"2024-04-22T19:59:00.700929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:31.094941+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.094941+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:52.744115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728180+0000","last_change":"2024-04-22T19:58:33.637242+0000","last_active":"2024-04-22T19:58:50.728180+0000","last_peered":"2024-04-22T19:58:50.728180+0000","last_clean":"2024-04-22T19:58:50.728180+0000","last_became_active":"2024-04-22T19:54:11.375398+0000","last_became_peered":"2024-04-22T19:54:11.375398+0000","last_unstale":"2024-04-22T19:58:50.728180+0000","last_undegraded":"2024-04-22T19:58:50.728180+0000","last_fullsized":"2024-04-22T19:58:50.728180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.637002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.637002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:58.765558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"128'46","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700904+0000","last_change":"2024-04-22T19:58:30.088031+0000","last_active":"2024-04-22T19:59:00.700904+0000","last_peered":"2024-04-22T19:59:00.700904+0000","last_clean":"2024-04-22T19:59:00.700904+0000","last_became_active":"2024-04-22T19:54:09.334434+0000","last_became_peered":"2024-04-22T19:54:09.334434+0000","last_unstale":"2024-04-22T19:59:00.700904+0000","last_undegraded":"2024-04-22T19:59:00.700904+0000","last_fullsized":"2024-04-22T19:59:00.700904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:30.087677+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.087677+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:11.701619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"94'4","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.689640+0000","last_change":"2024-04-22T19:58:34.470622+0000","last_active":"2024-04-22T19:59:00.689640+0000","last_peered":"2024-04-22T19:59:00.689640+0000","last_clean":"2024-04-22T19:59:00.689640+0000","last_became_active":"2024-04-22T19:57:45.788565+0000","last_became_peered":"2024-04-22T19:57:45.788565+0000","last_unstale":"2024-04-22T19:59:00.689640+0000","last_undegraded":"2024-04-22T19:59:00.689640+0000","last_fullsized":"2024-04-22T19:59:00.689640+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:34.470363+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.470363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:36.265987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"128'42","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706158+0000","last_change":"2024-04-22T19:58:41.208729+0000","last_active":"2024-04-22T19:59:00.706158+0000","last_peered":"2024-04-22T19:59:00.706158+0000","last_clean":"2024-04-22T19:59:00.706158+0000","last_became_active":"2024-04-22T19:54:09.349638+0000","last_became_peered":"2024-04-22T19:54:09.349638+0000","last_unstale":"2024-04-22T19:59:00.706158+0000","last_undegraded":"2024-04-22T19:59:00.706158+0000","last_fullsized":"2024-04-22T19:59:00.706158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:41.208454+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.208454+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:02.382862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"72'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.689718+0000","last_change":"2024-04-22T19:58:21.518650+0000","last_active":"2024-04-22T19:59:00.689718+0000","last_peered":"2024-04-22T19:59:00.689718+0000","last_clean":"2024-04-22T19:59:00.689718+0000","last_became_active":"2024-04-22T19:54:11.366422+0000","last_became_peered":"2024-04-22T19:54:11.366422+0000","last_unstale":"2024-04-22T19:59:00.689718+0000","last_undegraded":"2024-04-22T19:59:00.689718+0000","last_fullsized":"2024-04-22T19:59:00.689718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:21.518246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:06:55.768227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"128'44","reported_seq":120,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781166+0000","last_change":"2024-04-22T19:58:19.961232+0000","last_active":"2024-04-22T19:58:49.781166+0000","last_peered":"2024-04-22T19:58:49.781166+0000","last_clean":"2024-04-22T19:58:49.781166+0000","last_became_active":"2024-04-22T19:57:45.776886+0000","last_became_peered":"2024-04-22T19:57:45.776886+0000","last_unstale":"2024-04-22T19:58:49.781166+0000","last_undegraded":"2024-04-22T19:58:49.781166+0000","last_fullsized":"2024-04-22T19:58:49.781166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.960970+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.960970+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:03:10.242028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"72'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706261+0000","last_change":"2024-04-22T19:58:24.306326+0000","last_active":"2024-04-22T19:59:00.706261+0000","last_peered":"2024-04-22T19:59:00.706261+0000","last_clean":"2024-04-22T19:59:00.706261+0000","last_became_active":"2024-04-22T19:54:11.382226+0000","last_became_peered":"2024-04-22T19:54:11.382226+0000","last_unstale":"2024-04-22T19:59:00.706261+0000","last_undegraded":"2024-04-22T19:59:00.706261+0000","last_fullsized":"2024-04-22T19:59:00.706261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:24.306055+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.306055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.840256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"128'64","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693474+0000","last_change":"2024-04-22T19:58:42.856114+0000","last_active":"2024-04-22T19:58:50.693474+0000","last_peered":"2024-04-22T19:58:50.693474+0000","last_clean":"2024-04-22T19:58:50.693474+0000","last_became_active":"2024-04-22T19:54:09.312495+0000","last_became_peered":"2024-04-22T19:54:09.312495+0000","last_unstale":"2024-04-22T19:58:50.693474+0000","last_undegraded":"2024-04-22T19:58:50.693474+0000","last_fullsized":"2024-04-22T19:58:50.693474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'64","last_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_deep_scrub":"128'64","last_deep_scrub_stamp":"2024-04-22T19:58:42.855737+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.855737+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:03.584172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708134+0000","last_change":"2024-04-22T19:58:49.069868+0000","last_active":"2024-04-22T19:59:10.708134+0000","last_peered":"2024-04-22T19:59:10.708134+0000","last_clean":"2024-04-22T19:59:10.708134+0000","last_became_active":"2024-04-22T19:57:45.767256+0000","last_became_peered":"2024-04-22T19:57:45.767256+0000","last_unstale":"2024-04-22T19:59:10.708134+0000","last_undegraded":"2024-04-22T19:59:10.708134+0000","last_fullsized":"2024-04-22T19:59:10.708134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-22T19:58:49.069613+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.069613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:12.394579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"94'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780652+0000","last_change":"2024-04-22T19:58:22.905904+0000","last_active":"2024-04-22T19:58:49.780652+0000","last_peered":"2024-04-22T19:58:49.780652+0000","last_clean":"2024-04-22T19:58:49.780652+0000","last_became_active":"2024-04-22T19:57:45.775912+0000","last_became_peered":"2024-04-22T19:57:45.775912+0000","last_unstale":"2024-04-22T19:58:49.780652+0000","last_undegraded":"2024-04-22T19:58:49.780652+0000","last_fullsized":"2024-04-22T19:58:49.780652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.905620+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.905620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:23:50.165871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"128'54","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704833+0000","last_change":"2024-04-22T19:58:36.450209+0000","last_active":"2024-04-22T19:58:50.704833+0000","last_peered":"2024-04-22T19:58:50.704833+0000","last_clean":"2024-04-22T19:58:50.704833+0000","last_became_active":"2024-04-22T19:54:09.357828+0000","last_became_peered":"2024-04-22T19:54:09.357828+0000","last_unstale":"2024-04-22T19:58:50.704833+0000","last_undegraded":"2024-04-22T19:58:50.704833+0000","last_fullsized":"2024-04-22T19:58:50.704833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:36.449926+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.449926+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:12.898924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.731216+0000","last_change":"2024-04-22T19:58:22.717599+0000","last_active":"2024-04-22T19:59:05.731216+0000","last_peered":"2024-04-22T19:59:05.731216+0000","last_clean":"2024-04-22T19:59:05.731216+0000","last_became_active":"2024-04-22T19:54:13.369613+0000","last_became_peered":"2024-04-22T19:54:13.369613+0000","last_unstale":"2024-04-22T19:59:05.731216+0000","last_undegraded":"2024-04-22T19:59:05.731216+0000","last_fullsized":"2024-04-22T19:59:05.731216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.717340+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:55.715129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"128'23","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.696312+0000","last_change":"2024-04-22T19:58:29.718098+0000","last_active":"2024-04-22T19:59:05.696312+0000","last_peered":"2024-04-22T19:59:05.696312+0000","last_clean":"2024-04-22T19:59:05.696312+0000","last_became_active":"2024-04-22T19:54:15.366448+0000","last_became_peered":"2024-04-22T19:54:15.366448+0000","last_unstale":"2024-04-22T19:59:05.696312+0000","last_undegraded":"2024-04-22T19:59:05.696312+0000","last_fullsized":"2024-04-22T19:59:05.696312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:29.717813+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.717813+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:55.870440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.709152+0000","last_change":"2024-04-22T19:58:20.474223+0000","last_active":"2024-04-22T19:59:10.709152+0000","last_peered":"2024-04-22T19:59:10.709152+0000","last_clean":"2024-04-22T19:59:10.709152+0000","last_became_active":"2024-04-22T19:54:17.381134+0000","last_became_peered":"2024-04-22T19:54:17.381134+0000","last_unstale":"2024-04-22T19:59:10.709152+0000","last_undegraded":"2024-04-22T19:59:10.709152+0000","last_fullsized":"2024-04-22T19:59:10.709152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.473978+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.473978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:41.026983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"128'52","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.732160+0000","last_change":"2024-04-22T19:58:46.589302+0000","last_active":"2024-04-22T19:59:10.732160+0000","last_peered":"2024-04-22T19:59:10.732160+0000","last_clean":"2024-04-22T19:59:10.732160+0000","last_became_active":"2024-04-22T19:54:19.391689+0000","last_became_peered":"2024-04-22T19:54:19.391689+0000","last_unstale":"2024-04-22T19:59:10.732160+0000","last_undegraded":"2024-04-22T19:59:10.732160+0000","last_fullsized":"2024-04-22T19:59:10.732160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:46.589050+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.589050+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.045106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"72'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.730140+0000","last_change":"2024-04-22T19:58:31.634279+0000","last_active":"2024-04-22T19:59:00.730140+0000","last_peered":"2024-04-22T19:59:00.730140+0000","last_clean":"2024-04-22T19:59:00.730140+0000","last_became_active":"2024-04-22T19:54:11.376217+0000","last_became_peered":"2024-04-22T19:54:11.376217+0000","last_unstale":"2024-04-22T19:59:00.730140+0000","last_undegraded":"2024-04-22T19:59:00.730140+0000","last_fullsized":"2024-04-22T19:59:00.730140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:31.634014+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.634014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:00:20.994135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"128'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693513+0000","last_change":"2024-04-22T19:58:45.895933+0000","last_active":"2024-04-22T19:58:50.693513+0000","last_peered":"2024-04-22T19:58:50.693513+0000","last_clean":"2024-04-22T19:58:50.693513+0000","last_became_active":"2024-04-22T19:54:09.341403+0000","last_became_peered":"2024-04-22T19:54:09.341403+0000","last_unstale":"2024-04-22T19:58:50.693513+0000","last_undegraded":"2024-04-22T19:58:50.693513+0000","last_fullsized":"2024-04-22T19:58:50.693513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:45.895652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.895652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:24:09.220618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":6,"num_write":70,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"128'2","reported_seq":59,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780876+0000","last_change":"2024-04-22T19:58:35.765462+0000","last_active":"2024-04-22T19:58:49.780876+0000","last_peered":"2024-04-22T19:58:49.780876+0000","last_clean":"2024-04-22T19:58:49.780876+0000","last_became_active":"2024-04-22T19:57:45.773429+0000","last_became_peered":"2024-04-22T19:57:45.773429+0000","last_unstale":"2024-04-22T19:58:49.780876+0000","last_undegraded":"2024-04-22T19:58:49.780876+0000","last_fullsized":"2024-04-22T19:58:49.780876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:35.765205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.765205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:47:01.188160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"128'9","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.707356+0000","last_change":"2024-04-22T19:58:32.302606+0000","last_active":"2024-04-22T19:59:05.707356+0000","last_peered":"2024-04-22T19:59:05.707356+0000","last_clean":"2024-04-22T19:59:05.707356+0000","last_became_active":"2024-04-22T19:54:15.367723+0000","last_became_peered":"2024-04-22T19:54:15.367723+0000","last_unstale":"2024-04-22T19:59:05.707356+0000","last_undegraded":"2024-04-22T19:59:05.707356+0000","last_fullsized":"2024-04-22T19:59:05.707356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'9","last_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_deep_scrub":"128'9","last_deep_scrub_stamp":"2024-04-22T19:58:32.302336+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.302336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:06.126202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708485+0000","last_change":"2024-04-22T19:58:21.272870+0000","last_active":"2024-04-22T19:59:10.708485+0000","last_peered":"2024-04-22T19:59:10.708485+0000","last_clean":"2024-04-22T19:59:10.708485+0000","last_became_active":"2024-04-22T19:54:17.371769+0000","last_became_peered":"2024-04-22T19:54:17.371769+0000","last_unstale":"2024-04-22T19:59:10.708485+0000","last_undegraded":"2024-04-22T19:59:10.708485+0000","last_fullsized":"2024-04-22T19:59:10.708485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.272623+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.272623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.988843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719284+0000","last_change":"2024-04-22T19:58:18.778927+0000","last_active":"2024-04-22T19:58:49.719284+0000","last_peered":"2024-04-22T19:58:49.719284+0000","last_clean":"2024-04-22T19:58:49.719284+0000","last_became_active":"2024-04-22T19:54:19.376861+0000","last_became_peered":"2024-04-22T19:54:19.376861+0000","last_unstale":"2024-04-22T19:58:49.719284+0000","last_undegraded":"2024-04-22T19:58:49.719284+0000","last_fullsized":"2024-04-22T19:58:49.719284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.778674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.778674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:55.958715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.695397+0000","last_change":"2024-04-22T19:58:21.839691+0000","last_active":"2024-04-22T19:59:00.695397+0000","last_peered":"2024-04-22T19:59:00.695397+0000","last_clean":"2024-04-22T19:59:00.695397+0000","last_became_active":"2024-04-22T19:57:45.777817+0000","last_became_peered":"2024-04-22T19:57:45.777817+0000","last_unstale":"2024-04-22T19:59:00.695397+0000","last_undegraded":"2024-04-22T19:59:00.695397+0000","last_fullsized":"2024-04-22T19:59:00.695397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.839314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.839314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:07:30.724356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"128'34","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704789+0000","last_change":"2024-04-22T19:58:34.438814+0000","last_active":"2024-04-22T19:58:50.704789+0000","last_peered":"2024-04-22T19:58:50.704789+0000","last_clean":"2024-04-22T19:58:50.704789+0000","last_became_active":"2024-04-22T19:54:09.357944+0000","last_became_peered":"2024-04-22T19:54:09.357944+0000","last_unstale":"2024-04-22T19:58:50.704789+0000","last_undegraded":"2024-04-22T19:58:50.704789+0000","last_fullsized":"2024-04-22T19:58:50.704789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:34.438557+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.438557+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:42.541849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787770+0000","last_change":"2024-04-22T19:58:38.745911+0000","last_active":"2024-04-22T19:58:49.787770+0000","last_peered":"2024-04-22T19:58:49.787770+0000","last_clean":"2024-04-22T19:58:49.787770+0000","last_became_active":"2024-04-22T19:57:45.786795+0000","last_became_peered":"2024-04-22T19:57:45.786795+0000","last_unstale":"2024-04-22T19:58:49.787770+0000","last_undegraded":"2024-04-22T19:58:49.787770+0000","last_fullsized":"2024-04-22T19:58:49.787770+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.745635+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.745635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:18:56.954405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"128'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.688701+0000","last_change":"2024-04-22T19:58:16.479385+0000","last_active":"2024-04-22T19:58:55.688701+0000","last_peered":"2024-04-22T19:58:55.688701+0000","last_clean":"2024-04-22T19:58:55.688701+0000","last_became_active":"2024-04-22T19:54:15.358774+0000","last_became_peered":"2024-04-22T19:54:15.358774+0000","last_unstale":"2024-04-22T19:58:55.688701+0000","last_undegraded":"2024-04-22T19:58:55.688701+0000","last_fullsized":"2024-04-22T19:58:55.688701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:16.479219+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.479219+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:02:43.681364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"128'138","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.709074+0000","last_change":"2024-04-22T19:58:19.498802+0000","last_active":"2024-04-22T19:59:10.709074+0000","last_peered":"2024-04-22T19:59:10.709074+0000","last_clean":"2024-04-22T19:59:10.709074+0000","last_became_active":"2024-04-22T19:54:17.390245+0000","last_became_peered":"2024-04-22T19:54:17.390245+0000","last_unstale":"2024-04-22T19:59:10.709074+0000","last_undegraded":"2024-04-22T19:59:10.709074+0000","last_fullsized":"2024-04-22T19:59:10.709074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:19.498548+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.498548+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:46:41.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718952+0000","last_change":"2024-04-22T19:58:17.188034+0000","last_active":"2024-04-22T19:58:49.718952+0000","last_peered":"2024-04-22T19:58:49.718952+0000","last_clean":"2024-04-22T19:58:49.718952+0000","last_became_active":"2024-04-22T19:54:19.961716+0000","last_became_peered":"2024-04-22T19:54:19.961716+0000","last_unstale":"2024-04-22T19:58:49.718952+0000","last_undegraded":"2024-04-22T19:58:49.718952+0000","last_fullsized":"2024-04-22T19:58:49.718952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.187785+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.187785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:18.983408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"94'12","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:54.823797+0000","last_change":"2024-04-22T19:58:54.823797+0000","last_active":"2024-04-22T19:58:54.823797+0000","last_peered":"2024-04-22T19:58:54.823797+0000","last_clean":"2024-04-22T19:58:54.823797+0000","last_became_active":"2024-04-22T19:57:45.782803+0000","last_became_peered":"2024-04-22T19:57:45.782803+0000","last_unstale":"2024-04-22T19:58:54.823797+0000","last_undegraded":"2024-04-22T19:58:54.823797+0000","last_fullsized":"2024-04-22T19:58:54.823797+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-04-22T19:58:54.823392+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.823392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:03:00.698299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"128'60","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.698994+0000","last_change":"2024-04-22T19:58:28.040907+0000","last_active":"2024-04-22T19:58:50.698994+0000","last_peered":"2024-04-22T19:58:50.698994+0000","last_clean":"2024-04-22T19:58:50.698994+0000","last_became_active":"2024-04-22T19:54:09.333911+0000","last_became_peered":"2024-04-22T19:54:09.333911+0000","last_unstale":"2024-04-22T19:58:50.698994+0000","last_undegraded":"2024-04-22T19:58:50.698994+0000","last_fullsized":"2024-04-22T19:58:50.698994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:28.040556+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.040556+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:15.465509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.731279+0000","last_change":"2024-04-22T19:58:20.641458+0000","last_active":"2024-04-22T19:59:05.731279+0000","last_peered":"2024-04-22T19:59:05.731279+0000","last_clean":"2024-04-22T19:59:05.731279+0000","last_became_active":"2024-04-22T19:57:45.777919+0000","last_became_peered":"2024-04-22T19:57:45.777919+0000","last_unstale":"2024-04-22T19:59:05.731279+0000","last_undegraded":"2024-04-22T19:59:05.731279+0000","last_fullsized":"2024-04-22T19:59:05.731279+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.641205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.641205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:30.357425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"128'25","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.707963+0000","last_change":"2024-04-22T19:58:33.427878+0000","last_active":"2024-04-22T19:59:05.707963+0000","last_peered":"2024-04-22T19:59:05.707963+0000","last_clean":"2024-04-22T19:59:05.707963+0000","last_became_active":"2024-04-22T19:54:15.378587+0000","last_became_peered":"2024-04-22T19:54:15.378587+0000","last_unstale":"2024-04-22T19:59:05.707963+0000","last_undegraded":"2024-04-22T19:59:05.707963+0000","last_fullsized":"2024-04-22T19:59:05.707963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:33.427618+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.427618+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:57:02.865666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":140,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'145","reported_seq":403,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.872374+0000","last_change":"2024-04-22T19:58:52.872374+0000","last_active":"2024-04-22T19:58:52.872374+0000","last_peered":"2024-04-22T19:58:52.872374+0000","last_clean":"2024-04-22T19:58:52.872374+0000","last_became_active":"2024-04-22T19:57:52.333239+0000","last_became_peered":"2024-04-22T19:57:52.333239+0000","last_unstale":"2024-04-22T19:58:52.872374+0000","last_undegraded":"2024-04-22T19:58:52.872374+0000","last_fullsized":"2024-04-22T19:58:52.872374+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:52.872124+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.872124+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:18:39.444908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779647+0000","last_change":"2024-04-22T19:58:29.654960+0000","last_active":"2024-04-22T19:58:49.779647+0000","last_peered":"2024-04-22T19:58:49.779647+0000","last_clean":"2024-04-22T19:58:49.779647+0000","last_became_active":"2024-04-22T19:54:11.375587+0000","last_became_peered":"2024-04-22T19:54:11.375587+0000","last_unstale":"2024-04-22T19:58:49.779647+0000","last_undegraded":"2024-04-22T19:58:49.779647+0000","last_fullsized":"2024-04-22T19:58:49.779647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.654681+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.654681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:34.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"128'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731757+0000","last_change":"2024-04-22T19:58:43.437110+0000","last_active":"2024-04-22T19:58:49.731757+0000","last_peered":"2024-04-22T19:58:49.731757+0000","last_clean":"2024-04-22T19:58:49.731757+0000","last_became_active":"2024-04-22T19:54:09.356879+0000","last_became_peered":"2024-04-22T19:54:09.356879+0000","last_unstale":"2024-04-22T19:58:49.731757+0000","last_undegraded":"2024-04-22T19:58:49.731757+0000","last_fullsized":"2024-04-22T19:58:49.731757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:43.436845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.436845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:20.465511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728959+0000","last_change":"2024-04-22T19:58:23.512955+0000","last_active":"2024-04-22T19:58:49.728959+0000","last_peered":"2024-04-22T19:58:49.728959+0000","last_clean":"2024-04-22T19:58:49.728959+0000","last_became_active":"2024-04-22T19:54:13.371139+0000","last_became_peered":"2024-04-22T19:54:13.371139+0000","last_unstale":"2024-04-22T19:58:49.728959+0000","last_undegraded":"2024-04-22T19:58:49.728959+0000","last_fullsized":"2024-04-22T19:58:49.728959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.512717+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.512717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:24:20.221826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778574+0000","last_change":"2024-04-22T19:58:32.646966+0000","last_active":"2024-04-22T19:58:49.778574+0000","last_peered":"2024-04-22T19:58:49.778574+0000","last_clean":"2024-04-22T19:58:49.778574+0000","last_became_active":"2024-04-22T19:54:15.376599+0000","last_became_peered":"2024-04-22T19:54:15.376599+0000","last_unstale":"2024-04-22T19:58:49.778574+0000","last_undegraded":"2024-04-22T19:58:49.778574+0000","last_fullsized":"2024-04-22T19:58:49.778574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:32.646663+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.646663+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:58.799289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687789+0000","last_change":"2024-04-22T19:58:37.387348+0000","last_active":"2024-04-22T19:58:50.687789+0000","last_peered":"2024-04-22T19:58:50.687789+0000","last_clean":"2024-04-22T19:58:50.687789+0000","last_became_active":"2024-04-22T19:54:17.379805+0000","last_became_peered":"2024-04-22T19:54:17.379805+0000","last_unstale":"2024-04-22T19:58:50.687789+0000","last_undegraded":"2024-04-22T19:58:50.687789+0000","last_fullsized":"2024-04-22T19:58:50.687789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.387104+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.387104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:32:01.638538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"110'4","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781981+0000","last_change":"2024-04-22T19:58:36.595013+0000","last_active":"2024-04-22T19:58:49.781981+0000","last_peered":"2024-04-22T19:58:49.781981+0000","last_clean":"2024-04-22T19:58:49.781981+0000","last_became_active":"2024-04-22T19:54:19.390969+0000","last_became_peered":"2024-04-22T19:54:19.390969+0000","last_unstale":"2024-04-22T19:58:49.781981+0000","last_undegraded":"2024-04-22T19:58:49.781981+0000","last_fullsized":"2024-04-22T19:58:49.781981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:36.594693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.594693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:13.623359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718925+0000","last_change":"2024-04-22T19:58:22.293061+0000","last_active":"2024-04-22T19:58:49.718925+0000","last_peered":"2024-04-22T19:58:49.718925+0000","last_clean":"2024-04-22T19:58:49.718925+0000","last_became_active":"2024-04-22T19:54:11.374485+0000","last_became_peered":"2024-04-22T19:54:11.374485+0000","last_unstale":"2024-04-22T19:58:49.718925+0000","last_undegraded":"2024-04-22T19:58:49.718925+0000","last_fullsized":"2024-04-22T19:58:49.718925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.292655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.292655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:59.472696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"128'60","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731844+0000","last_change":"2024-04-22T19:58:44.450211+0000","last_active":"2024-04-22T19:58:49.731844+0000","last_peered":"2024-04-22T19:58:49.731844+0000","last_clean":"2024-04-22T19:58:49.731844+0000","last_became_active":"2024-04-22T19:54:09.353076+0000","last_became_peered":"2024-04-22T19:54:09.353076+0000","last_unstale":"2024-04-22T19:58:49.731844+0000","last_undegraded":"2024-04-22T19:58:49.731844+0000","last_fullsized":"2024-04-22T19:58:49.731844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:44.449955+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.449955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:10.591204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727106+0000","last_change":"2024-04-22T19:58:25.550146+0000","last_active":"2024-04-22T19:58:49.727106+0000","last_peered":"2024-04-22T19:58:49.727106+0000","last_clean":"2024-04-22T19:58:49.727106+0000","last_became_active":"2024-04-22T19:54:13.361210+0000","last_became_peered":"2024-04-22T19:54:13.361210+0000","last_unstale":"2024-04-22T19:58:49.727106+0000","last_undegraded":"2024-04-22T19:58:49.727106+0000","last_fullsized":"2024-04-22T19:58:49.727106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.549886+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.549886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:47.259183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"128'23","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780496+0000","last_change":"2024-04-22T19:58:37.788840+0000","last_active":"2024-04-22T19:58:49.780496+0000","last_peered":"2024-04-22T19:58:49.780496+0000","last_clean":"2024-04-22T19:58:49.780496+0000","last_became_active":"2024-04-22T19:57:45.775238+0000","last_became_peered":"2024-04-22T19:57:45.775238+0000","last_unstale":"2024-04-22T19:58:49.780496+0000","last_undegraded":"2024-04-22T19:58:49.780496+0000","last_fullsized":"2024-04-22T19:58:49.780496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:37.788550+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.788550+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:13:56.231718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778360+0000","last_change":"2024-04-22T19:58:43.778157+0000","last_active":"2024-04-22T19:58:49.778360+0000","last_peered":"2024-04-22T19:58:49.778360+0000","last_clean":"2024-04-22T19:58:49.778360+0000","last_became_active":"2024-04-22T19:57:45.761209+0000","last_became_peered":"2024-04-22T19:57:45.761209+0000","last_unstale":"2024-04-22T19:58:49.778360+0000","last_undegraded":"2024-04-22T19:58:49.778360+0000","last_fullsized":"2024-04-22T19:58:49.778360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:43.777901+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.777901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:42:47.888643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780807+0000","last_change":"2024-04-22T19:58:40.231114+0000","last_active":"2024-04-22T19:58:49.780807+0000","last_peered":"2024-04-22T19:58:49.780807+0000","last_clean":"2024-04-22T19:58:49.780807+0000","last_became_active":"2024-04-22T19:54:19.390705+0000","last_became_peered":"2024-04-22T19:54:19.390705+0000","last_unstale":"2024-04-22T19:58:49.780807+0000","last_undegraded":"2024-04-22T19:58:49.780807+0000","last_fullsized":"2024-04-22T19:58:49.780807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.230839+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.230839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:17.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"102'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779114+0000","last_change":"2024-04-22T19:58:24.110266+0000","last_active":"2024-04-22T19:58:49.779114+0000","last_peered":"2024-04-22T19:58:49.779114+0000","last_clean":"2024-04-22T19:58:49.779114+0000","last_became_active":"2024-04-22T19:54:11.364978+0000","last_became_peered":"2024-04-22T19:54:11.364978+0000","last_unstale":"2024-04-22T19:58:49.779114+0000","last_undegraded":"2024-04-22T19:58:49.779114+0000","last_fullsized":"2024-04-22T19:58:49.779114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'6","last_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_deep_scrub":"102'6","last_deep_scrub_stamp":"2024-04-22T19:58:24.110002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.110002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:52:35.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"128'48","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732174+0000","last_change":"2024-04-22T19:58:30.359409+0000","last_active":"2024-04-22T19:58:49.732174+0000","last_peered":"2024-04-22T19:58:49.732174+0000","last_clean":"2024-04-22T19:58:49.732174+0000","last_became_active":"2024-04-22T19:54:09.360393+0000","last_became_peered":"2024-04-22T19:54:09.360393+0000","last_unstale":"2024-04-22T19:58:49.732174+0000","last_undegraded":"2024-04-22T19:58:49.732174+0000","last_fullsized":"2024-04-22T19:58:49.732174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:30.359153+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.359153+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:44.032320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729122+0000","last_change":"2024-04-22T19:58:26.523999+0000","last_active":"2024-04-22T19:58:49.729122+0000","last_peered":"2024-04-22T19:58:49.729122+0000","last_clean":"2024-04-22T19:58:49.729122+0000","last_became_active":"2024-04-22T19:54:13.363316+0000","last_became_peered":"2024-04-22T19:54:13.363316+0000","last_unstale":"2024-04-22T19:58:49.729122+0000","last_undegraded":"2024-04-22T19:58:49.729122+0000","last_fullsized":"2024-04-22T19:58:49.729122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.523740+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.523740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:13.948692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"128'33","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729394+0000","last_change":"2024-04-22T19:58:27.427862+0000","last_active":"2024-04-22T19:58:49.729394+0000","last_peered":"2024-04-22T19:58:49.729394+0000","last_clean":"2024-04-22T19:58:49.729394+0000","last_became_active":"2024-04-22T19:54:15.371752+0000","last_became_peered":"2024-04-22T19:54:15.371752+0000","last_unstale":"2024-04-22T19:58:49.729394+0000","last_undegraded":"2024-04-22T19:58:49.729394+0000","last_fullsized":"2024-04-22T19:58:49.729394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'33","last_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_deep_scrub":"128'33","last_deep_scrub_stamp":"2024-04-22T19:58:27.427605+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.427605+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:09.902592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"128'138","reported_seq":408,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718103+0000","last_change":"2024-04-22T19:58:35.747918+0000","last_active":"2024-04-22T19:58:49.718103+0000","last_peered":"2024-04-22T19:58:49.718103+0000","last_clean":"2024-04-22T19:58:49.718103+0000","last_became_active":"2024-04-22T19:54:17.367341+0000","last_became_peered":"2024-04-22T19:54:17.367341+0000","last_unstale":"2024-04-22T19:58:49.718103+0000","last_undegraded":"2024-04-22T19:58:49.718103+0000","last_fullsized":"2024-04-22T19:58:49.718103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.747517+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.747517+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:50.447799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"72'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724964+0000","last_change":"2024-04-22T19:58:16.730644+0000","last_active":"2024-04-22T19:58:49.724964+0000","last_peered":"2024-04-22T19:58:49.724964+0000","last_clean":"2024-04-22T19:58:49.724964+0000","last_became_active":"2024-04-22T19:54:19.380565+0000","last_became_peered":"2024-04-22T19:54:19.380565+0000","last_unstale":"2024-04-22T19:58:49.724964+0000","last_undegraded":"2024-04-22T19:58:49.724964+0000","last_fullsized":"2024-04-22T19:58:49.724964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:16.730457+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.730457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:25:09.035892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'8","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722262+0000","last_change":"2024-04-22T19:58:36.787907+0000","last_active":"2024-04-22T19:58:49.722262+0000","last_peered":"2024-04-22T19:58:49.722262+0000","last_clean":"2024-04-22T19:58:49.722262+0000","last_became_active":"2024-04-22T19:54:11.351140+0000","last_became_peered":"2024-04-22T19:54:11.351140+0000","last_unstale":"2024-04-22T19:58:49.722262+0000","last_undegraded":"2024-04-22T19:58:49.722262+0000","last_fullsized":"2024-04-22T19:58:49.722262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:36.787607+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.787607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:04.047858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"128'48","reported_seq":358,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.577277+0000","last_change":"2024-04-22T19:58:51.577277+0000","last_active":"2024-04-22T19:58:51.577277+0000","last_peered":"2024-04-22T19:58:51.577277+0000","last_clean":"2024-04-22T19:58:51.577277+0000","last_became_active":"2024-04-22T19:57:45.787218+0000","last_became_peered":"2024-04-22T19:57:45.787218+0000","last_unstale":"2024-04-22T19:58:51.577277+0000","last_undegraded":"2024-04-22T19:58:51.577277+0000","last_fullsized":"2024-04-22T19:58:51.577277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:51.576855+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.576855+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:11.942670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":58,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728084+0000","last_change":"2024-04-22T19:58:23.484410+0000","last_active":"2024-04-22T19:58:49.728084+0000","last_peered":"2024-04-22T19:58:49.728084+0000","last_clean":"2024-04-22T19:58:49.728084+0000","last_became_active":"2024-04-22T19:54:13.354973+0000","last_became_peered":"2024-04-22T19:54:13.354973+0000","last_unstale":"2024-04-22T19:58:49.728084+0000","last_undegraded":"2024-04-22T19:58:49.728084+0000","last_fullsized":"2024-04-22T19:58:49.728084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.484147+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.484147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:56:38.997055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"128'40","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718802+0000","last_change":"2024-04-22T19:58:27.761011+0000","last_active":"2024-04-22T19:58:49.718802+0000","last_peered":"2024-04-22T19:58:49.718802+0000","last_clean":"2024-04-22T19:58:49.718802+0000","last_became_active":"2024-04-22T19:54:15.366571+0000","last_became_peered":"2024-04-22T19:54:15.366571+0000","last_unstale":"2024-04-22T19:58:49.718802+0000","last_undegraded":"2024-04-22T19:58:49.718802+0000","last_fullsized":"2024-04-22T19:58:49.718802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:27.760632+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.760632+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:34.368637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.726829+0000","last_change":"2024-04-22T19:58:17.518261+0000","last_active":"2024-04-22T19:58:49.726829+0000","last_peered":"2024-04-22T19:58:49.726829+0000","last_clean":"2024-04-22T19:58:49.726829+0000","last_became_active":"2024-04-22T19:54:17.378279+0000","last_became_peered":"2024-04-22T19:54:17.378279+0000","last_unstale":"2024-04-22T19:58:49.726829+0000","last_undegraded":"2024-04-22T19:58:49.726829+0000","last_fullsized":"2024-04-22T19:58:49.726829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.517952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.517952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:05:07.840116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"128'12","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722850+0000","last_change":"2024-04-22T19:58:44.466554+0000","last_active":"2024-04-22T19:58:49.722850+0000","last_peered":"2024-04-22T19:58:49.722850+0000","last_clean":"2024-04-22T19:58:49.722850+0000","last_became_active":"2024-04-22T19:57:45.787776+0000","last_became_peered":"2024-04-22T19:57:45.787776+0000","last_unstale":"2024-04-22T19:58:49.722850+0000","last_undegraded":"2024-04-22T19:58:49.722850+0000","last_fullsized":"2024-04-22T19:58:49.722850+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:44.466194+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.466194+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:48.497091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"72'8","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.103567+0000","last_change":"2024-04-22T19:58:52.103567+0000","last_active":"2024-04-22T19:58:52.103567+0000","last_peered":"2024-04-22T19:58:52.103567+0000","last_clean":"2024-04-22T19:58:52.103567+0000","last_became_active":"2024-04-22T19:57:45.771320+0000","last_became_peered":"2024-04-22T19:57:45.771320+0000","last_unstale":"2024-04-22T19:58:52.103567+0000","last_undegraded":"2024-04-22T19:58:52.103567+0000","last_fullsized":"2024-04-22T19:58:52.103567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:52.103299+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.103299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:10:12.469113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779442+0000","last_change":"2024-04-22T19:58:34.745129+0000","last_active":"2024-04-22T19:58:49.779442+0000","last_peered":"2024-04-22T19:58:49.779442+0000","last_clean":"2024-04-22T19:58:49.779442+0000","last_became_active":"2024-04-22T19:57:45.764577+0000","last_became_peered":"2024-04-22T19:57:45.764577+0000","last_unstale":"2024-04-22T19:58:49.779442+0000","last_undegraded":"2024-04-22T19:58:49.779442+0000","last_fullsized":"2024-04-22T19:58:49.779442+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:34.744759+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.744759+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:57:54.166002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.728665+0000","last_change":"2024-04-22T19:58:24.533940+0000","last_active":"2024-04-22T19:58:49.728665+0000","last_peered":"2024-04-22T19:58:49.728665+0000","last_clean":"2024-04-22T19:58:49.728665+0000","last_became_active":"2024-04-22T19:54:13.357678+0000","last_became_peered":"2024-04-22T19:54:13.357678+0000","last_unstale":"2024-04-22T19:58:49.728665+0000","last_undegraded":"2024-04-22T19:58:49.728665+0000","last_fullsized":"2024-04-22T19:58:49.728665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.533684+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.533684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:14:51.774917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"128'26","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719970+0000","last_change":"2024-04-22T19:58:30.337957+0000","last_active":"2024-04-22T19:58:49.719970+0000","last_peered":"2024-04-22T19:58:49.719970+0000","last_clean":"2024-04-22T19:58:49.719970+0000","last_became_active":"2024-04-22T19:54:15.362549+0000","last_became_peered":"2024-04-22T19:54:15.362549+0000","last_unstale":"2024-04-22T19:58:49.719970+0000","last_undegraded":"2024-04-22T19:58:49.719970+0000","last_fullsized":"2024-04-22T19:58:49.719970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:30.337665+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.337665+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:35.150066+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693650+0000","last_change":"2024-04-22T19:58:49.848072+0000","last_active":"2024-04-22T19:58:50.693650+0000","last_peered":"2024-04-22T19:58:50.693650+0000","last_clean":"2024-04-22T19:58:50.693650+0000","last_became_active":"2024-04-22T19:57:45.783144+0000","last_became_peered":"2024-04-22T19:57:45.783144+0000","last_unstale":"2024-04-22T19:58:50.693650+0000","last_undegraded":"2024-04-22T19:58:50.693650+0000","last_fullsized":"2024-04-22T19:58:50.693650+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.847965+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.847965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:23.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781217+0000","last_change":"2024-04-22T19:58:20.927739+0000","last_active":"2024-04-22T19:58:49.781217+0000","last_peered":"2024-04-22T19:58:49.781217+0000","last_clean":"2024-04-22T19:58:49.781217+0000","last_became_active":"2024-04-22T19:57:45.777594+0000","last_became_peered":"2024-04-22T19:57:45.777594+0000","last_unstale":"2024-04-22T19:58:49.781217+0000","last_undegraded":"2024-04-22T19:58:49.781217+0000","last_fullsized":"2024-04-22T19:58:49.781217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.927474+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.927474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:34:00.979025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720329+0000","last_change":"2024-04-22T19:58:31.333096+0000","last_active":"2024-04-22T19:58:49.720329+0000","last_peered":"2024-04-22T19:58:49.720329+0000","last_clean":"2024-04-22T19:58:49.720329+0000","last_became_active":"2024-04-22T19:54:11.363041+0000","last_became_peered":"2024-04-22T19:54:11.363041+0000","last_unstale":"2024-04-22T19:58:49.720329+0000","last_undegraded":"2024-04-22T19:58:49.720329+0000","last_fullsized":"2024-04-22T19:58:49.720329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:31.332694+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.332694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:34.424331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"128'50","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779333+0000","last_change":"2024-04-22T19:58:32.096533+0000","last_active":"2024-04-22T19:58:49.779333+0000","last_peered":"2024-04-22T19:58:49.779333+0000","last_clean":"2024-04-22T19:58:49.779333+0000","last_became_active":"2024-04-22T19:54:09.348450+0000","last_became_peered":"2024-04-22T19:54:09.348450+0000","last_unstale":"2024-04-22T19:58:49.779333+0000","last_undegraded":"2024-04-22T19:58:49.779333+0000","last_fullsized":"2024-04-22T19:58:49.779333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'50","last_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_deep_scrub":"128'50","last_deep_scrub_stamp":"2024-04-22T19:58:32.096266+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.096266+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:47:52.649272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721241+0000","last_change":"2024-04-22T19:58:18.307596+0000","last_active":"2024-04-22T19:58:49.721241+0000","last_peered":"2024-04-22T19:58:49.721241+0000","last_clean":"2024-04-22T19:58:49.721241+0000","last_became_active":"2024-04-22T19:54:13.355889+0000","last_became_peered":"2024-04-22T19:54:13.355889+0000","last_unstale":"2024-04-22T19:58:49.721241+0000","last_undegraded":"2024-04-22T19:58:49.721241+0000","last_fullsized":"2024-04-22T19:58:49.721241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.307360+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.307360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:34.422174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"128'32","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729783+0000","last_change":"2024-04-22T19:58:32.486485+0000","last_active":"2024-04-22T19:58:49.729783+0000","last_peered":"2024-04-22T19:58:49.729783+0000","last_clean":"2024-04-22T19:58:49.729783+0000","last_became_active":"2024-04-22T19:57:45.783541+0000","last_became_peered":"2024-04-22T19:57:45.783541+0000","last_unstale":"2024-04-22T19:58:49.729783+0000","last_undegraded":"2024-04-22T19:58:49.729783+0000","last_fullsized":"2024-04-22T19:58:49.729783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:32.486175+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.486175+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:45.504059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"128'138","reported_seq":421,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687784+0000","last_change":"2024-04-22T19:58:27.517394+0000","last_active":"2024-04-22T19:58:50.687784+0000","last_peered":"2024-04-22T19:58:50.687784+0000","last_clean":"2024-04-22T19:58:50.687784+0000","last_became_active":"2024-04-22T19:54:17.379607+0000","last_became_peered":"2024-04-22T19:54:17.379607+0000","last_unstale":"2024-04-22T19:58:50.687784+0000","last_undegraded":"2024-04-22T19:58:50.687784+0000","last_fullsized":"2024-04-22T19:58:50.687784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:27.517132+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.517132+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:41:43.631946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721254+0000","last_change":"2024-04-22T19:58:38.423222+0000","last_active":"2024-04-22T19:58:49.721254+0000","last_peered":"2024-04-22T19:58:49.721254+0000","last_clean":"2024-04-22T19:58:49.721254+0000","last_became_active":"2024-04-22T19:54:19.368306+0000","last_became_peered":"2024-04-22T19:54:19.368306+0000","last_unstale":"2024-04-22T19:58:49.721254+0000","last_undegraded":"2024-04-22T19:58:49.721254+0000","last_fullsized":"2024-04-22T19:58:49.721254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.422877+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.422877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:43.235278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720538+0000","last_change":"2024-04-22T19:58:25.330594+0000","last_active":"2024-04-22T19:58:49.720538+0000","last_peered":"2024-04-22T19:58:49.720538+0000","last_clean":"2024-04-22T19:58:49.720538+0000","last_became_active":"2024-04-22T19:54:11.372196+0000","last_became_peered":"2024-04-22T19:54:11.372196+0000","last_unstale":"2024-04-22T19:58:49.720538+0000","last_undegraded":"2024-04-22T19:58:49.720538+0000","last_fullsized":"2024-04-22T19:58:49.720538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-22T19:58:25.330307+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.330307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:20.617415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"128'68","reported_seq":305,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719766+0000","last_change":"2024-04-22T19:58:39.168214+0000","last_active":"2024-04-22T19:58:49.719766+0000","last_peered":"2024-04-22T19:58:49.719766+0000","last_clean":"2024-04-22T19:58:49.719766+0000","last_became_active":"2024-04-22T19:54:09.347243+0000","last_became_peered":"2024-04-22T19:54:09.347243+0000","last_unstale":"2024-04-22T19:58:49.719766+0000","last_undegraded":"2024-04-22T19:58:49.719766+0000","last_fullsized":"2024-04-22T19:58:49.719766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:39.167952+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.167952+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.868234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"128'4","reported_seq":417,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782671+0000","last_change":"2024-04-22T19:58:26.683917+0000","last_active":"2024-04-22T19:58:49.782671+0000","last_peered":"2024-04-22T19:58:49.782671+0000","last_clean":"2024-04-22T19:58:49.782671+0000","last_became_active":"2024-04-22T19:54:13.371916+0000","last_became_peered":"2024-04-22T19:54:13.371916+0000","last_unstale":"2024-04-22T19:58:49.782671+0000","last_undegraded":"2024-04-22T19:58:49.782671+0000","last_fullsized":"2024-04-22T19:58:49.782671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:26.683650+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.683650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:10.955092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"128'16","reported_seq":69,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781463+0000","last_change":"2024-04-22T19:58:25.869942+0000","last_active":"2024-04-22T19:58:49.781463+0000","last_peered":"2024-04-22T19:58:49.781463+0000","last_clean":"2024-04-22T19:58:49.781463+0000","last_became_active":"2024-04-22T19:57:45.777422+0000","last_became_peered":"2024-04-22T19:57:45.777422+0000","last_unstale":"2024-04-22T19:58:49.781463+0000","last_undegraded":"2024-04-22T19:58:49.781463+0000","last_fullsized":"2024-04-22T19:58:49.781463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:25.869672+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.869672+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:09.682604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"128'138","reported_seq":453,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.699101+0000","last_change":"2024-04-22T19:58:35.051644+0000","last_active":"2024-04-22T19:58:50.699101+0000","last_peered":"2024-04-22T19:58:50.699101+0000","last_clean":"2024-04-22T19:58:50.699101+0000","last_became_active":"2024-04-22T19:54:17.374996+0000","last_became_peered":"2024-04-22T19:54:17.374996+0000","last_unstale":"2024-04-22T19:58:50.699101+0000","last_undegraded":"2024-04-22T19:58:50.699101+0000","last_fullsized":"2024-04-22T19:58:50.699101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:35.051246+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.051246+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:47.248809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'2","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719225+0000","last_change":"2024-04-22T19:58:18.225650+0000","last_active":"2024-04-22T19:58:49.719225+0000","last_peered":"2024-04-22T19:58:49.719225+0000","last_clean":"2024-04-22T19:58:49.719225+0000","last_became_active":"2024-04-22T19:54:19.378759+0000","last_became_peered":"2024-04-22T19:54:19.378759+0000","last_unstale":"2024-04-22T19:58:49.719225+0000","last_undegraded":"2024-04-22T19:58:49.719225+0000","last_fullsized":"2024-04-22T19:58:49.719225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:18.225380+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.225380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:48.957609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"94'2","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:20.693416+0000","last_change":"2024-04-22T19:58:33.432624+0000","last_active":"2024-04-22T19:59:20.693416+0000","last_peered":"2024-04-22T19:59:20.693416+0000","last_clean":"2024-04-22T19:59:20.693416+0000","last_became_active":"2024-04-22T19:57:45.784080+0000","last_became_peered":"2024-04-22T19:57:45.784080+0000","last_unstale":"2024-04-22T19:59:20.693416+0000","last_undegraded":"2024-04-22T19:59:20.693416+0000","last_fullsized":"2024-04-22T19:59:20.693416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:33.432306+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.432306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:45.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782277+0000","last_change":"2024-04-22T19:58:18.997599+0000","last_active":"2024-04-22T19:58:49.782277+0000","last_peered":"2024-04-22T19:58:49.782277+0000","last_clean":"2024-04-22T19:58:49.782277+0000","last_became_active":"2024-04-22T19:57:45.778136+0000","last_became_peered":"2024-04-22T19:57:45.778136+0000","last_unstale":"2024-04-22T19:58:49.782277+0000","last_undegraded":"2024-04-22T19:58:49.782277+0000","last_fullsized":"2024-04-22T19:58:49.782277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:18.997314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.997314+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:28:53.842090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720244+0000","last_change":"2024-04-22T19:58:26.325728+0000","last_active":"2024-04-22T19:58:49.720244+0000","last_peered":"2024-04-22T19:58:49.720244+0000","last_clean":"2024-04-22T19:58:49.720244+0000","last_became_active":"2024-04-22T19:54:13.361960+0000","last_became_peered":"2024-04-22T19:54:13.361960+0000","last_unstale":"2024-04-22T19:58:49.720244+0000","last_undegraded":"2024-04-22T19:58:49.720244+0000","last_fullsized":"2024-04-22T19:58:49.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.325477+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.325477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:37.087214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"128'36","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781603+0000","last_change":"2024-04-22T19:58:30.674719+0000","last_active":"2024-04-22T19:58:49.781603+0000","last_peered":"2024-04-22T19:58:49.781603+0000","last_clean":"2024-04-22T19:58:49.781603+0000","last_became_active":"2024-04-22T19:54:15.364798+0000","last_became_peered":"2024-04-22T19:54:15.364798+0000","last_unstale":"2024-04-22T19:58:49.781603+0000","last_undegraded":"2024-04-22T19:58:49.781603+0000","last_fullsized":"2024-04-22T19:58:49.781603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:30.674320+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.674320+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:33.765957+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.699066+0000","last_change":"2024-04-22T19:58:42.230927+0000","last_active":"2024-04-22T19:58:50.699066+0000","last_peered":"2024-04-22T19:58:50.699066+0000","last_clean":"2024-04-22T19:58:50.699066+0000","last_became_active":"2024-04-22T19:57:45.780161+0000","last_became_peered":"2024-04-22T19:57:45.780161+0000","last_unstale":"2024-04-22T19:58:50.699066+0000","last_undegraded":"2024-04-22T19:58:50.699066+0000","last_fullsized":"2024-04-22T19:58:50.699066+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.230558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.230558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:31.343141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720731+0000","last_change":"2024-04-22T19:58:39.395968+0000","last_active":"2024-04-22T19:58:49.720731+0000","last_peered":"2024-04-22T19:58:49.720731+0000","last_clean":"2024-04-22T19:58:49.720731+0000","last_became_active":"2024-04-22T19:54:19.389175+0000","last_became_peered":"2024-04-22T19:54:19.389175+0000","last_unstale":"2024-04-22T19:58:49.720731+0000","last_undegraded":"2024-04-22T19:58:49.720731+0000","last_fullsized":"2024-04-22T19:58:49.720731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.395713+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.395713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:15:42.487350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"110'4","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784728+0000","last_change":"2024-04-22T19:58:18.123066+0000","last_active":"2024-04-22T19:58:49.784728+0000","last_peered":"2024-04-22T19:58:49.784728+0000","last_clean":"2024-04-22T19:58:49.784728+0000","last_became_active":"2024-04-22T19:54:11.379541+0000","last_became_peered":"2024-04-22T19:54:11.379541+0000","last_unstale":"2024-04-22T19:58:49.784728+0000","last_undegraded":"2024-04-22T19:58:49.784728+0000","last_fullsized":"2024-04-22T19:58:49.784728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.122778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.122778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:46:33.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"128'119","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729545+0000","last_change":"2024-04-22T19:58:37.472988+0000","last_active":"2024-04-22T19:58:49.729545+0000","last_peered":"2024-04-22T19:58:49.729545+0000","last_clean":"2024-04-22T19:58:49.729545+0000","last_became_active":"2024-04-22T19:53:56.680956+0000","last_became_peered":"2024-04-22T19:53:56.680956+0000","last_unstale":"2024-04-22T19:58:49.729545+0000","last_undegraded":"2024-04-22T19:58:49.729545+0000","last_fullsized":"2024-04-22T19:58:49.729545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-22T19:58:37.472725+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.472725+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:04:44.080730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781475+0000","last_change":"2024-04-22T19:58:38.554586+0000","last_active":"2024-04-22T19:58:49.781475+0000","last_peered":"2024-04-22T19:58:49.781475+0000","last_clean":"2024-04-22T19:58:49.781475+0000","last_became_active":"2024-04-22T19:54:03.272827+0000","last_became_peered":"2024-04-22T19:54:03.272827+0000","last_unstale":"2024-04-22T19:58:49.781475+0000","last_undegraded":"2024-04-22T19:58:49.781475+0000","last_fullsized":"2024-04-22T19:58:49.781475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.554326+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:36:53.254607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"128'40","reported_seq":114,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.838321+0000","last_change":"2024-04-22T19:58:51.838321+0000","last_active":"2024-04-22T19:58:51.838321+0000","last_peered":"2024-04-22T19:58:51.838321+0000","last_clean":"2024-04-22T19:58:51.838321+0000","last_became_active":"2024-04-22T19:57:45.776329+0000","last_became_peered":"2024-04-22T19:57:45.776329+0000","last_unstale":"2024-04-22T19:58:51.838321+0000","last_undegraded":"2024-04-22T19:58:51.838321+0000","last_fullsized":"2024-04-22T19:58:51.838321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:51.838030+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.838030+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:34:16.599906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730855+0000","last_change":"2024-04-22T19:58:21.518764+0000","last_active":"2024-04-22T19:58:49.730855+0000","last_peered":"2024-04-22T19:58:49.730855+0000","last_clean":"2024-04-22T19:58:49.730855+0000","last_became_active":"2024-04-22T19:54:13.366995+0000","last_became_peered":"2024-04-22T19:54:13.366995+0000","last_unstale":"2024-04-22T19:58:49.730855+0000","last_undegraded":"2024-04-22T19:58:49.730855+0000","last_fullsized":"2024-04-22T19:58:49.730855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.518480+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.518480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:55:40.830419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"129'51","reported_seq":338,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783265+0000","last_change":"2024-04-22T19:58:49.630999+0000","last_active":"2024-04-22T19:58:49.783265+0000","last_peered":"2024-04-22T19:58:49.783265+0000","last_clean":"2024-04-22T19:58:49.783265+0000","last_became_active":"2024-04-22T19:57:45.785716+0000","last_became_peered":"2024-04-22T19:57:45.785716+0000","last_unstale":"2024-04-22T19:58:49.783265+0000","last_undegraded":"2024-04-22T19:58:49.783265+0000","last_fullsized":"2024-04-22T19:58:49.783265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"129'51","last_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_deep_scrub":"129'51","last_deep_scrub_stamp":"2024-04-22T19:58:49.630678+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.630678+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.236682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725143+0000","last_change":"2024-04-22T19:58:22.881306+0000","last_active":"2024-04-22T19:58:49.725143+0000","last_peered":"2024-04-22T19:58:49.725143+0000","last_clean":"2024-04-22T19:58:49.725143+0000","last_became_active":"2024-04-22T19:54:17.377773+0000","last_became_peered":"2024-04-22T19:54:17.377773+0000","last_unstale":"2024-04-22T19:58:49.725143+0000","last_undegraded":"2024-04-22T19:58:49.725143+0000","last_fullsized":"2024-04-22T19:58:49.725143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.880909+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.880909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:26:14.802541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777694+0000","last_change":"2024-04-22T19:58:41.240761+0000","last_active":"2024-04-22T19:58:49.777694+0000","last_peered":"2024-04-22T19:58:49.777694+0000","last_clean":"2024-04-22T19:58:49.777694+0000","last_became_active":"2024-04-22T19:54:19.398413+0000","last_became_peered":"2024-04-22T19:54:19.398413+0000","last_unstale":"2024-04-22T19:58:49.777694+0000","last_undegraded":"2024-04-22T19:58:49.777694+0000","last_fullsized":"2024-04-22T19:58:49.777694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.240528+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.240528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:54.913695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"102'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725613+0000","last_change":"2024-04-22T19:58:34.719771+0000","last_active":"2024-04-22T19:58:49.725613+0000","last_peered":"2024-04-22T19:58:49.725613+0000","last_clean":"2024-04-22T19:58:49.725613+0000","last_became_active":"2024-04-22T19:54:11.352602+0000","last_became_peered":"2024-04-22T19:54:11.352602+0000","last_unstale":"2024-04-22T19:58:49.725613+0000","last_undegraded":"2024-04-22T19:58:49.725613+0000","last_fullsized":"2024-04-22T19:58:49.725613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'2","last_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_deep_scrub":"102'2","last_deep_scrub_stamp":"2024-04-22T19:58:34.719505+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.719505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:00.860754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729291+0000","last_change":"2024-04-22T19:58:38.430322+0000","last_active":"2024-04-22T19:58:49.729291+0000","last_peered":"2024-04-22T19:58:49.729291+0000","last_clean":"2024-04-22T19:58:49.729291+0000","last_became_active":"2024-04-22T19:54:03.275637+0000","last_became_peered":"2024-04-22T19:54:03.275637+0000","last_unstale":"2024-04-22T19:58:49.729291+0000","last_undegraded":"2024-04-22T19:58:49.729291+0000","last_fullsized":"2024-04-22T19:58:49.729291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.429906+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.429906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:12.253772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'38","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718816+0000","last_change":"2024-04-22T19:58:38.791449+0000","last_active":"2024-04-22T19:58:49.718816+0000","last_peered":"2024-04-22T19:58:49.718816+0000","last_clean":"2024-04-22T19:58:49.718816+0000","last_became_active":"2024-04-22T19:54:09.346285+0000","last_became_peered":"2024-04-22T19:54:09.346285+0000","last_unstale":"2024-04-22T19:58:49.718816+0000","last_undegraded":"2024-04-22T19:58:49.718816+0000","last_fullsized":"2024-04-22T19:58:49.718816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:38.791289+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.791289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:08.068969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784820+0000","last_change":"2024-04-22T19:58:24.702237+0000","last_active":"2024-04-22T19:58:49.784820+0000","last_peered":"2024-04-22T19:58:49.784820+0000","last_clean":"2024-04-22T19:58:49.784820+0000","last_became_active":"2024-04-22T19:54:13.369773+0000","last_became_peered":"2024-04-22T19:54:13.369773+0000","last_unstale":"2024-04-22T19:58:49.784820+0000","last_undegraded":"2024-04-22T19:58:49.784820+0000","last_fullsized":"2024-04-22T19:58:49.784820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.701995+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.701995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:19.989103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"128'157","reported_seq":503,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721143+0000","last_change":"2024-04-22T19:58:25.357191+0000","last_active":"2024-04-22T19:58:49.721143+0000","last_peered":"2024-04-22T19:58:49.721143+0000","last_clean":"2024-04-22T19:58:49.721143+0000","last_became_active":"2024-04-22T19:54:15.370291+0000","last_became_peered":"2024-04-22T19:54:15.370291+0000","last_unstale":"2024-04-22T19:58:49.721143+0000","last_undegraded":"2024-04-22T19:58:49.721143+0000","last_fullsized":"2024-04-22T19:58:49.721143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'157","last_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_deep_scrub":"128'157","last_deep_scrub_stamp":"2024-04-22T19:58:25.356913+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.356913+0000","objects_scrubbed":10,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:30:27.152536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":205,"num_read_kb":540,"num_write":40,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730831+0000","last_change":"2024-04-22T19:58:18.447954+0000","last_active":"2024-04-22T19:58:49.730831+0000","last_peered":"2024-04-22T19:58:49.730831+0000","last_clean":"2024-04-22T19:58:49.730831+0000","last_became_active":"2024-04-22T19:54:17.382259+0000","last_became_peered":"2024-04-22T19:54:17.382259+0000","last_unstale":"2024-04-22T19:58:49.730831+0000","last_undegraded":"2024-04-22T19:58:49.730831+0000","last_fullsized":"2024-04-22T19:58:49.730831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.447634+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.447634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:16:00.061576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720365+0000","last_change":"2024-04-22T19:58:40.425876+0000","last_active":"2024-04-22T19:58:49.720365+0000","last_peered":"2024-04-22T19:58:49.720365+0000","last_clean":"2024-04-22T19:58:49.720365+0000","last_became_active":"2024-04-22T19:54:19.958699+0000","last_became_peered":"2024-04-22T19:54:19.958699+0000","last_unstale":"2024-04-22T19:58:49.720365+0000","last_undegraded":"2024-04-22T19:58:49.720365+0000","last_fullsized":"2024-04-22T19:58:49.720365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.425608+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.425608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:14.249474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"77'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723513+0000","last_change":"2024-04-22T19:58:36.431697+0000","last_active":"2024-04-22T19:58:49.723513+0000","last_peered":"2024-04-22T19:58:49.723513+0000","last_clean":"2024-04-22T19:58:49.723513+0000","last_became_active":"2024-04-22T19:54:11.356037+0000","last_became_peered":"2024-04-22T19:54:11.356037+0000","last_unstale":"2024-04-22T19:58:49.723513+0000","last_undegraded":"2024-04-22T19:58:49.723513+0000","last_fullsized":"2024-04-22T19:58:49.723513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:36.431438+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.431438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:52.242045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727710+0000","last_change":"2024-04-22T19:58:30.443698+0000","last_active":"2024-04-22T19:58:49.727710+0000","last_peered":"2024-04-22T19:58:49.727710+0000","last_clean":"2024-04-22T19:58:49.727710+0000","last_became_active":"2024-04-22T19:57:45.767252+0000","last_became_peered":"2024-04-22T19:57:45.767252+0000","last_unstale":"2024-04-22T19:58:49.727710+0000","last_undegraded":"2024-04-22T19:58:49.727710+0000","last_fullsized":"2024-04-22T19:58:49.727710+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.443442+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.443442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:03.953148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"128'44","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720445+0000","last_change":"2024-04-22T19:58:32.394461+0000","last_active":"2024-04-22T19:58:49.720445+0000","last_peered":"2024-04-22T19:58:49.720445+0000","last_clean":"2024-04-22T19:58:49.720445+0000","last_became_active":"2024-04-22T19:54:09.315959+0000","last_became_peered":"2024-04-22T19:54:09.315959+0000","last_unstale":"2024-04-22T19:58:49.720445+0000","last_undegraded":"2024-04-22T19:58:49.720445+0000","last_fullsized":"2024-04-22T19:58:49.720445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.394212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.394212+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:47.928414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"128'4","reported_seq":325,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729218+0000","last_change":"2024-04-22T19:58:18.530479+0000","last_active":"2024-04-22T19:58:49.729218+0000","last_peered":"2024-04-22T19:58:49.729218+0000","last_clean":"2024-04-22T19:58:49.729218+0000","last_became_active":"2024-04-22T19:54:13.372936+0000","last_became_peered":"2024-04-22T19:54:13.372936+0000","last_unstale":"2024-04-22T19:58:49.729218+0000","last_undegraded":"2024-04-22T19:58:49.729218+0000","last_fullsized":"2024-04-22T19:58:49.729218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'4","last_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_deep_scrub":"128'4","last_deep_scrub_stamp":"2024-04-22T19:58:18.530255+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.530255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:54:00.211123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"128'24","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.731596+0000","last_change":"2024-04-22T19:58:35.476767+0000","last_active":"2024-04-22T19:58:49.731596+0000","last_peered":"2024-04-22T19:58:49.731596+0000","last_clean":"2024-04-22T19:58:49.731596+0000","last_became_active":"2024-04-22T19:54:15.379654+0000","last_became_peered":"2024-04-22T19:54:15.379654+0000","last_unstale":"2024-04-22T19:58:49.731596+0000","last_undegraded":"2024-04-22T19:58:49.731596+0000","last_fullsized":"2024-04-22T19:58:49.731596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'24","last_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_deep_scrub":"128'24","last_deep_scrub_stamp":"2024-04-22T19:58:35.476482+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.476482+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:19.340518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723336+0000","last_change":"2024-04-22T19:58:33.758437+0000","last_active":"2024-04-22T19:58:49.723336+0000","last_peered":"2024-04-22T19:58:49.723336+0000","last_clean":"2024-04-22T19:58:49.723336+0000","last_became_active":"2024-04-22T19:54:17.366092+0000","last_became_peered":"2024-04-22T19:54:17.366092+0000","last_unstale":"2024-04-22T19:58:49.723336+0000","last_undegraded":"2024-04-22T19:58:49.723336+0000","last_fullsized":"2024-04-22T19:58:49.723336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:33.758101+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.758101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:10.786767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"72'3","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783753+0000","last_change":"2024-04-22T19:58:17.987195+0000","last_active":"2024-04-22T19:58:49.783753+0000","last_peered":"2024-04-22T19:58:49.783753+0000","last_clean":"2024-04-22T19:58:49.783753+0000","last_became_active":"2024-04-22T19:57:45.778708+0000","last_became_peered":"2024-04-22T19:57:45.778708+0000","last_unstale":"2024-04-22T19:58:49.783753+0000","last_undegraded":"2024-04-22T19:58:49.783753+0000","last_fullsized":"2024-04-22T19:58:49.783753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-22T19:58:17.987075+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.987075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:36.445136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"102'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721618+0000","last_change":"2024-04-22T19:58:22.362339+0000","last_active":"2024-04-22T19:58:49.721618+0000","last_peered":"2024-04-22T19:58:49.721618+0000","last_clean":"2024-04-22T19:58:49.721618+0000","last_became_active":"2024-04-22T19:54:11.372215+0000","last_became_peered":"2024-04-22T19:54:11.372215+0000","last_unstale":"2024-04-22T19:58:49.721618+0000","last_undegraded":"2024-04-22T19:58:49.721618+0000","last_fullsized":"2024-04-22T19:58:49.721618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:22.362021+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.362021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:29:08.734602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781547+0000","last_change":"2024-04-22T19:58:39.563909+0000","last_active":"2024-04-22T19:58:49.781547+0000","last_peered":"2024-04-22T19:58:49.781547+0000","last_clean":"2024-04-22T19:58:49.781547+0000","last_became_active":"2024-04-22T19:54:03.275678+0000","last_became_peered":"2024-04-22T19:54:03.275678+0000","last_unstale":"2024-04-22T19:58:49.781547+0000","last_undegraded":"2024-04-22T19:58:49.781547+0000","last_fullsized":"2024-04-22T19:58:49.781547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.563668+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.563668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:06.823919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719703+0000","last_change":"2024-04-22T19:58:40.167488+0000","last_active":"2024-04-22T19:58:49.719703+0000","last_peered":"2024-04-22T19:58:49.719703+0000","last_clean":"2024-04-22T19:58:49.719703+0000","last_became_active":"2024-04-22T19:54:09.348330+0000","last_became_peered":"2024-04-22T19:54:09.348330+0000","last_unstale":"2024-04-22T19:58:49.719703+0000","last_undegraded":"2024-04-22T19:58:49.719703+0000","last_fullsized":"2024-04-22T19:58:49.719703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:40.167230+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.167230+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:07.427481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724590+0000","last_change":"2024-04-22T19:58:26.788631+0000","last_active":"2024-04-22T19:58:49.724590+0000","last_peered":"2024-04-22T19:58:49.724590+0000","last_clean":"2024-04-22T19:58:49.724590+0000","last_became_active":"2024-04-22T19:54:13.353703+0000","last_became_peered":"2024-04-22T19:54:13.353703+0000","last_unstale":"2024-04-22T19:58:49.724590+0000","last_undegraded":"2024-04-22T19:58:49.724590+0000","last_fullsized":"2024-04-22T19:58:49.724590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:26.788265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.788265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:13:03.237263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"128'18","reported_seq":72,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779958+0000","last_change":"2024-04-22T19:58:23.879082+0000","last_active":"2024-04-22T19:58:49.779958+0000","last_peered":"2024-04-22T19:58:49.779958+0000","last_clean":"2024-04-22T19:58:49.779958+0000","last_became_active":"2024-04-22T19:57:45.777068+0000","last_became_peered":"2024-04-22T19:57:45.777068+0000","last_unstale":"2024-04-22T19:58:49.779958+0000","last_undegraded":"2024-04-22T19:58:49.779958+0000","last_fullsized":"2024-04-22T19:58:49.779958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'18","last_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_deep_scrub":"128'18","last_deep_scrub_stamp":"2024-04-22T19:58:23.878825+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.878825+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:45.053233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785785+0000","last_change":"2024-04-22T19:58:38.170948+0000","last_active":"2024-04-22T19:58:49.785785+0000","last_peered":"2024-04-22T19:58:49.785785+0000","last_clean":"2024-04-22T19:58:49.785785+0000","last_became_active":"2024-04-22T19:54:17.382698+0000","last_became_peered":"2024-04-22T19:54:17.382698+0000","last_unstale":"2024-04-22T19:58:49.785785+0000","last_undegraded":"2024-04-22T19:58:49.785785+0000","last_fullsized":"2024-04-22T19:58:49.785785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:38.170543+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.170543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:38.074298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778349+0000","last_change":"2024-04-22T19:58:47.576509+0000","last_active":"2024-04-22T19:58:49.778349+0000","last_peered":"2024-04-22T19:58:49.778349+0000","last_clean":"2024-04-22T19:58:49.778349+0000","last_became_active":"2024-04-22T19:57:45.781770+0000","last_became_peered":"2024-04-22T19:57:45.781770+0000","last_unstale":"2024-04-22T19:58:49.778349+0000","last_undegraded":"2024-04-22T19:58:49.778349+0000","last_fullsized":"2024-04-22T19:58:49.778349+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.576262+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.576262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:42:31.230662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720927+0000","last_change":"2024-04-22T19:58:20.294158+0000","last_active":"2024-04-22T19:58:49.720927+0000","last_peered":"2024-04-22T19:58:49.720927+0000","last_clean":"2024-04-22T19:58:49.720927+0000","last_became_active":"2024-04-22T19:54:11.377417+0000","last_became_peered":"2024-04-22T19:54:11.377417+0000","last_unstale":"2024-04-22T19:58:49.720927+0000","last_undegraded":"2024-04-22T19:58:49.720927+0000","last_fullsized":"2024-04-22T19:58:49.720927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.293893+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.293893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:16.928437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'36","reported_seq":331,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.784400+0000","last_change":"2024-04-22T19:58:48.608253+0000","last_active":"2024-04-22T19:58:49.784400+0000","last_peered":"2024-04-22T19:58:49.784400+0000","last_clean":"2024-04-22T19:58:49.784400+0000","last_became_active":"2024-04-22T19:57:45.778146+0000","last_became_peered":"2024-04-22T19:57:45.778146+0000","last_unstale":"2024-04-22T19:58:49.784400+0000","last_undegraded":"2024-04-22T19:58:49.784400+0000","last_fullsized":"2024-04-22T19:58:49.784400+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:48.608003+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.608003+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:17:05.803923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721907+0000","last_change":"2024-04-22T19:58:30.434976+0000","last_active":"2024-04-22T19:58:49.721907+0000","last_peered":"2024-04-22T19:58:49.721907+0000","last_clean":"2024-04-22T19:58:49.721907+0000","last_became_active":"2024-04-22T19:54:03.273530+0000","last_became_peered":"2024-04-22T19:54:03.273530+0000","last_unstale":"2024-04-22T19:58:49.721907+0000","last_undegraded":"2024-04-22T19:58:49.721907+0000","last_fullsized":"2024-04-22T19:58:49.721907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:30.434622+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.434622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:58:07.614663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720812+0000","last_change":"2024-04-22T19:58:24.804084+0000","last_active":"2024-04-22T19:58:49.720812+0000","last_peered":"2024-04-22T19:58:49.720812+0000","last_clean":"2024-04-22T19:58:49.720812+0000","last_became_active":"2024-04-22T19:54:13.358218+0000","last_became_peered":"2024-04-22T19:54:13.358218+0000","last_unstale":"2024-04-22T19:58:49.720812+0000","last_undegraded":"2024-04-22T19:58:49.720812+0000","last_fullsized":"2024-04-22T19:58:49.720812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.803800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.803800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:40.614408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'49","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.839511+0000","last_change":"2024-04-22T19:58:52.839511+0000","last_active":"2024-04-22T19:58:52.839511+0000","last_peered":"2024-04-22T19:58:52.839511+0000","last_clean":"2024-04-22T19:58:52.839511+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:52.839511+0000","last_undegraded":"2024-04-22T19:58:52.839511+0000","last_fullsized":"2024-04-22T19:58:52.839511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'49","last_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_deep_scrub":"130'49","last_deep_scrub_stamp":"2024-04-22T19:58:52.839216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.839216+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:11:40.560064+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718405+0000","last_change":"2024-04-22T19:58:47.121103+0000","last_active":"2024-04-22T19:58:49.718405+0000","last_peered":"2024-04-22T19:58:49.718405+0000","last_clean":"2024-04-22T19:58:49.718405+0000","last_became_active":"2024-04-22T19:57:45.769473+0000","last_became_peered":"2024-04-22T19:57:45.769473+0000","last_unstale":"2024-04-22T19:58:49.718405+0000","last_undegraded":"2024-04-22T19:58:49.718405+0000","last_fullsized":"2024-04-22T19:58:49.718405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.120733+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.120733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:10:41.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"110'10","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693598+0000","last_change":"2024-04-22T19:58:17.741271+0000","last_active":"2024-04-22T19:58:50.693598+0000","last_peered":"2024-04-22T19:58:50.693598+0000","last_clean":"2024-04-22T19:58:50.693598+0000","last_became_active":"2024-04-22T19:54:19.961345+0000","last_became_peered":"2024-04-22T19:54:19.961345+0000","last_unstale":"2024-04-22T19:58:50.693598+0000","last_undegraded":"2024-04-22T19:58:50.693598+0000","last_fullsized":"2024-04-22T19:58:50.693598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:17.740838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.740838+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:27.457058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'14","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722047+0000","last_change":"2024-04-22T19:58:28.727269+0000","last_active":"2024-04-22T19:58:49.722047+0000","last_peered":"2024-04-22T19:58:49.722047+0000","last_clean":"2024-04-22T19:58:49.722047+0000","last_became_active":"2024-04-22T19:54:11.369022+0000","last_became_peered":"2024-04-22T19:54:11.369022+0000","last_unstale":"2024-04-22T19:58:49.722047+0000","last_undegraded":"2024-04-22T19:58:49.722047+0000","last_fullsized":"2024-04-22T19:58:49.722047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-04-22T19:58:28.726953+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.726953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:02.550820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"128'52","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721678+0000","last_change":"2024-04-22T19:58:33.411941+0000","last_active":"2024-04-22T19:58:49.721678+0000","last_peered":"2024-04-22T19:58:49.721678+0000","last_clean":"2024-04-22T19:58:49.721678+0000","last_became_active":"2024-04-22T19:54:09.317028+0000","last_became_peered":"2024-04-22T19:54:09.317028+0000","last_unstale":"2024-04-22T19:58:49.721678+0000","last_undegraded":"2024-04-22T19:58:49.721678+0000","last_fullsized":"2024-04-22T19:58:49.721678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'52","last_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_deep_scrub":"128'52","last_deep_scrub_stamp":"2024-04-22T19:58:33.411530+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.411530+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:20:28.698638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732453+0000","last_change":"2024-04-22T19:58:39.429573+0000","last_active":"2024-04-22T19:58:49.732453+0000","last_peered":"2024-04-22T19:58:49.732453+0000","last_clean":"2024-04-22T19:58:49.732453+0000","last_became_active":"2024-04-22T19:54:03.275856+0000","last_became_peered":"2024-04-22T19:54:03.275856+0000","last_unstale":"2024-04-22T19:58:49.732453+0000","last_undegraded":"2024-04-22T19:58:49.732453+0000","last_fullsized":"2024-04-22T19:58:49.732453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:39.429325+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.429325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:05.581952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778655+0000","last_change":"2024-04-22T19:58:19.104338+0000","last_active":"2024-04-22T19:58:49.778655+0000","last_peered":"2024-04-22T19:58:49.778655+0000","last_clean":"2024-04-22T19:58:49.778655+0000","last_became_active":"2024-04-22T19:54:13.363829+0000","last_became_peered":"2024-04-22T19:54:13.363829+0000","last_unstale":"2024-04-22T19:58:49.778655+0000","last_undegraded":"2024-04-22T19:58:49.778655+0000","last_fullsized":"2024-04-22T19:58:49.778655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.104069+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.104069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:36:30.964621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"128'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720753+0000","last_change":"2024-04-22T19:58:21.341817+0000","last_active":"2024-04-22T19:58:49.720753+0000","last_peered":"2024-04-22T19:58:49.720753+0000","last_clean":"2024-04-22T19:58:49.720753+0000","last_became_active":"2024-04-22T19:54:15.357733+0000","last_became_peered":"2024-04-22T19:54:15.357733+0000","last_unstale":"2024-04-22T19:58:49.720753+0000","last_undegraded":"2024-04-22T19:58:49.720753+0000","last_fullsized":"2024-04-22T19:58:49.720753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'22","last_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_deep_scrub":"128'22","last_deep_scrub_stamp":"2024-04-22T19:58:21.341527+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.341527+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:24:54.851233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"128'138","reported_seq":407,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779292+0000","last_change":"2024-04-22T19:58:34.589554+0000","last_active":"2024-04-22T19:58:49.779292+0000","last_peered":"2024-04-22T19:58:49.779292+0000","last_clean":"2024-04-22T19:58:49.779292+0000","last_became_active":"2024-04-22T19:54:17.378540+0000","last_became_peered":"2024-04-22T19:54:17.378540+0000","last_unstale":"2024-04-22T19:58:49.779292+0000","last_undegraded":"2024-04-22T19:58:49.779292+0000","last_fullsized":"2024-04-22T19:58:49.779292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:34.589314+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.589314+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:23.787658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.787894+0000","last_change":"2024-04-22T19:58:40.762959+0000","last_active":"2024-04-22T19:58:49.787894+0000","last_peered":"2024-04-22T19:58:49.787894+0000","last_clean":"2024-04-22T19:58:49.787894+0000","last_became_active":"2024-04-22T19:57:45.785385+0000","last_became_peered":"2024-04-22T19:57:45.785385+0000","last_unstale":"2024-04-22T19:58:49.787894+0000","last_undegraded":"2024-04-22T19:58:49.787894+0000","last_fullsized":"2024-04-22T19:58:49.787894+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:40.762709+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.762709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:53.879187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'8","reported_seq":62,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778570+0000","last_change":"2024-04-22T19:58:33.733337+0000","last_active":"2024-04-22T19:58:49.778570+0000","last_peered":"2024-04-22T19:58:49.778570+0000","last_clean":"2024-04-22T19:58:49.778570+0000","last_became_active":"2024-04-22T19:57:45.774250+0000","last_became_peered":"2024-04-22T19:57:45.774250+0000","last_unstale":"2024-04-22T19:58:49.778570+0000","last_undegraded":"2024-04-22T19:58:49.778570+0000","last_fullsized":"2024-04-22T19:58:49.778570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-22T19:58:33.733067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.733067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:27.957653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"128'32","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.849141+0000","last_change":"2024-04-22T19:58:55.849141+0000","last_active":"2024-04-22T19:58:55.849141+0000","last_peered":"2024-04-22T19:58:55.849141+0000","last_clean":"2024-04-22T19:58:55.849141+0000","last_became_active":"2024-04-22T19:57:45.784182+0000","last_became_peered":"2024-04-22T19:57:45.784182+0000","last_unstale":"2024-04-22T19:58:55.849141+0000","last_undegraded":"2024-04-22T19:58:55.849141+0000","last_fullsized":"2024-04-22T19:58:55.849141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:55.848777+0000","last_clean_scrub_stamp":"2024-04-22T19:58:55.848777+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:27:10.791144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723854+0000","last_change":"2024-04-22T19:58:29.435801+0000","last_active":"2024-04-22T19:58:49.723854+0000","last_peered":"2024-04-22T19:58:49.723854+0000","last_clean":"2024-04-22T19:58:49.723854+0000","last_became_active":"2024-04-22T19:54:03.271293+0000","last_became_peered":"2024-04-22T19:54:03.271293+0000","last_unstale":"2024-04-22T19:58:49.723854+0000","last_undegraded":"2024-04-22T19:58:49.723854+0000","last_fullsized":"2024-04-22T19:58:49.723854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:29.435552+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.435552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:58:39.151772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718745+0000","last_change":"2024-04-22T19:58:20.261029+0000","last_active":"2024-04-22T19:58:49.718745+0000","last_peered":"2024-04-22T19:58:49.718745+0000","last_clean":"2024-04-22T19:58:49.718745+0000","last_became_active":"2024-04-22T19:57:45.766878+0000","last_became_peered":"2024-04-22T19:57:45.766878+0000","last_unstale":"2024-04-22T19:58:49.718745+0000","last_undegraded":"2024-04-22T19:58:49.718745+0000","last_fullsized":"2024-04-22T19:58:49.718745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.260752+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.260752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.735740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.121529+0000","last_change":"2024-04-22T19:58:53.121529+0000","last_active":"2024-04-22T19:58:53.121529+0000","last_peered":"2024-04-22T19:58:53.121529+0000","last_clean":"2024-04-22T19:58:53.121529+0000","last_became_active":"2024-04-22T19:57:45.775017+0000","last_became_peered":"2024-04-22T19:57:45.775017+0000","last_unstale":"2024-04-22T19:58:53.121529+0000","last_undegraded":"2024-04-22T19:58:53.121529+0000","last_fullsized":"2024-04-22T19:58:53.121529+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-22T19:58:53.121265+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.121265+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:36:27.242810+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'145","reported_seq":483,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:57.857851+0000","last_change":"2024-04-22T19:58:57.857851+0000","last_active":"2024-04-22T19:58:57.857851+0000","last_peered":"2024-04-22T19:58:57.857851+0000","last_clean":"2024-04-22T19:58:57.857851+0000","last_became_active":"2024-04-22T19:57:53.331788+0000","last_became_peered":"2024-04-22T19:57:53.331788+0000","last_unstale":"2024-04-22T19:58:57.857851+0000","last_undegraded":"2024-04-22T19:58:57.857851+0000","last_fullsized":"2024-04-22T19:58:57.857851+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'145","last_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_deep_scrub":"130'145","last_deep_scrub_stamp":"2024-04-22T19:58:57.857586+0000","last_clean_scrub_stamp":"2024-04-22T19:58:57.857586+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:08:29.653087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.693564+0000","last_change":"2024-04-22T19:58:48.883137+0000","last_active":"2024-04-22T19:58:50.693564+0000","last_peered":"2024-04-22T19:58:50.693564+0000","last_clean":"2024-04-22T19:58:50.693564+0000","last_became_active":"2024-04-22T19:57:45.777931+0000","last_became_peered":"2024-04-22T19:57:45.777931+0000","last_unstale":"2024-04-22T19:58:50.693564+0000","last_undegraded":"2024-04-22T19:58:50.693564+0000","last_fullsized":"2024-04-22T19:58:50.693564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.882882+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.882882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:58:08.304125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"110'16","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719083+0000","last_change":"2024-04-22T19:58:35.262559+0000","last_active":"2024-04-22T19:58:49.719083+0000","last_peered":"2024-04-22T19:58:49.719083+0000","last_clean":"2024-04-22T19:58:49.719083+0000","last_became_active":"2024-04-22T19:54:11.358497+0000","last_became_peered":"2024-04-22T19:54:11.358497+0000","last_unstale":"2024-04-22T19:58:49.719083+0000","last_undegraded":"2024-04-22T19:58:49.719083+0000","last_fullsized":"2024-04-22T19:58:49.719083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-04-22T19:58:35.262297+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.262297+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:24.460641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725868+0000","last_change":"2024-04-22T19:58:43.829392+0000","last_active":"2024-04-22T19:58:49.725868+0000","last_peered":"2024-04-22T19:58:49.725868+0000","last_clean":"2024-04-22T19:58:49.725868+0000","last_became_active":"2024-04-22T19:54:09.313415+0000","last_became_peered":"2024-04-22T19:54:09.313415+0000","last_unstale":"2024-04-22T19:58:49.725868+0000","last_undegraded":"2024-04-22T19:58:49.725868+0000","last_fullsized":"2024-04-22T19:58:49.725868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:43.829140+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.829140+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:38.536122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786647+0000","last_change":"2024-04-22T19:58:27.069425+0000","last_active":"2024-04-22T19:58:49.786647+0000","last_peered":"2024-04-22T19:58:49.786647+0000","last_clean":"2024-04-22T19:58:49.786647+0000","last_became_active":"2024-04-22T19:54:03.271616+0000","last_became_peered":"2024-04-22T19:54:03.271616+0000","last_unstale":"2024-04-22T19:58:49.786647+0000","last_undegraded":"2024-04-22T19:58:49.786647+0000","last_fullsized":"2024-04-22T19:58:49.786647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.069189+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.069189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:48.778486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778218+0000","last_change":"2024-04-22T19:58:48.781188+0000","last_active":"2024-04-22T19:58:49.778218+0000","last_peered":"2024-04-22T19:58:49.778218+0000","last_clean":"2024-04-22T19:58:49.778218+0000","last_became_active":"2024-04-22T19:57:45.773922+0000","last_became_peered":"2024-04-22T19:57:45.773922+0000","last_unstale":"2024-04-22T19:58:49.778218+0000","last_undegraded":"2024-04-22T19:58:49.778218+0000","last_fullsized":"2024-04-22T19:58:49.778218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.780827+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.780827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:40:10.109946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"128'60","reported_seq":312,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730066+0000","last_change":"2024-04-22T19:58:31.378737+0000","last_active":"2024-04-22T19:58:49.730066+0000","last_peered":"2024-04-22T19:58:49.730066+0000","last_clean":"2024-04-22T19:58:49.730066+0000","last_became_active":"2024-04-22T19:54:15.378663+0000","last_became_peered":"2024-04-22T19:54:15.378663+0000","last_unstale":"2024-04-22T19:58:49.730066+0000","last_undegraded":"2024-04-22T19:58:49.730066+0000","last_fullsized":"2024-04-22T19:58:49.730066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'60","last_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_deep_scrub":"128'60","last_deep_scrub_stamp":"2024-04-22T19:58:31.378434+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.378434+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:20.491017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779593+0000","last_change":"2024-04-22T19:58:46.759279+0000","last_active":"2024-04-22T19:58:49.779593+0000","last_peered":"2024-04-22T19:58:49.779593+0000","last_clean":"2024-04-22T19:58:49.779593+0000","last_became_active":"2024-04-22T19:57:45.770295+0000","last_became_peered":"2024-04-22T19:57:45.770295+0000","last_unstale":"2024-04-22T19:58:49.779593+0000","last_undegraded":"2024-04-22T19:58:49.779593+0000","last_fullsized":"2024-04-22T19:58:49.779593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.759006+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.759006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:41:44.556912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728275+0000","last_change":"2024-04-22T19:58:18.596119+0000","last_active":"2024-04-22T19:58:50.728275+0000","last_peered":"2024-04-22T19:58:50.728275+0000","last_clean":"2024-04-22T19:58:50.728275+0000","last_became_active":"2024-04-22T19:54:19.395742+0000","last_became_peered":"2024-04-22T19:54:19.395742+0000","last_unstale":"2024-04-22T19:58:50.728275+0000","last_undegraded":"2024-04-22T19:58:50.728275+0000","last_fullsized":"2024-04-22T19:58:50.728275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:18.595870+0000","last_clean_scrub_stamp":"2024-04-22T19:58:18.595870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:55.388396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"94'5","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724733+0000","last_change":"2024-04-22T19:58:15.768820+0000","last_active":"2024-04-22T19:58:49.724733+0000","last_peered":"2024-04-22T19:58:49.724733+0000","last_clean":"2024-04-22T19:58:49.724733+0000","last_became_active":"2024-04-22T19:54:19.394536+0000","last_became_peered":"2024-04-22T19:54:19.394536+0000","last_unstale":"2024-04-22T19:58:49.724733+0000","last_undegraded":"2024-04-22T19:58:49.724733+0000","last_fullsized":"2024-04-22T19:58:49.724733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'5","last_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_deep_scrub":"94'5","last_deep_scrub_stamp":"2024-04-22T19:58:15.768683+0000","last_clean_scrub_stamp":"2024-04-22T19:58:15.768683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:15.672438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"110'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704025+0000","last_change":"2024-04-22T19:58:27.362422+0000","last_active":"2024-04-22T19:58:50.704025+0000","last_peered":"2024-04-22T19:58:50.704025+0000","last_clean":"2024-04-22T19:58:50.704025+0000","last_became_active":"2024-04-22T19:54:11.367645+0000","last_became_peered":"2024-04-22T19:54:11.367645+0000","last_unstale":"2024-04-22T19:58:50.704025+0000","last_undegraded":"2024-04-22T19:58:50.704025+0000","last_fullsized":"2024-04-22T19:58:50.704025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.362163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.362163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:11.633606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704077+0000","last_change":"2024-04-22T19:58:42.168090+0000","last_active":"2024-04-22T19:58:50.704077+0000","last_peered":"2024-04-22T19:58:50.704077+0000","last_clean":"2024-04-22T19:58:50.704077+0000","last_became_active":"2024-04-22T19:54:09.353400+0000","last_became_peered":"2024-04-22T19:54:09.353400+0000","last_unstale":"2024-04-22T19:58:50.704077+0000","last_undegraded":"2024-04-22T19:58:50.704077+0000","last_fullsized":"2024-04-22T19:58:50.704077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:42.167705+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.167705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:04:42.116621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.688798+0000","last_change":"2024-04-22T19:58:19.329416+0000","last_active":"2024-04-22T19:58:55.688798+0000","last_peered":"2024-04-22T19:58:55.688798+0000","last_clean":"2024-04-22T19:58:55.688798+0000","last_became_active":"2024-04-22T19:54:13.375764+0000","last_became_peered":"2024-04-22T19:54:13.375764+0000","last_unstale":"2024-04-22T19:58:55.688798+0000","last_undegraded":"2024-04-22T19:58:55.688798+0000","last_fullsized":"2024-04-22T19:58:55.688798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.329086+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:12.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778734+0000","last_change":"2024-04-22T19:58:27.786037+0000","last_active":"2024-04-22T19:58:49.778734+0000","last_peered":"2024-04-22T19:58:49.778734+0000","last_clean":"2024-04-22T19:58:49.778734+0000","last_became_active":"2024-04-22T19:57:45.771343+0000","last_became_peered":"2024-04-22T19:57:45.771343+0000","last_unstale":"2024-04-22T19:58:49.778734+0000","last_undegraded":"2024-04-22T19:58:49.778734+0000","last_fullsized":"2024-04-22T19:58:49.778734+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:27.785753+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.785753+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:08.483838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781767+0000","last_change":"2024-04-22T19:58:47.793348+0000","last_active":"2024-04-22T19:58:49.781767+0000","last_peered":"2024-04-22T19:58:49.781767+0000","last_clean":"2024-04-22T19:58:49.781767+0000","last_became_active":"2024-04-22T19:57:45.766623+0000","last_became_peered":"2024-04-22T19:57:45.766623+0000","last_unstale":"2024-04-22T19:58:49.781767+0000","last_undegraded":"2024-04-22T19:58:49.781767+0000","last_fullsized":"2024-04-22T19:58:49.781767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.792946+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.792946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:48.756251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"128'8","reported_seq":61,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779540+0000","last_change":"2024-04-22T19:58:29.776061+0000","last_active":"2024-04-22T19:58:49.779540+0000","last_peered":"2024-04-22T19:58:49.779540+0000","last_clean":"2024-04-22T19:58:49.779540+0000","last_became_active":"2024-04-22T19:57:45.772256+0000","last_became_peered":"2024-04-22T19:57:45.772256+0000","last_unstale":"2024-04-22T19:58:49.779540+0000","last_undegraded":"2024-04-22T19:58:49.779540+0000","last_fullsized":"2024-04-22T19:58:49.779540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'8","last_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_deep_scrub":"128'8","last_deep_scrub_stamp":"2024-04-22T19:58:29.775802+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.775802+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:09:24.482784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687755+0000","last_change":"2024-04-22T19:58:35.391017+0000","last_active":"2024-04-22T19:58:50.687755+0000","last_peered":"2024-04-22T19:58:50.687755+0000","last_clean":"2024-04-22T19:58:50.687755+0000","last_became_active":"2024-04-22T19:54:11.352358+0000","last_became_peered":"2024-04-22T19:54:11.352358+0000","last_unstale":"2024-04-22T19:58:50.687755+0000","last_undegraded":"2024-04-22T19:58:50.687755+0000","last_fullsized":"2024-04-22T19:58:50.687755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:35.390742+0000","last_clean_scrub_stamp":"2024-04-22T19:58:35.390742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:19.662185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"128'58","reported_seq":379,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706941+0000","last_change":"2024-04-22T19:58:50.386788+0000","last_active":"2024-04-22T19:59:00.706941+0000","last_peered":"2024-04-22T19:59:00.706941+0000","last_clean":"2024-04-22T19:59:00.706941+0000","last_became_active":"2024-04-22T19:57:45.788068+0000","last_became_peered":"2024-04-22T19:57:45.788068+0000","last_unstale":"2024-04-22T19:59:00.706941+0000","last_undegraded":"2024-04-22T19:59:00.706941+0000","last_fullsized":"2024-04-22T19:59:00.706941+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'58","last_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_deep_scrub":"128'58","last_deep_scrub_stamp":"2024-04-22T19:58:50.386558+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.386558+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:29.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.821961+0000","last_change":"2024-04-22T19:58:49.821961+0000","last_active":"2024-04-22T19:58:49.821961+0000","last_peered":"2024-04-22T19:58:49.821961+0000","last_clean":"2024-04-22T19:58:49.821961+0000","last_became_active":"2024-04-22T19:57:45.774901+0000","last_became_peered":"2024-04-22T19:57:45.774901+0000","last_unstale":"2024-04-22T19:58:49.821961+0000","last_undegraded":"2024-04-22T19:58:49.821961+0000","last_fullsized":"2024-04-22T19:58:49.821961+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:49.821791+0000","last_clean_scrub_stamp":"2024-04-22T19:58:49.821791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:06:08.419670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"128'12","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.694413+0000","last_change":"2024-04-22T19:58:31.722300+0000","last_active":"2024-04-22T19:58:55.694413+0000","last_peered":"2024-04-22T19:58:55.694413+0000","last_clean":"2024-04-22T19:58:55.694413+0000","last_became_active":"2024-04-22T19:54:15.365442+0000","last_became_peered":"2024-04-22T19:54:15.365442+0000","last_unstale":"2024-04-22T19:58:55.694413+0000","last_undegraded":"2024-04-22T19:58:55.694413+0000","last_fullsized":"2024-04-22T19:58:55.694413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'12","last_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_deep_scrub":"128'12","last_deep_scrub_stamp":"2024-04-22T19:58:31.722041+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.722041+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:29:06.566817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706836+0000","last_change":"2024-04-22T19:58:45.425840+0000","last_active":"2024-04-22T19:59:00.706836+0000","last_peered":"2024-04-22T19:59:00.706836+0000","last_clean":"2024-04-22T19:59:00.706836+0000","last_became_active":"2024-04-22T19:54:17.376559+0000","last_became_peered":"2024-04-22T19:54:17.376559+0000","last_unstale":"2024-04-22T19:59:00.706836+0000","last_undegraded":"2024-04-22T19:59:00.706836+0000","last_fullsized":"2024-04-22T19:59:00.706836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.425597+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.425597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:00.125879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.724308+0000","last_change":"2024-04-22T19:58:19.809358+0000","last_active":"2024-04-22T19:58:49.724308+0000","last_peered":"2024-04-22T19:58:49.724308+0000","last_clean":"2024-04-22T19:58:49.724308+0000","last_became_active":"2024-04-22T19:54:19.376643+0000","last_became_peered":"2024-04-22T19:54:19.376643+0000","last_unstale":"2024-04-22T19:58:49.724308+0000","last_undegraded":"2024-04-22T19:58:49.724308+0000","last_fullsized":"2024-04-22T19:58:49.724308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.808992+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.808992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:02:33.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"110'10","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780035+0000","last_change":"2024-04-22T19:58:26.826840+0000","last_active":"2024-04-22T19:58:49.780035+0000","last_peered":"2024-04-22T19:58:49.780035+0000","last_clean":"2024-04-22T19:58:49.780035+0000","last_became_active":"2024-04-22T19:57:45.776948+0000","last_became_peered":"2024-04-22T19:57:45.776948+0000","last_unstale":"2024-04-22T19:58:49.780035+0000","last_undegraded":"2024-04-22T19:58:49.780035+0000","last_fullsized":"2024-04-22T19:58:49.780035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-04-22T19:58:26.826575+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.826575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:06.020809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"128'42","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.730186+0000","last_change":"2024-04-22T19:58:44.569409+0000","last_active":"2024-04-22T19:59:00.730186+0000","last_peered":"2024-04-22T19:59:00.730186+0000","last_clean":"2024-04-22T19:59:00.730186+0000","last_became_active":"2024-04-22T19:54:09.350666+0000","last_became_peered":"2024-04-22T19:54:09.350666+0000","last_unstale":"2024-04-22T19:59:00.730186+0000","last_undegraded":"2024-04-22T19:59:00.730186+0000","last_fullsized":"2024-04-22T19:59:00.730186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:44.569139+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.569139+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.123495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.705730+0000","last_change":"2024-04-22T19:58:24.467318+0000","last_active":"2024-04-22T19:58:55.705730+0000","last_peered":"2024-04-22T19:58:55.705730+0000","last_clean":"2024-04-22T19:58:55.705730+0000","last_became_active":"2024-04-22T19:54:13.364874+0000","last_became_peered":"2024-04-22T19:54:13.364874+0000","last_unstale":"2024-04-22T19:58:55.705730+0000","last_undegraded":"2024-04-22T19:58:55.705730+0000","last_fullsized":"2024-04-22T19:58:55.705730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:24.467056+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.467056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:19:43.694677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"128'26","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780166+0000","last_change":"2024-04-22T19:58:39.767731+0000","last_active":"2024-04-22T19:58:49.780166+0000","last_peered":"2024-04-22T19:58:49.780166+0000","last_clean":"2024-04-22T19:58:49.780166+0000","last_became_active":"2024-04-22T19:57:45.776025+0000","last_became_peered":"2024-04-22T19:57:45.776025+0000","last_unstale":"2024-04-22T19:58:49.780166+0000","last_undegraded":"2024-04-22T19:58:49.780166+0000","last_fullsized":"2024-04-22T19:58:49.780166+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'26","last_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_deep_scrub":"128'26","last_deep_scrub_stamp":"2024-04-22T19:58:39.767456+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.767456+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:20:41.789158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700849+0000","last_change":"2024-04-22T19:58:25.133898+0000","last_active":"2024-04-22T19:59:00.700849+0000","last_peered":"2024-04-22T19:59:00.700849+0000","last_clean":"2024-04-22T19:59:00.700849+0000","last_became_active":"2024-04-22T19:54:17.373108+0000","last_became_peered":"2024-04-22T19:54:17.373108+0000","last_unstale":"2024-04-22T19:59:00.700849+0000","last_undegraded":"2024-04-22T19:59:00.700849+0000","last_fullsized":"2024-04-22T19:59:00.700849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:25.133646+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.133646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:54.305171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781769+0000","last_change":"2024-04-22T19:58:21.685253+0000","last_active":"2024-04-22T19:58:49.781769+0000","last_peered":"2024-04-22T19:58:49.781769+0000","last_clean":"2024-04-22T19:58:49.781769+0000","last_became_active":"2024-04-22T19:54:19.391865+0000","last_became_peered":"2024-04-22T19:54:19.391865+0000","last_unstale":"2024-04-22T19:58:49.781769+0000","last_undegraded":"2024-04-22T19:58:49.781769+0000","last_fullsized":"2024-04-22T19:58:49.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.684845+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.684845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:57:58.864886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.871339+0000","last_change":"2024-04-22T19:58:50.871339+0000","last_active":"2024-04-22T19:58:50.871339+0000","last_peered":"2024-04-22T19:58:50.871339+0000","last_clean":"2024-04-22T19:58:50.871339+0000","last_became_active":"2024-04-22T19:57:45.776427+0000","last_became_peered":"2024-04-22T19:57:45.776427+0000","last_unstale":"2024-04-22T19:58:50.871339+0000","last_undegraded":"2024-04-22T19:58:50.871339+0000","last_fullsized":"2024-04-22T19:58:50.871339+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:50.871096+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.871096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:21:27.912144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"128'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.695459+0000","last_change":"2024-04-22T19:58:40.841946+0000","last_active":"2024-04-22T19:59:00.695459+0000","last_peered":"2024-04-22T19:59:00.695459+0000","last_clean":"2024-04-22T19:59:00.695459+0000","last_became_active":"2024-04-22T19:54:09.310488+0000","last_became_peered":"2024-04-22T19:54:09.310488+0000","last_unstale":"2024-04-22T19:59:00.695459+0000","last_undegraded":"2024-04-22T19:59:00.695459+0000","last_fullsized":"2024-04-22T19:59:00.695459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:40.841699+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.841699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:20.035934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.699925+0000","last_change":"2024-04-22T19:58:23.068978+0000","last_active":"2024-04-22T19:58:55.699925+0000","last_peered":"2024-04-22T19:58:55.699925+0000","last_clean":"2024-04-22T19:58:55.699925+0000","last_became_active":"2024-04-22T19:54:13.368523+0000","last_became_peered":"2024-04-22T19:54:13.368523+0000","last_unstale":"2024-04-22T19:58:55.699925+0000","last_undegraded":"2024-04-22T19:58:55.699925+0000","last_fullsized":"2024-04-22T19:58:55.699925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.068731+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.068731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:53:14.242923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"128'23","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:55.705839+0000","last_change":"2024-04-22T19:58:25.437001+0000","last_active":"2024-04-22T19:58:55.705839+0000","last_peered":"2024-04-22T19:58:55.705839+0000","last_clean":"2024-04-22T19:58:55.705839+0000","last_became_active":"2024-04-22T19:54:15.370219+0000","last_became_peered":"2024-04-22T19:54:15.370219+0000","last_unstale":"2024-04-22T19:58:55.705839+0000","last_undegraded":"2024-04-22T19:58:55.705839+0000","last_fullsized":"2024-04-22T19:58:55.705839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.436707+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.436707+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.168937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.695296+0000","last_change":"2024-04-22T19:58:20.810337+0000","last_active":"2024-04-22T19:59:00.695296+0000","last_peered":"2024-04-22T19:59:00.695296+0000","last_clean":"2024-04-22T19:59:00.695296+0000","last_became_active":"2024-04-22T19:54:17.380190+0000","last_became_peered":"2024-04-22T19:54:17.380190+0000","last_unstale":"2024-04-22T19:59:00.695296+0000","last_undegraded":"2024-04-22T19:59:00.695296+0000","last_fullsized":"2024-04-22T19:59:00.695296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:20.809993+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.809993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:18:09.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786228+0000","last_change":"2024-04-22T19:58:26.097064+0000","last_active":"2024-04-22T19:58:49.786228+0000","last_peered":"2024-04-22T19:58:49.786228+0000","last_clean":"2024-04-22T19:58:49.786228+0000","last_became_active":"2024-04-22T19:54:11.360967+0000","last_became_peered":"2024-04-22T19:54:11.360967+0000","last_unstale":"2024-04-22T19:58:49.786228+0000","last_undegraded":"2024-04-22T19:58:49.786228+0000","last_fullsized":"2024-04-22T19:58:49.786228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.096800+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.096800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:21:41.663789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"128'46","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778906+0000","last_change":"2024-04-22T19:58:31.734250+0000","last_active":"2024-04-22T19:58:49.778906+0000","last_peered":"2024-04-22T19:58:49.778906+0000","last_clean":"2024-04-22T19:58:49.778906+0000","last_became_active":"2024-04-22T19:57:45.772443+0000","last_became_peered":"2024-04-22T19:57:45.772443+0000","last_unstale":"2024-04-22T19:58:49.778906+0000","last_undegraded":"2024-04-22T19:58:49.778906+0000","last_fullsized":"2024-04-22T19:58:49.778906+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:31.733987+0000","last_clean_scrub_stamp":"2024-04-22T19:58:31.733987+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:23:55.058953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725206+0000","last_change":"2024-04-22T19:58:23.839178+0000","last_active":"2024-04-22T19:58:49.725206+0000","last_peered":"2024-04-22T19:58:49.725206+0000","last_clean":"2024-04-22T19:58:49.725206+0000","last_became_active":"2024-04-22T19:54:13.356925+0000","last_became_peered":"2024-04-22T19:54:13.356925+0000","last_unstale":"2024-04-22T19:58:49.725206+0000","last_undegraded":"2024-04-22T19:58:49.725206+0000","last_fullsized":"2024-04-22T19:58:49.725206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.838919+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.838919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:33:08.110361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"128'39","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721745+0000","last_change":"2024-04-22T19:58:23.377441+0000","last_active":"2024-04-22T19:58:49.721745+0000","last_peered":"2024-04-22T19:58:49.721745+0000","last_clean":"2024-04-22T19:58:49.721745+0000","last_became_active":"2024-04-22T19:54:15.363735+0000","last_became_peered":"2024-04-22T19:54:15.363735+0000","last_unstale":"2024-04-22T19:58:49.721745+0000","last_undegraded":"2024-04-22T19:58:49.721745+0000","last_fullsized":"2024-04-22T19:58:49.721745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'39","last_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_deep_scrub":"128'39","last_deep_scrub_stamp":"2024-04-22T19:58:23.377172+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.377172+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:36.395055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779200+0000","last_change":"2024-04-22T19:58:17.626427+0000","last_active":"2024-04-22T19:58:49.779200+0000","last_peered":"2024-04-22T19:58:49.779200+0000","last_clean":"2024-04-22T19:58:49.779200+0000","last_became_active":"2024-04-22T19:57:45.776859+0000","last_became_peered":"2024-04-22T19:57:45.776859+0000","last_unstale":"2024-04-22T19:58:49.779200+0000","last_undegraded":"2024-04-22T19:58:49.779200+0000","last_fullsized":"2024-04-22T19:58:49.779200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:17.626182+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.626182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:30.537304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781415+0000","last_change":"2024-04-22T19:58:42.757654+0000","last_active":"2024-04-22T19:58:49.781415+0000","last_peered":"2024-04-22T19:58:49.781415+0000","last_clean":"2024-04-22T19:58:49.781415+0000","last_became_active":"2024-04-22T19:57:45.777175+0000","last_became_peered":"2024-04-22T19:57:45.777175+0000","last_unstale":"2024-04-22T19:58:49.781415+0000","last_undegraded":"2024-04-22T19:58:49.781415+0000","last_fullsized":"2024-04-22T19:58:49.781415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:42.757403+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.757403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:30:52.412108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725477+0000","last_change":"2024-04-22T19:58:30.734974+0000","last_active":"2024-04-22T19:58:49.725477+0000","last_peered":"2024-04-22T19:58:49.725477+0000","last_clean":"2024-04-22T19:58:49.725477+0000","last_became_active":"2024-04-22T19:54:11.363333+0000","last_became_peered":"2024-04-22T19:54:11.363333+0000","last_unstale":"2024-04-22T19:58:49.725477+0000","last_undegraded":"2024-04-22T19:58:49.725477+0000","last_fullsized":"2024-04-22T19:58:49.725477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.734692+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.734692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:55:49.192753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"128'42","reported_seq":342,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.689717+0000","last_change":"2024-04-22T19:58:43.446056+0000","last_active":"2024-04-22T19:59:00.689717+0000","last_peered":"2024-04-22T19:59:00.689717+0000","last_clean":"2024-04-22T19:59:00.689717+0000","last_became_active":"2024-04-22T19:57:45.785250+0000","last_became_peered":"2024-04-22T19:57:45.785250+0000","last_unstale":"2024-04-22T19:59:00.689717+0000","last_undegraded":"2024-04-22T19:59:00.689717+0000","last_fullsized":"2024-04-22T19:59:00.689717+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:43.445779+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.445779+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:30:32.644123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785788+0000","last_change":"2024-04-22T19:58:21.025798+0000","last_active":"2024-04-22T19:58:49.785788+0000","last_peered":"2024-04-22T19:58:49.785788+0000","last_clean":"2024-04-22T19:58:49.785788+0000","last_became_active":"2024-04-22T19:54:13.363791+0000","last_became_peered":"2024-04-22T19:54:13.363791+0000","last_unstale":"2024-04-22T19:58:49.785788+0000","last_undegraded":"2024-04-22T19:58:49.785788+0000","last_fullsized":"2024-04-22T19:58:49.785788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:21.025544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.025544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:14.731508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"128'32","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.730394+0000","last_change":"2024-04-22T19:58:29.365201+0000","last_active":"2024-04-22T19:58:49.730394+0000","last_peered":"2024-04-22T19:58:49.730394+0000","last_clean":"2024-04-22T19:58:49.730394+0000","last_became_active":"2024-04-22T19:54:15.370065+0000","last_became_peered":"2024-04-22T19:54:15.370065+0000","last_unstale":"2024-04-22T19:58:49.730394+0000","last_undegraded":"2024-04-22T19:58:49.730394+0000","last_fullsized":"2024-04-22T19:58:49.730394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:29.364812+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.364812+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:32:44.801114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722325+0000","last_change":"2024-04-22T19:58:27.371739+0000","last_active":"2024-04-22T19:58:49.722325+0000","last_peered":"2024-04-22T19:58:49.722325+0000","last_clean":"2024-04-22T19:58:49.722325+0000","last_became_active":"2024-04-22T19:54:17.373237+0000","last_became_peered":"2024-04-22T19:54:17.373237+0000","last_unstale":"2024-04-22T19:58:49.722325+0000","last_undegraded":"2024-04-22T19:58:49.722325+0000","last_fullsized":"2024-04-22T19:58:49.722325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:27.371472+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.371472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:27:04.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"102'4","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.700807+0000","last_change":"2024-04-22T19:58:39.203265+0000","last_active":"2024-04-22T19:59:00.700807+0000","last_peered":"2024-04-22T19:59:00.700807+0000","last_clean":"2024-04-22T19:59:00.700807+0000","last_became_active":"2024-04-22T19:54:19.379256+0000","last_became_peered":"2024-04-22T19:54:19.379256+0000","last_unstale":"2024-04-22T19:59:00.700807+0000","last_undegraded":"2024-04-22T19:59:00.700807+0000","last_fullsized":"2024-04-22T19:59:00.700807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:39.203002+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.203002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:09:54.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779914+0000","last_change":"2024-04-22T19:58:30.768350+0000","last_active":"2024-04-22T19:58:49.779914+0000","last_peered":"2024-04-22T19:58:49.779914+0000","last_clean":"2024-04-22T19:58:49.779914+0000","last_became_active":"2024-04-22T19:57:45.770495+0000","last_became_peered":"2024-04-22T19:57:45.770495+0000","last_unstale":"2024-04-22T19:58:49.779914+0000","last_undegraded":"2024-04-22T19:58:49.779914+0000","last_fullsized":"2024-04-22T19:58:49.779914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:30.768078+0000","last_clean_scrub_stamp":"2024-04-22T19:58:30.768078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"128'40","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708342+0000","last_change":"2024-04-22T19:58:38.217745+0000","last_active":"2024-04-22T19:59:10.708342+0000","last_peered":"2024-04-22T19:59:10.708342+0000","last_clean":"2024-04-22T19:59:10.708342+0000","last_became_active":"2024-04-22T19:54:09.340237+0000","last_became_peered":"2024-04-22T19:54:09.340237+0000","last_unstale":"2024-04-22T19:59:10.708342+0000","last_undegraded":"2024-04-22T19:59:10.708342+0000","last_fullsized":"2024-04-22T19:59:10.708342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'40","last_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_deep_scrub":"128'40","last_deep_scrub_stamp":"2024-04-22T19:58:38.217319+0000","last_clean_scrub_stamp":"2024-04-22T19:58:38.217319+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:05:04.358568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721540+0000","last_change":"2024-04-22T19:58:48.108181+0000","last_active":"2024-04-22T19:58:49.721540+0000","last_peered":"2024-04-22T19:58:49.721540+0000","last_clean":"2024-04-22T19:58:49.721540+0000","last_became_active":"2024-04-22T19:57:45.772370+0000","last_became_peered":"2024-04-22T19:57:45.772370+0000","last_unstale":"2024-04-22T19:58:49.721540+0000","last_undegraded":"2024-04-22T19:58:49.721540+0000","last_fullsized":"2024-04-22T19:58:49.721540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.107938+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.107938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:07:01.272981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":76,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:56.850505+0000","last_change":"2024-04-22T19:58:56.850505+0000","last_active":"2024-04-22T19:58:56.850505+0000","last_peered":"2024-04-22T19:58:56.850505+0000","last_clean":"2024-04-22T19:58:56.850505+0000","last_became_active":"2024-04-22T19:57:45.785740+0000","last_became_peered":"2024-04-22T19:57:45.785740+0000","last_unstale":"2024-04-22T19:58:56.850505+0000","last_undegraded":"2024-04-22T19:58:56.850505+0000","last_fullsized":"2024-04-22T19:58:56.850505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-22T19:58:56.850198+0000","last_clean_scrub_stamp":"2024-04-22T19:58:56.850198+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:06:22.846760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722495+0000","last_change":"2024-04-22T19:58:41.409524+0000","last_active":"2024-04-22T19:58:49.722495+0000","last_peered":"2024-04-22T19:58:49.722495+0000","last_clean":"2024-04-22T19:58:49.722495+0000","last_became_active":"2024-04-22T19:57:45.767824+0000","last_became_peered":"2024-04-22T19:57:45.767824+0000","last_unstale":"2024-04-22T19:58:49.722495+0000","last_undegraded":"2024-04-22T19:58:49.722495+0000","last_fullsized":"2024-04-22T19:58:49.722495+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:41.409279+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.409279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:07.561905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.730037+0000","last_change":"2024-04-22T19:58:19.642149+0000","last_active":"2024-04-22T19:59:00.730037+0000","last_peered":"2024-04-22T19:59:00.730037+0000","last_clean":"2024-04-22T19:59:00.730037+0000","last_became_active":"2024-04-22T19:54:19.392500+0000","last_became_peered":"2024-04-22T19:54:19.392500+0000","last_unstale":"2024-04-22T19:59:00.730037+0000","last_undegraded":"2024-04-22T19:59:00.730037+0000","last_fullsized":"2024-04-22T19:59:00.730037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:19.641890+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.641890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:02.116877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"71'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.691566+0000","last_change":"2024-04-22T19:58:22.477673+0000","last_active":"2024-04-22T19:59:10.691566+0000","last_peered":"2024-04-22T19:59:10.691566+0000","last_clean":"2024-04-22T19:59:10.691566+0000","last_became_active":"2024-04-22T19:54:11.373280+0000","last_became_peered":"2024-04-22T19:54:11.373280+0000","last_unstale":"2024-04-22T19:59:10.691566+0000","last_undegraded":"2024-04-22T19:59:10.691566+0000","last_fullsized":"2024-04-22T19:59:10.691566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.477408+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.477408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:30:51.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"128'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.697207+0000","last_change":"2024-04-22T19:58:46.909414+0000","last_active":"2024-04-22T19:59:10.697207+0000","last_peered":"2024-04-22T19:59:10.697207+0000","last_clean":"2024-04-22T19:59:10.697207+0000","last_became_active":"2024-04-22T19:54:09.346265+0000","last_became_peered":"2024-04-22T19:54:09.346265+0000","last_unstale":"2024-04-22T19:59:10.697207+0000","last_undegraded":"2024-04-22T19:59:10.697207+0000","last_fullsized":"2024-04-22T19:59:10.697207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:46.909163+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.909163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:56.941948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722573+0000","last_change":"2024-04-22T19:58:16.251307+0000","last_active":"2024-04-22T19:58:49.722573+0000","last_peered":"2024-04-22T19:58:49.722573+0000","last_clean":"2024-04-22T19:58:49.722573+0000","last_became_active":"2024-04-22T19:54:13.356151+0000","last_became_peered":"2024-04-22T19:54:13.356151+0000","last_unstale":"2024-04-22T19:58:49.722573+0000","last_undegraded":"2024-04-22T19:58:49.722573+0000","last_fullsized":"2024-04-22T19:58:49.722573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:16.251206+0000","last_clean_scrub_stamp":"2024-04-22T19:58:16.251206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:46:37.960504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"128'16","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720078+0000","last_change":"2024-04-22T19:58:36.221480+0000","last_active":"2024-04-22T19:58:49.720078+0000","last_peered":"2024-04-22T19:58:49.720078+0000","last_clean":"2024-04-22T19:58:49.720078+0000","last_became_active":"2024-04-22T19:54:15.376588+0000","last_became_peered":"2024-04-22T19:54:15.376588+0000","last_unstale":"2024-04-22T19:58:49.720078+0000","last_undegraded":"2024-04-22T19:58:49.720078+0000","last_fullsized":"2024-04-22T19:58:49.720078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'16","last_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_deep_scrub":"128'16","last_deep_scrub_stamp":"2024-04-22T19:58:36.221216+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.221216+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:08:40.252113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"128'138","reported_seq":435,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785100+0000","last_change":"2024-04-22T19:58:36.096797+0000","last_active":"2024-04-22T19:58:49.785100+0000","last_peered":"2024-04-22T19:58:49.785100+0000","last_clean":"2024-04-22T19:58:49.785100+0000","last_became_active":"2024-04-22T19:54:17.375599+0000","last_became_peered":"2024-04-22T19:54:17.375599+0000","last_unstale":"2024-04-22T19:58:49.785100+0000","last_undegraded":"2024-04-22T19:58:49.785100+0000","last_fullsized":"2024-04-22T19:58:49.785100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'138","last_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_deep_scrub":"128'138","last_deep_scrub_stamp":"2024-04-22T19:58:36.096568+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.096568+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:45:49.007690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706775+0000","last_change":"2024-04-22T19:58:48.329730+0000","last_active":"2024-04-22T19:59:00.706775+0000","last_peered":"2024-04-22T19:59:00.706775+0000","last_clean":"2024-04-22T19:59:00.706775+0000","last_became_active":"2024-04-22T19:54:19.395638+0000","last_became_peered":"2024-04-22T19:54:19.395638+0000","last_unstale":"2024-04-22T19:59:00.706775+0000","last_undegraded":"2024-04-22T19:59:00.706775+0000","last_fullsized":"2024-04-22T19:59:00.706775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:48.329451+0000","last_clean_scrub_stamp":"2024-04-22T19:58:48.329451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:56:17.607131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708380+0000","last_change":"2024-04-22T19:58:50.097933+0000","last_active":"2024-04-22T19:59:10.708380+0000","last_peered":"2024-04-22T19:59:10.708380+0000","last_clean":"2024-04-22T19:59:10.708380+0000","last_became_active":"2024-04-22T19:57:45.769701+0000","last_became_peered":"2024-04-22T19:57:45.769701+0000","last_unstale":"2024-04-22T19:59:10.708380+0000","last_undegraded":"2024-04-22T19:59:10.708380+0000","last_fullsized":"2024-04-22T19:59:10.708380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:50.097674+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.097674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:29:03.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"128'56","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.732254+0000","last_change":"2024-04-22T19:58:45.615453+0000","last_active":"2024-04-22T19:59:10.732254+0000","last_peered":"2024-04-22T19:59:10.732254+0000","last_clean":"2024-04-22T19:59:10.732254+0000","last_became_active":"2024-04-22T19:54:09.355546+0000","last_became_peered":"2024-04-22T19:54:09.355546+0000","last_unstale":"2024-04-22T19:59:10.732254+0000","last_undegraded":"2024-04-22T19:59:10.732254+0000","last_fullsized":"2024-04-22T19:59:10.732254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:45.615205+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.615205+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:08.966839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729631+0000","last_change":"2024-04-22T19:58:22.480862+0000","last_active":"2024-04-22T19:58:49.729631+0000","last_peered":"2024-04-22T19:58:49.729631+0000","last_clean":"2024-04-22T19:58:49.729631+0000","last_became_active":"2024-04-22T19:54:13.365550+0000","last_became_peered":"2024-04-22T19:54:13.365550+0000","last_unstale":"2024-04-22T19:58:49.729631+0000","last_undegraded":"2024-04-22T19:58:49.729631+0000","last_fullsized":"2024-04-22T19:58:49.729631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:22.480564+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.480564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:06:35.498447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"128'34","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.731102+0000","last_change":"2024-04-22T19:58:28.660291+0000","last_active":"2024-04-22T19:59:05.731102+0000","last_peered":"2024-04-22T19:59:05.731102+0000","last_clean":"2024-04-22T19:59:05.731102+0000","last_became_active":"2024-04-22T19:54:15.362483+0000","last_became_peered":"2024-04-22T19:54:15.362483+0000","last_unstale":"2024-04-22T19:59:05.731102+0000","last_undegraded":"2024-04-22T19:59:05.731102+0000","last_fullsized":"2024-04-22T19:59:05.731102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'34","last_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_deep_scrub":"128'34","last_deep_scrub_stamp":"2024-04-22T19:58:28.659907+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.659907+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:52.911342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.697121+0000","last_change":"2024-04-22T19:58:47.919421+0000","last_active":"2024-04-22T19:59:10.697121+0000","last_peered":"2024-04-22T19:59:10.697121+0000","last_clean":"2024-04-22T19:59:10.697121+0000","last_became_active":"2024-04-22T19:54:17.377202+0000","last_became_peered":"2024-04-22T19:54:17.377202+0000","last_unstale":"2024-04-22T19:59:10.697121+0000","last_undegraded":"2024-04-22T19:59:10.697121+0000","last_fullsized":"2024-04-22T19:59:10.697121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.919160+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.919160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:03:42.143746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'7","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.709180+0000","last_change":"2024-04-22T19:58:46.395998+0000","last_active":"2024-04-22T19:59:10.709180+0000","last_peered":"2024-04-22T19:59:10.709180+0000","last_clean":"2024-04-22T19:59:10.709180+0000","last_became_active":"2024-04-22T19:54:19.387960+0000","last_became_peered":"2024-04-22T19:54:19.387960+0000","last_unstale":"2024-04-22T19:59:10.709180+0000","last_undegraded":"2024-04-22T19:59:10.709180+0000","last_fullsized":"2024-04-22T19:59:10.709180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-22T19:58:46.395579+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.395579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:24:13.655830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"110'2","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.708304+0000","last_change":"2024-04-22T19:58:51.131281+0000","last_active":"2024-04-22T19:59:10.708304+0000","last_peered":"2024-04-22T19:59:10.708304+0000","last_clean":"2024-04-22T19:59:10.708304+0000","last_became_active":"2024-04-22T19:57:45.769995+0000","last_became_peered":"2024-04-22T19:57:45.769995+0000","last_unstale":"2024-04-22T19:59:10.708304+0000","last_undegraded":"2024-04-22T19:59:10.708304+0000","last_fullsized":"2024-04-22T19:59:10.708304+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-04-22T19:58:51.130867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.130867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:41.215183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"128'42","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.732296+0000","last_change":"2024-04-22T19:58:42.576359+0000","last_active":"2024-04-22T19:59:10.732296+0000","last_peered":"2024-04-22T19:59:10.732296+0000","last_clean":"2024-04-22T19:59:10.732296+0000","last_became_active":"2024-04-22T19:54:09.341343+0000","last_became_peered":"2024-04-22T19:54:09.341343+0000","last_unstale":"2024-04-22T19:59:10.732296+0000","last_undegraded":"2024-04-22T19:59:10.732296+0000","last_fullsized":"2024-04-22T19:59:10.732296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'42","last_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_deep_scrub":"128'42","last_deep_scrub_stamp":"2024-04-22T19:58:42.576088+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.576088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:26.389020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781038+0000","last_change":"2024-04-22T19:58:23.674796+0000","last_active":"2024-04-22T19:58:49.781038+0000","last_peered":"2024-04-22T19:58:49.781038+0000","last_clean":"2024-04-22T19:58:49.781038+0000","last_became_active":"2024-04-22T19:54:13.369356+0000","last_became_peered":"2024-04-22T19:54:13.369356+0000","last_unstale":"2024-04-22T19:58:49.781038+0000","last_undegraded":"2024-04-22T19:58:49.781038+0000","last_fullsized":"2024-04-22T19:58:49.781038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:23.674549+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.674549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:22:39.208751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"128'23","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.696192+0000","last_change":"2024-04-22T19:58:25.822109+0000","last_active":"2024-04-22T19:59:05.696192+0000","last_peered":"2024-04-22T19:59:05.696192+0000","last_clean":"2024-04-22T19:59:05.696192+0000","last_became_active":"2024-04-22T19:54:15.355755+0000","last_became_peered":"2024-04-22T19:54:15.355755+0000","last_unstale":"2024-04-22T19:59:05.696192+0000","last_undegraded":"2024-04-22T19:59:05.696192+0000","last_fullsized":"2024-04-22T19:59:05.696192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'23","last_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_deep_scrub":"128'23","last_deep_scrub_stamp":"2024-04-22T19:58:25.821838+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.821838+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:54:09.685873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":221,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.702607+0000","last_change":"2024-04-22T19:58:37.123262+0000","last_active":"2024-04-22T19:59:10.702607+0000","last_peered":"2024-04-22T19:59:10.702607+0000","last_clean":"2024-04-22T19:59:10.702607+0000","last_became_active":"2024-04-22T19:54:17.379076+0000","last_became_peered":"2024-04-22T19:54:17.379076+0000","last_unstale":"2024-04-22T19:59:10.702607+0000","last_undegraded":"2024-04-22T19:59:10.702607+0000","last_fullsized":"2024-04-22T19:59:10.702607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.122971+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.122971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:39:13.168555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779236+0000","last_change":"2024-04-22T19:58:45.718639+0000","last_active":"2024-04-22T19:58:49.779236+0000","last_peered":"2024-04-22T19:58:49.779236+0000","last_clean":"2024-04-22T19:58:49.779236+0000","last_became_active":"2024-04-22T19:57:45.770113+0000","last_became_peered":"2024-04-22T19:57:45.770113+0000","last_unstale":"2024-04-22T19:58:49.779236+0000","last_undegraded":"2024-04-22T19:58:49.779236+0000","last_fullsized":"2024-04-22T19:58:49.779236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:45.718361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:45.718361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:05:23.384125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"102'22","reported_seq":68,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.778873+0000","last_change":"2024-04-22T19:58:36.779777+0000","last_active":"2024-04-22T19:58:49.778873+0000","last_peered":"2024-04-22T19:58:49.778873+0000","last_clean":"2024-04-22T19:58:49.778873+0000","last_became_active":"2024-04-22T19:57:45.757782+0000","last_became_peered":"2024-04-22T19:57:45.757782+0000","last_unstale":"2024-04-22T19:58:49.778873+0000","last_undegraded":"2024-04-22T19:58:49.778873+0000","last_fullsized":"2024-04-22T19:58:49.778873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'22","last_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_deep_scrub":"102'22","last_deep_scrub_stamp":"2024-04-22T19:58:36.779361+0000","last_clean_scrub_stamp":"2024-04-22T19:58:36.779361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:12:29.462567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":74,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"128'48","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.786193+0000","last_change":"2024-04-22T19:58:28.743738+0000","last_active":"2024-04-22T19:58:49.786193+0000","last_peered":"2024-04-22T19:58:49.786193+0000","last_clean":"2024-04-22T19:58:49.786193+0000","last_became_active":"2024-04-22T19:57:45.770497+0000","last_became_peered":"2024-04-22T19:57:45.770497+0000","last_unstale":"2024-04-22T19:58:49.786193+0000","last_undegraded":"2024-04-22T19:58:49.786193+0000","last_fullsized":"2024-04-22T19:58:49.786193+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:28.743345+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.743345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:49:49.471780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.707128+0000","last_change":"2024-04-22T19:58:28.353722+0000","last_active":"2024-04-22T19:59:05.707128+0000","last_peered":"2024-04-22T19:59:05.707128+0000","last_clean":"2024-04-22T19:59:05.707128+0000","last_became_active":"2024-04-22T19:54:13.364170+0000","last_became_peered":"2024-04-22T19:54:13.364170+0000","last_unstale":"2024-04-22T19:59:05.707128+0000","last_undegraded":"2024-04-22T19:59:05.707128+0000","last_fullsized":"2024-04-22T19:59:05.707128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:28.353464+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.353464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:44.164072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"128'17","reported_seq":66,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783540+0000","last_change":"2024-04-22T19:58:17.030290+0000","last_active":"2024-04-22T19:58:49.783540+0000","last_peered":"2024-04-22T19:58:49.783540+0000","last_clean":"2024-04-22T19:58:49.783540+0000","last_became_active":"2024-04-22T19:57:45.778094+0000","last_became_peered":"2024-04-22T19:57:45.778094+0000","last_unstale":"2024-04-22T19:58:49.783540+0000","last_undegraded":"2024-04-22T19:58:49.783540+0000","last_fullsized":"2024-04-22T19:58:49.783540+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'17","last_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_deep_scrub":"128'17","last_deep_scrub_stamp":"2024-04-22T19:58:17.030161+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.030161+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:18:50.757782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.718597+0000","last_change":"2024-04-22T19:58:46.114287+0000","last_active":"2024-04-22T19:58:49.718597+0000","last_peered":"2024-04-22T19:58:49.718597+0000","last_clean":"2024-04-22T19:58:49.718597+0000","last_became_active":"2024-04-22T19:54:17.368822+0000","last_became_peered":"2024-04-22T19:54:17.368822+0000","last_unstale":"2024-04-22T19:58:49.718597+0000","last_undegraded":"2024-04-22T19:58:49.718597+0000","last_fullsized":"2024-04-22T19:58:49.718597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:46.114035+0000","last_clean_scrub_stamp":"2024-04-22T19:58:46.114035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:23:09.465668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:10.709103+0000","last_change":"2024-04-22T19:58:47.352906+0000","last_active":"2024-04-22T19:59:10.709103+0000","last_peered":"2024-04-22T19:59:10.709103+0000","last_clean":"2024-04-22T19:59:10.709103+0000","last_became_active":"2024-04-22T19:54:19.391065+0000","last_became_peered":"2024-04-22T19:54:19.391065+0000","last_unstale":"2024-04-22T19:59:10.709103+0000","last_undegraded":"2024-04-22T19:59:10.709103+0000","last_fullsized":"2024-04-22T19:59:10.709103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:47.352655+0000","last_clean_scrub_stamp":"2024-04-22T19:58:47.352655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:08.527063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"110'4","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706036+0000","last_change":"2024-04-22T19:58:23.272496+0000","last_active":"2024-04-22T19:59:00.706036+0000","last_peered":"2024-04-22T19:59:00.706036+0000","last_clean":"2024-04-22T19:59:00.706036+0000","last_became_active":"2024-04-22T19:54:11.374098+0000","last_became_peered":"2024-04-22T19:54:11.374098+0000","last_unstale":"2024-04-22T19:59:00.706036+0000","last_undegraded":"2024-04-22T19:59:00.706036+0000","last_fullsized":"2024-04-22T19:59:00.706036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:23.272212+0000","last_clean_scrub_stamp":"2024-04-22T19:58:23.272212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:34:56.270001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"128'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.725683+0000","last_change":"2024-04-22T19:58:39.811833+0000","last_active":"2024-04-22T19:58:49.725683+0000","last_peered":"2024-04-22T19:58:49.725683+0000","last_clean":"2024-04-22T19:58:49.725683+0000","last_became_active":"2024-04-22T19:54:09.309709+0000","last_became_peered":"2024-04-22T19:54:09.309709+0000","last_unstale":"2024-04-22T19:58:49.725683+0000","last_undegraded":"2024-04-22T19:58:49.725683+0000","last_fullsized":"2024-04-22T19:58:49.725683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:39.811572+0000","last_clean_scrub_stamp":"2024-04-22T19:58:39.811572+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T22:00:23.624504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"128'2","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:05.690651+0000","last_change":"2024-04-22T19:58:17.276221+0000","last_active":"2024-04-22T19:59:05.690651+0000","last_peered":"2024-04-22T19:59:05.690651+0000","last_clean":"2024-04-22T19:59:05.690651+0000","last_became_active":"2024-04-22T19:54:13.372828+0000","last_became_peered":"2024-04-22T19:54:13.372828+0000","last_unstale":"2024-04-22T19:59:05.690651+0000","last_undegraded":"2024-04-22T19:59:05.690651+0000","last_fullsized":"2024-04-22T19:59:05.690651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'2","last_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_deep_scrub":"128'2","last_deep_scrub_stamp":"2024-04-22T19:58:17.276092+0000","last_clean_scrub_stamp":"2024-04-22T19:58:17.276092+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:22:04.701045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"128'25","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720478+0000","last_change":"2024-04-22T19:58:34.235173+0000","last_active":"2024-04-22T19:58:49.720478+0000","last_peered":"2024-04-22T19:58:49.720478+0000","last_clean":"2024-04-22T19:58:49.720478+0000","last_became_active":"2024-04-22T19:54:15.373160+0000","last_became_peered":"2024-04-22T19:54:15.373160+0000","last_unstale":"2024-04-22T19:58:49.720478+0000","last_undegraded":"2024-04-22T19:58:49.720478+0000","last_fullsized":"2024-04-22T19:58:49.720478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'25","last_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_deep_scrub":"128'25","last_deep_scrub_stamp":"2024-04-22T19:58:34.234693+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.234693+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:28:59.363249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719471+0000","last_change":"2024-04-22T19:58:37.830012+0000","last_active":"2024-04-22T19:58:49.719471+0000","last_peered":"2024-04-22T19:58:49.719471+0000","last_clean":"2024-04-22T19:58:49.719471+0000","last_became_active":"2024-04-22T19:54:17.371174+0000","last_became_peered":"2024-04-22T19:54:17.371174+0000","last_unstale":"2024-04-22T19:58:49.719471+0000","last_undegraded":"2024-04-22T19:58:49.719471+0000","last_fullsized":"2024-04-22T19:58:49.719471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.829751+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.829751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:47:59.004159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"71'4","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.706221+0000","last_change":"2024-04-22T19:58:19.211781+0000","last_active":"2024-04-22T19:59:00.706221+0000","last_peered":"2024-04-22T19:59:00.706221+0000","last_clean":"2024-04-22T19:59:00.706221+0000","last_became_active":"2024-04-22T19:54:19.378618+0000","last_became_peered":"2024-04-22T19:54:19.378618+0000","last_unstale":"2024-04-22T19:59:00.706221+0000","last_undegraded":"2024-04-22T19:59:00.706221+0000","last_fullsized":"2024-04-22T19:59:00.706221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-22T19:58:19.211536+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.211536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:26:56.004062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'2","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723301+0000","last_change":"2024-04-22T19:58:26.356910+0000","last_active":"2024-04-22T19:58:49.723301+0000","last_peered":"2024-04-22T19:58:49.723301+0000","last_clean":"2024-04-22T19:58:49.723301+0000","last_became_active":"2024-04-22T19:54:11.359018+0000","last_became_peered":"2024-04-22T19:54:11.359018+0000","last_unstale":"2024-04-22T19:58:49.723301+0000","last_undegraded":"2024-04-22T19:58:49.723301+0000","last_fullsized":"2024-04-22T19:58:49.723301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:26.356540+0000","last_clean_scrub_stamp":"2024-04-22T19:58:26.356540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:57.088770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"128'48","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777755+0000","last_change":"2024-04-22T19:58:29.052672+0000","last_active":"2024-04-22T19:58:49.777755+0000","last_peered":"2024-04-22T19:58:49.777755+0000","last_clean":"2024-04-22T19:58:49.777755+0000","last_became_active":"2024-04-22T19:54:09.334151+0000","last_became_peered":"2024-04-22T19:54:09.334151+0000","last_unstale":"2024-04-22T19:58:49.777755+0000","last_undegraded":"2024-04-22T19:58:49.777755+0000","last_fullsized":"2024-04-22T19:58:49.777755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'48","last_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_deep_scrub":"128'48","last_deep_scrub_stamp":"2024-04-22T19:58:29.052427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.052427+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:48:29.150327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"72'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.723195+0000","last_change":"2024-04-22T19:58:28.395324+0000","last_active":"2024-04-22T19:58:49.723195+0000","last_peered":"2024-04-22T19:58:49.723195+0000","last_clean":"2024-04-22T19:58:49.723195+0000","last_became_active":"2024-04-22T19:54:11.355892+0000","last_became_peered":"2024-04-22T19:54:11.355892+0000","last_unstale":"2024-04-22T19:58:49.723195+0000","last_undegraded":"2024-04-22T19:58:49.723195+0000","last_fullsized":"2024-04-22T19:58:49.723195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-22T19:58:28.395067+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.395067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:42:10.870055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"128'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.727305+0000","last_change":"2024-04-22T19:58:28.480036+0000","last_active":"2024-04-22T19:58:49.727305+0000","last_peered":"2024-04-22T19:58:49.727305+0000","last_clean":"2024-04-22T19:58:49.727305+0000","last_became_active":"2024-04-22T19:54:48.935642+0000","last_became_peered":"2024-04-22T19:54:48.935642+0000","last_unstale":"2024-04-22T19:58:49.727305+0000","last_undegraded":"2024-04-22T19:58:49.727305+0000","last_fullsized":"2024-04-22T19:58:49.727305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:28.479633+0000","last_clean_scrub_stamp":"2024-04-22T19:58:28.479633+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:43:21.830473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"110'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783167+0000","last_change":"2024-04-22T19:58:27.649913+0000","last_active":"2024-04-22T19:58:49.783167+0000","last_peered":"2024-04-22T19:58:49.783167+0000","last_clean":"2024-04-22T19:58:49.783167+0000","last_became_active":"2024-04-22T19:54:11.380136+0000","last_became_peered":"2024-04-22T19:54:11.380136+0000","last_unstale":"2024-04-22T19:58:49.783167+0000","last_undegraded":"2024-04-22T19:58:49.783167+0000","last_fullsized":"2024-04-22T19:58:49.783167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-04-22T19:58:27.649652+0000","last_clean_scrub_stamp":"2024-04-22T19:58:27.649652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:27:43.460259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"128'44","reported_seq":356,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.617855+0000","last_change":"2024-04-22T19:58:50.617855+0000","last_active":"2024-04-22T19:58:50.617855+0000","last_peered":"2024-04-22T19:58:50.617855+0000","last_clean":"2024-04-22T19:58:50.617855+0000","last_became_active":"2024-04-22T19:57:45.785855+0000","last_became_peered":"2024-04-22T19:57:45.785855+0000","last_unstale":"2024-04-22T19:58:50.617855+0000","last_undegraded":"2024-04-22T19:58:50.617855+0000","last_fullsized":"2024-04-22T19:58:50.617855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:50.617595+0000","last_clean_scrub_stamp":"2024-04-22T19:58:50.617595+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:49:40.701911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"94'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721858+0000","last_change":"2024-04-22T19:58:24.357656+0000","last_active":"2024-04-22T19:58:49.721858+0000","last_peered":"2024-04-22T19:58:49.721858+0000","last_clean":"2024-04-22T19:58:49.721858+0000","last_became_active":"2024-04-22T19:54:11.363265+0000","last_became_peered":"2024-04-22T19:54:11.363265+0000","last_unstale":"2024-04-22T19:58:49.721858+0000","last_undegraded":"2024-04-22T19:58:49.721858+0000","last_fullsized":"2024-04-22T19:58:49.721858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-04-22T19:58:24.357397+0000","last_clean_scrub_stamp":"2024-04-22T19:58:24.357397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:39:36.554960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"128'32","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.869837+0000","last_change":"2024-04-22T19:58:51.869837+0000","last_active":"2024-04-22T19:58:51.869837+0000","last_peered":"2024-04-22T19:58:51.869837+0000","last_clean":"2024-04-22T19:58:51.869837+0000","last_became_active":"2024-04-22T19:57:45.765046+0000","last_became_peered":"2024-04-22T19:57:45.765046+0000","last_unstale":"2024-04-22T19:58:51.869837+0000","last_undegraded":"2024-04-22T19:58:51.869837+0000","last_fullsized":"2024-04-22T19:58:51.869837+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'32","last_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_deep_scrub":"128'32","last_deep_scrub_stamp":"2024-04-22T19:58:51.869529+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.869529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:03:23.046557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"102'4","reported_seq":58,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.780808+0000","last_change":"2024-04-22T19:58:41.787298+0000","last_active":"2024-04-22T19:58:49.780808+0000","last_peered":"2024-04-22T19:58:49.780808+0000","last_clean":"2024-04-22T19:58:49.780808+0000","last_became_active":"2024-04-22T19:57:45.776050+0000","last_became_peered":"2024-04-22T19:57:45.776050+0000","last_unstale":"2024-04-22T19:58:49.780808+0000","last_undegraded":"2024-04-22T19:58:49.780808+0000","last_fullsized":"2024-04-22T19:58:49.780808+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'4","last_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_deep_scrub":"102'4","last_deep_scrub_stamp":"2024-04-22T19:58:41.786867+0000","last_clean_scrub_stamp":"2024-04-22T19:58:41.786867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:20:44.295841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"128'62","reported_seq":84,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T20:01:22.557871+0000","last_change":"2024-04-22T20:01:22.557905+0000","last_active":"2024-04-22T20:01:22.557871+0000","last_peered":"2024-04-22T20:01:22.557871+0000","last_clean":"2024-04-22T20:01:22.557871+0000","last_became_active":"2024-04-22T19:58:49.732058+0000","last_became_peered":"2024-04-22T19:58:49.732058+0000","last_unstale":"2024-04-22T20:01:22.557871+0000","last_undegraded":"2024-04-22T20:01:22.557871+0000","last_fullsized":"2024-04-22T20:01:22.557871+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T20:01:22.557762+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T20:01:22.557762+0000","last_clean_scrub_stamp":"2024-04-22T20:01:22.557762+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:58:51.835442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":150994944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.720641+0000","last_change":"2024-04-22T19:58:37.198034+0000","last_active":"2024-04-22T19:58:49.720641+0000","last_peered":"2024-04-22T19:58:49.720641+0000","last_clean":"2024-04-22T19:58:49.720641+0000","last_became_active":"2024-04-22T19:54:11.355388+0000","last_became_peered":"2024-04-22T19:54:11.355388+0000","last_unstale":"2024-04-22T19:58:49.720641+0000","last_undegraded":"2024-04-22T19:58:49.720641+0000","last_fullsized":"2024-04-22T19:58:49.720641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:37.197778+0000","last_clean_scrub_stamp":"2024-04-22T19:58:37.197778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:45:14.226444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"128'38","reported_seq":335,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.722992+0000","last_change":"2024-04-22T19:58:42.441228+0000","last_active":"2024-04-22T19:58:49.722992+0000","last_peered":"2024-04-22T19:58:49.722992+0000","last_clean":"2024-04-22T19:58:49.722992+0000","last_became_active":"2024-04-22T19:57:45.785144+0000","last_became_peered":"2024-04-22T19:57:45.785144+0000","last_unstale":"2024-04-22T19:58:49.722992+0000","last_undegraded":"2024-04-22T19:58:49.722992+0000","last_fullsized":"2024-04-22T19:58:49.722992+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'38","last_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_deep_scrub":"128'38","last_deep_scrub_stamp":"2024-04-22T19:58:42.440933+0000","last_clean_scrub_stamp":"2024-04-22T19:58:42.440933+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:29:07.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":96468992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'2","reported_seq":56,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779177+0000","last_change":"2024-04-22T19:58:32.687912+0000","last_active":"2024-04-22T19:58:49.779177+0000","last_peered":"2024-04-22T19:58:49.779177+0000","last_clean":"2024-04-22T19:58:49.779177+0000","last_became_active":"2024-04-22T19:57:45.769700+0000","last_became_peered":"2024-04-22T19:57:45.769700+0000","last_unstale":"2024-04-22T19:58:49.779177+0000","last_undegraded":"2024-04-22T19:58:49.779177+0000","last_fullsized":"2024-04-22T19:58:49.779177+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:32.687645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.687645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:13:42.720430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"128'56","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.785909+0000","last_change":"2024-04-22T19:58:34.081613+0000","last_active":"2024-04-22T19:58:49.785909+0000","last_peered":"2024-04-22T19:58:49.785909+0000","last_clean":"2024-04-22T19:58:49.785909+0000","last_became_active":"2024-04-22T19:54:09.350915+0000","last_became_peered":"2024-04-22T19:54:09.350915+0000","last_unstale":"2024-04-22T19:58:49.785909+0000","last_undegraded":"2024-04-22T19:58:49.785909+0000","last_fullsized":"2024-04-22T19:58:49.785909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:34.081201+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.081201+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:25:02.134630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"71'2","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.777695+0000","last_change":"2024-04-22T19:58:22.053833+0000","last_active":"2024-04-22T19:58:49.777695+0000","last_peered":"2024-04-22T19:58:49.777695+0000","last_clean":"2024-04-22T19:58:49.777695+0000","last_became_active":"2024-04-22T19:54:11.365195+0000","last_became_peered":"2024-04-22T19:54:11.365195+0000","last_unstale":"2024-04-22T19:58:49.777695+0000","last_undegraded":"2024-04-22T19:58:49.777695+0000","last_fullsized":"2024-04-22T19:58:49.777695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-22T19:58:22.053544+0000","last_clean_scrub_stamp":"2024-04-22T19:58:22.053544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:50:54.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"128'36","reported_seq":108,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.830273+0000","last_change":"2024-04-22T19:58:53.830273+0000","last_active":"2024-04-22T19:58:53.830273+0000","last_peered":"2024-04-22T19:58:53.830273+0000","last_clean":"2024-04-22T19:58:53.830273+0000","last_became_active":"2024-04-22T19:57:45.782129+0000","last_became_peered":"2024-04-22T19:57:45.782129+0000","last_unstale":"2024-04-22T19:58:53.830273+0000","last_undegraded":"2024-04-22T19:58:53.830273+0000","last_fullsized":"2024-04-22T19:58:53.830273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'36","last_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_deep_scrub":"128'36","last_deep_scrub_stamp":"2024-04-22T19:58:53.829999+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.829999+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T20:50:06.061114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"72'6","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.871926+0000","last_change":"2024-04-22T19:58:53.871926+0000","last_active":"2024-04-22T19:58:53.871926+0000","last_peered":"2024-04-22T19:58:53.871926+0000","last_clean":"2024-04-22T19:58:53.871926+0000","last_became_active":"2024-04-22T19:57:45.785647+0000","last_became_peered":"2024-04-22T19:57:45.785647+0000","last_unstale":"2024-04-22T19:58:53.871926+0000","last_undegraded":"2024-04-22T19:58:53.871926+0000","last_fullsized":"2024-04-22T19:58:53.871926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-22T19:58:53.871661+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.871661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:43:15.682570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"128'54","reported_seq":367,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:53.628061+0000","last_change":"2024-04-22T19:58:53.628061+0000","last_active":"2024-04-22T19:58:53.628061+0000","last_peered":"2024-04-22T19:58:53.628061+0000","last_clean":"2024-04-22T19:58:53.628061+0000","last_became_active":"2024-04-22T19:57:45.789666+0000","last_became_peered":"2024-04-22T19:57:45.789666+0000","last_unstale":"2024-04-22T19:58:53.628061+0000","last_undegraded":"2024-04-22T19:58:53.628061+0000","last_fullsized":"2024-04-22T19:58:53.628061+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:53.627772+0000","last_clean_scrub_stamp":"2024-04-22T19:58:53.627772+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T05:13:11.887626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"110'6","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.704175+0000","last_change":"2024-04-22T19:58:33.251575+0000","last_active":"2024-04-22T19:58:50.704175+0000","last_peered":"2024-04-22T19:58:50.704175+0000","last_clean":"2024-04-22T19:58:50.704175+0000","last_became_active":"2024-04-22T19:54:11.361415+0000","last_became_peered":"2024-04-22T19:54:11.361415+0000","last_unstale":"2024-04-22T19:58:50.704175+0000","last_undegraded":"2024-04-22T19:58:50.704175+0000","last_fullsized":"2024-04-22T19:58:50.704175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-04-22T19:58:33.251267+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.251267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T21:28:59.403894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"128'68","reported_seq":156,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.782158+0000","last_change":"2024-04-22T19:58:21.913099+0000","last_active":"2024-04-22T19:58:49.782158+0000","last_peered":"2024-04-22T19:58:49.782158+0000","last_clean":"2024-04-22T19:58:49.782158+0000","last_became_active":"2024-04-22T19:57:45.779003+0000","last_became_peered":"2024-04-22T19:57:45.779003+0000","last_unstale":"2024-04-22T19:58:49.782158+0000","last_undegraded":"2024-04-22T19:58:49.782158+0000","last_fullsized":"2024-04-22T19:58:49.782158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'68","last_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_deep_scrub":"128'68","last_deep_scrub_stamp":"2024-04-22T19:58:21.912819+0000","last_clean_scrub_stamp":"2024-04-22T19:58:21.912819+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T07:04:48.054067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":176160768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"77'2","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729647+0000","last_change":"2024-04-22T19:58:20.522113+0000","last_active":"2024-04-22T19:58:49.729647+0000","last_peered":"2024-04-22T19:58:49.729647+0000","last_clean":"2024-04-22T19:58:49.729647+0000","last_became_active":"2024-04-22T19:54:11.356941+0000","last_became_peered":"2024-04-22T19:54:11.356941+0000","last_unstale":"2024-04-22T19:58:49.729647+0000","last_undegraded":"2024-04-22T19:58:49.729647+0000","last_fullsized":"2024-04-22T19:58:49.729647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-22T19:58:20.521744+0000","last_clean_scrub_stamp":"2024-04-22T19:58:20.521744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:04:25.608239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"128'72","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781013+0000","last_change":"2024-04-22T19:58:43.563111+0000","last_active":"2024-04-22T19:58:49.781013+0000","last_peered":"2024-04-22T19:58:49.781013+0000","last_clean":"2024-04-22T19:58:49.781013+0000","last_became_active":"2024-04-22T19:54:09.341963+0000","last_became_peered":"2024-04-22T19:54:09.341963+0000","last_unstale":"2024-04-22T19:58:49.781013+0000","last_undegraded":"2024-04-22T19:58:49.781013+0000","last_fullsized":"2024-04-22T19:58:49.781013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'72","last_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_deep_scrub":"128'72","last_deep_scrub_stamp":"2024-04-22T19:58:43.562824+0000","last_clean_scrub_stamp":"2024-04-22T19:58:43.562824+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T00:37:22.757058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"102'14","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.721225+0000","last_change":"2024-04-22T19:58:29.369785+0000","last_active":"2024-04-22T19:58:49.721225+0000","last_peered":"2024-04-22T19:58:49.721225+0000","last_clean":"2024-04-22T19:58:49.721225+0000","last_became_active":"2024-04-22T19:54:11.367305+0000","last_became_peered":"2024-04-22T19:54:11.367305+0000","last_unstale":"2024-04-22T19:58:49.721225+0000","last_undegraded":"2024-04-22T19:58:49.721225+0000","last_fullsized":"2024-04-22T19:58:49.721225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'14","last_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_deep_scrub":"102'14","last_deep_scrub_stamp":"2024-04-22T19:58:29.369465+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.369465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:31:53.620900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"128'62","reported_seq":75,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687662+0000","last_change":"2024-04-22T19:58:49.842624+0000","last_active":"2024-04-22T19:58:50.687662+0000","last_peered":"2024-04-22T19:58:50.687662+0000","last_clean":"2024-04-22T19:58:50.687662+0000","last_became_active":"2024-04-22T19:58:49.733397+0000","last_became_peered":"2024-04-22T19:58:49.733397+0000","last_unstale":"2024-04-22T19:58:50.687662+0000","last_undegraded":"2024-04-22T19:58:50.687662+0000","last_fullsized":"2024-04-22T19:58:50.687662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'62","last_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_deep_scrub":"128'62","last_deep_scrub_stamp":"2024-04-22T19:58:44.871098+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.871098+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:46:44.774853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:52.369242+0000","last_change":"2024-04-22T19:58:52.369242+0000","last_active":"2024-04-22T19:58:52.369242+0000","last_peered":"2024-04-22T19:58:52.369242+0000","last_clean":"2024-04-22T19:58:52.369242+0000","last_became_active":"2024-04-22T19:58:49.781010+0000","last_became_peered":"2024-04-22T19:58:49.781010+0000","last_unstale":"2024-04-22T19:58:52.369242+0000","last_undegraded":"2024-04-22T19:58:52.369242+0000","last_fullsized":"2024-04-22T19:58:52.369242+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:52.368897+0000","last_clean_scrub_stamp":"2024-04-22T19:58:52.368897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:50:13.097332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"128'56","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.781363+0000","last_change":"2024-04-22T19:58:33.085911+0000","last_active":"2024-04-22T19:58:49.781363+0000","last_peered":"2024-04-22T19:58:49.781363+0000","last_clean":"2024-04-22T19:58:49.781363+0000","last_became_active":"2024-04-22T19:54:09.348524+0000","last_became_peered":"2024-04-22T19:54:09.348524+0000","last_unstale":"2024-04-22T19:58:49.781363+0000","last_undegraded":"2024-04-22T19:58:49.781363+0000","last_fullsized":"2024-04-22T19:58:49.781363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:33.085493+0000","last_clean_scrub_stamp":"2024-04-22T19:58:33.085493+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:56.917363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"94'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.719016+0000","last_change":"2024-04-22T19:58:32.758784+0000","last_active":"2024-04-22T19:58:49.719016+0000","last_peered":"2024-04-22T19:58:49.719016+0000","last_clean":"2024-04-22T19:58:49.719016+0000","last_became_active":"2024-04-22T19:54:11.354378+0000","last_became_peered":"2024-04-22T19:54:11.354378+0000","last_unstale":"2024-04-22T19:58:49.719016+0000","last_undegraded":"2024-04-22T19:58:49.719016+0000","last_fullsized":"2024-04-22T19:58:49.719016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-04-22T19:58:32.758516+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.758516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T01:29:59.136900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"128'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.732474+0000","last_change":"2024-04-22T19:58:32.406368+0000","last_active":"2024-04-22T19:58:49.732474+0000","last_peered":"2024-04-22T19:58:49.732474+0000","last_clean":"2024-04-22T19:58:49.732474+0000","last_became_active":"2024-04-22T19:54:09.357778+0000","last_became_peered":"2024-04-22T19:54:09.357778+0000","last_unstale":"2024-04-22T19:58:49.732474+0000","last_undegraded":"2024-04-22T19:58:49.732474+0000","last_fullsized":"2024-04-22T19:58:49.732474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:32.406125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:32.406125+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:43.167862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.779461+0000","last_change":"2024-04-22T19:58:44.751979+0000","last_active":"2024-04-22T19:58:49.779461+0000","last_peered":"2024-04-22T19:58:49.779461+0000","last_clean":"2024-04-22T19:58:49.779461+0000","last_became_active":"2024-04-22T19:57:45.764497+0000","last_became_peered":"2024-04-22T19:57:45.764497+0000","last_unstale":"2024-04-22T19:58:49.779461+0000","last_undegraded":"2024-04-22T19:58:49.779461+0000","last_fullsized":"2024-04-22T19:58:49.779461+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T19:58:44.751645+0000","last_clean_scrub_stamp":"2024-04-22T19:58:44.751645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T03:05:34.294464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"128'44","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687825+0000","last_change":"2024-04-22T19:58:19.562332+0000","last_active":"2024-04-22T19:58:50.687825+0000","last_peered":"2024-04-22T19:58:50.687825+0000","last_clean":"2024-04-22T19:58:50.687825+0000","last_became_active":"2024-04-22T19:54:09.323027+0000","last_became_peered":"2024-04-22T19:54:09.323027+0000","last_unstale":"2024-04-22T19:58:50.687825+0000","last_undegraded":"2024-04-22T19:58:50.687825+0000","last_fullsized":"2024-04-22T19:58:50.687825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'44","last_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_deep_scrub":"128'44","last_deep_scrub_stamp":"2024-04-22T19:58:19.562060+0000","last_clean_scrub_stamp":"2024-04-22T19:58:19.562060+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T02:31:18.741761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"94'10","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:51.357646+0000","last_change":"2024-04-22T19:58:51.357646+0000","last_active":"2024-04-22T19:58:51.357646+0000","last_peered":"2024-04-22T19:58:51.357646+0000","last_clean":"2024-04-22T19:58:51.357646+0000","last_became_active":"2024-04-22T19:57:45.789658+0000","last_became_peered":"2024-04-22T19:57:45.789658+0000","last_unstale":"2024-04-22T19:58:51.357646+0000","last_undegraded":"2024-04-22T19:58:51.357646+0000","last_fullsized":"2024-04-22T19:58:51.357646+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-04-22T19:58:51.357352+0000","last_clean_scrub_stamp":"2024-04-22T19:58:51.357352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:36:32.055438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"128'56","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.729219+0000","last_change":"2024-04-22T19:58:29.463514+0000","last_active":"2024-04-22T19:58:49.729219+0000","last_peered":"2024-04-22T19:58:49.729219+0000","last_clean":"2024-04-22T19:58:49.729219+0000","last_became_active":"2024-04-22T19:54:48.939562+0000","last_became_peered":"2024-04-22T19:54:48.939562+0000","last_unstale":"2024-04-22T19:58:49.729219+0000","last_undegraded":"2024-04-22T19:58:49.729219+0000","last_fullsized":"2024-04-22T19:58:49.729219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'56","last_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_deep_scrub":"128'56","last_deep_scrub_stamp":"2024-04-22T19:58:29.463239+0000","last_clean_scrub_stamp":"2024-04-22T19:58:29.463239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T04:04:26.097783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"128'54","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.728080+0000","last_change":"2024-04-22T19:58:40.531680+0000","last_active":"2024-04-22T19:58:50.728080+0000","last_peered":"2024-04-22T19:58:50.728080+0000","last_clean":"2024-04-22T19:58:50.728080+0000","last_became_active":"2024-04-22T19:54:09.312534+0000","last_became_peered":"2024-04-22T19:54:09.312534+0000","last_unstale":"2024-04-22T19:58:50.728080+0000","last_undegraded":"2024-04-22T19:58:50.728080+0000","last_fullsized":"2024-04-22T19:58:50.728080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'54","last_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_deep_scrub":"128'54","last_deep_scrub_stamp":"2024-04-22T19:58:40.531427+0000","last_clean_scrub_stamp":"2024-04-22T19:58:40.531427+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:48:01.705835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:59:00.695430+0000","last_change":"2024-04-22T19:58:54.886608+0000","last_active":"2024-04-22T19:59:00.695430+0000","last_peered":"2024-04-22T19:59:00.695430+0000","last_clean":"2024-04-22T19:59:00.695430+0000","last_became_active":"2024-04-22T19:57:45.786986+0000","last_became_peered":"2024-04-22T19:57:45.786986+0000","last_unstale":"2024-04-22T19:59:00.695430+0000","last_undegraded":"2024-04-22T19:59:00.695430+0000","last_fullsized":"2024-04-22T19:59:00.695430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-22T19:58:54.886341+0000","last_clean_scrub_stamp":"2024-04-22T19:58:54.886341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T06:39:43.812632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"128'46","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:50.687709+0000","last_change":"2024-04-22T19:58:34.442376+0000","last_active":"2024-04-22T19:58:50.687709+0000","last_peered":"2024-04-22T19:58:50.687709+0000","last_clean":"2024-04-22T19:58:50.687709+0000","last_became_active":"2024-04-22T19:54:09.346487+0000","last_became_peered":"2024-04-22T19:54:09.346487+0000","last_unstale":"2024-04-22T19:58:50.687709+0000","last_undegraded":"2024-04-22T19:58:50.687709+0000","last_fullsized":"2024-04-22T19:58:50.687709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'46","last_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_deep_scrub":"128'46","last_deep_scrub_stamp":"2024-04-22T19:58:34.442125+0000","last_clean_scrub_stamp":"2024-04-22T19:58:34.442125+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:45.203862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"110'12","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-22T19:58:49.783301+0000","last_change":"2024-04-22T19:58:25.724560+0000","last_active":"2024-04-22T19:58:49.783301+0000","last_peered":"2024-04-22T19:58:49.783301+0000","last_clean":"2024-04-22T19:58:49.783301+0000","last_became_active":"2024-04-22T19:54:11.383273+0000","last_became_peered":"2024-04-22T19:54:11.383273+0000","last_unstale":"2024-04-22T19:58:49.783301+0000","last_undegraded":"2024-04-22T19:58:49.783301+0000","last_fullsized":"2024-04-22T19:58:49.783301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-04-22T19:58:25.724290+0000","last_clean_scrub_stamp":"2024-04-22T19:58:25.724290+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T23:06:36.486027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":337,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1214,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1064,"num_read_kb":1547,"num_write":545,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":321,"num_read_kb":321,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1405,"num_read_kb":1373,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":607,"num_bytes_recovered":2256535552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2211840,"data_stored":1515737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1585152,"data_stored":924262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":926083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1572864,"data_stored":923760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45232,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326608,"statfs":{"total":96636764160,"available":96590446592,"internally_reserved":0,"allocated":1613824,"data_stored":925497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1576960,"data_stored":924817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":924904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1514696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T20:01:42.921 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-22T20:01:43.272 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-22T20:01:43.272 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-22T20:01:43.273 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-22T20:01:43.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:43.332 INFO:tasks.ceph.osd.0:Stopped 2024-04-22T20:01:43.333 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-22T20:01:43.333 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:43.429 INFO:tasks.ceph.osd.1:Stopped 2024-04-22T20:01:43.429 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-22T20:01:43.429 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:43.507 INFO:tasks.ceph.osd.2:Stopped 2024-04-22T20:01:43.507 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-22T20:01:43.507 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:43.597 INFO:tasks.ceph.osd.3:Stopped 2024-04-22T20:01:43.597 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-22T20:01:43.597 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:44.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-22T20:01:49.699 INFO:tasks.ceph.osd.4:Stopped 2024-04-22T20:01:49.699 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-22T20:01:49.699 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:49.760 INFO:tasks.ceph.osd.5:Stopped 2024-04-22T20:01:49.760 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-22T20:01:49.760 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:49.851 INFO:tasks.ceph.osd.6:Stopped 2024-04-22T20:01:49.851 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-22T20:01:49.851 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:49.935 INFO:tasks.ceph.osd.7:Stopped 2024-04-22T20:01:49.935 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-22T20:01:49.936 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-22T20:01:49.936 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:49.963 INFO:tasks.ceph.mgr.y:Stopped 2024-04-22T20:01:49.964 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-22T20:01:49.964 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:49.994 INFO:tasks.ceph.mgr.x:Stopped 2024-04-22T20:01:49.994 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-22T20:01:49.994 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-22T20:01:49.994 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:50.027 INFO:tasks.ceph.mon.a:Stopped 2024-04-22T20:01:50.027 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-22T20:01:50.027 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:50.083 INFO:tasks.ceph.mon.c:Stopped 2024-04-22T20:01:50.083 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-22T20:01:50.083 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T20:01:50.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-22T20:01:50.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-22T20:01:50.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-22T20:01:50.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-22T20:01:50.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-22T20:01:50.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-22T20:01:50.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-22T20:01:50.105 INFO:tasks.ceph.mon.b:Stopped 2024-04-22T20:01:50.105 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-22T20:01:50.105 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-22T20:01:50.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T20:01:50.140 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-22T20:01:50.552 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T20:01:50.552 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-22T20:01:50.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T20:01:50.844 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-22T20:01:51.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T20:01:51.017 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-22T20:01:51.201 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T20:01:51.201 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-22T20:01:51.655 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T20:01:51.655 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-22T20:01:51.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T20:01:51.851 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-22T20:01:52.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T20:01:52.045 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-22T20:01:52.231 INFO:tasks.ceph:Archiving mon data... 2024-04-22T20:01:52.232 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/data/mon.a.tgz 2024-04-22T20:01:52.232 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-22T20:01:52.238 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.nUBzsdk4BG 2024-04-22T20:01:52.239 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nUBzsdk4BG 2024-04-22T20:01:52.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.nUBzsdk4BG 2024-04-22T20:01:52.497 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.nUBzsdk4BG is 648KB 2024-04-22T20:01:52.559 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.nUBzsdk4BG 2024-04-22T20:01:52.565 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/data/mon.c.tgz 2024-04-22T20:01:52.565 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-22T20:01:52.614 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.fKe7hv7kmZ 2024-04-22T20:01:52.614 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fKe7hv7kmZ 2024-04-22T20:01:52.859 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.fKe7hv7kmZ 2024-04-22T20:01:52.922 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.fKe7hv7kmZ is 835KB 2024-04-22T20:01:52.987 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.fKe7hv7kmZ 2024-04-22T20:01:52.993 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/data/mon.b.tgz 2024-04-22T20:01:52.993 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-22T20:01:52.999 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.eH9dAEnJOb 2024-04-22T20:01:52.999 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.eH9dAEnJOb 2024-04-22T20:01:53.237 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.eH9dAEnJOb 2024-04-22T20:01:53.299 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.eH9dAEnJOb is 835KB 2024-04-22T20:01:53.366 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.eH9dAEnJOb 2024-04-22T20:01:53.371 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-22T20:01:53.371 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T20:01:53.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T20:01:53.433 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T20:01:53.472 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T20:01:53.472 INFO:tasks.ceph:Archiving crash dumps... 2024-04-22T20:01:53.473 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi111/crash 2024-04-22T20:01:53.474 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T20:01:53.489 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi138/crash 2024-04-22T20:01:53.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T20:01:53.527 INFO:tasks.ceph:Compressing logs... 2024-04-22T20:01:53.527 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T20:01:53.534 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T20:01:53.553 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66860.log 2024-04-22T20:01:53.554 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35619.log 2024-04-22T20:01:53.554 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68705.log 2024-04-22T20:01:53.554 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66860.log.gz 2024-04-22T20:01:53.554 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35619.log.gz 2024-04-22T20:01:53.554 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69043.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68705.log.gz 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66417.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35134.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66417.log: gzip/var/log/ceph/ceph-client.admin.69043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62586.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66417.log.gz 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69043.log.gz 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35134.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35134.log.gz 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62586.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20246.log 2024-04-22T20:01:53.558 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62586.log.gz 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50742.log 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.tmp-client.admin.20246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36092.log 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20246.log.gz 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.50742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32812.log 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50742.log.gz 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68445.log 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36092.log.gz/var/log/ceph/ceph-client.admin.32812.log: 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32812.log.gz 2024-04-22T20:01:53.559 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35924.log 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68445.log.gz 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34435.log 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35924.log.gz 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2024-04-22T20:01:53.569 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68393.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34435.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.68393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68393.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5/var/log/ceph/ceph-client.admin.35100.log: --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59430.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55125.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56093.log 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59430.log.gz 2024-04-22T20:01:53.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30903.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55125.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56093.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33047.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30903.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51358.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33047.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51358.log.gz 2024-04-22T20:01:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33640.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55347.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33640.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33640.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66385.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55347.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61575.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68679.log 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66385.log.gz 2024-04-22T20:01:53.572 INFO:teuthology.orchestra.run.smithi111.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61575.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33599.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31323.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68679.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55479.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33599.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31323.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34461.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55479.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40562.log 2024-04-22T20:01:53.573 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34461.log.gz 2024-04-22T20:01:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61677.log 2024-04-22T20:01:53.574 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-04-22T20:01:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25221.log 2024-04-22T20:01:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-22T20:01:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25221.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25221.log.gz 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25046.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25070.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25046.log.gz 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25070.log.gz 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25118.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25094.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25118.log.gz 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-22T20:01:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25094.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25094.log.gz 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25142.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25142.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25142.log.gz 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25173.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25197.log 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25173.log: 89.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25173.log.gz 2024-04-22T20:01:53.615 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T20:01:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25197.log.gz 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34975.log 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40562.log.gz 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31312.log 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61677.log.gz 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47729.log 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34975.log.gz 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33492.log 2024-04-22T20:01:53.649 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31312.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32990.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47729.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66886.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33492.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32990.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66886.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.37595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62673.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-04-22T20:01:53.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30907.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62673.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59323.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31313.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30907.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35437.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59323.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32360.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31313.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:gzip/var/log/ceph/ceph-client.admin.35437.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58220.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35437.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35443.log 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32360.log.gz 2024-04-22T20:01:53.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59236.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58220.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68653.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35443.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62677.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59236.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68653.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:gzip/var/log/ceph/ceph-client.admin.62677.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62677.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55430.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34278.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62867.log 2024-04-22T20:01:53.652 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55430.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34278.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66704.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62867.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59612.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66704.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:gzip/var/log/ceph/ceph-client.admin.59612.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59612.log.gz 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2024-04-22T20:01:53.653 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38189.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.38189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66912.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38189.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68237.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66912.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66574.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30749.log 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68237.log.gz 2024-04-22T20:01:53.654 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31605.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66574.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66782.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30749.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31605.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68289.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68783.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66782.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68289.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.68289.log.gz /var/log/ceph/ceph-client.admin.68263.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68783.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68783.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68263.log.gz 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2024-04-22T20:01:53.655 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67564.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67162.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67155.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67564.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67162.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68939.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67155.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55067.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67389.log 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68939.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55067.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.55067.log.gz 2024-04-22T20:01:53.656 INFO:teuthology.orchestra.run.smithi111.stderr: /var/log/ceph/ceph-client.admin.68757.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67144.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67389.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31115.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68757.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65622.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67144.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32614.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31115.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34884.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65622.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32614.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34884.log.gz 2024-04-22T20:01:53.657 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68887.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62947.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68887.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58345.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62947.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36407.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58345.log.gz 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66834.log 2024-04-22T20:01:53.658 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36407.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53999.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68861.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66834.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67369.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53999.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67174.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68861.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54988.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67369.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53776.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67174.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58501.log 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54988.log.gz 2024-04-22T20:01:53.659 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68523.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53776.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68549.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58501.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68523.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68523.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68549.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33084.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33678.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32412.log 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33084.log.gz 2024-04-22T20:01:53.660 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30893.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31322.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32412.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41767.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30893.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65519.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31322.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58565.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41767.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66496.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65519.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58565.log.gz 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61837.log 2024-04-22T20:01:53.661 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66496.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34096.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60889.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61837.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34096.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.60889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60889.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62505.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32487.log 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-04-22T20:01:53.662 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68575.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62505.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58055.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32487.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53913.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68575.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67161.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58055.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53913.log: -- /var/log/ceph/ceph-client.admin.25213.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53913.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35521.log 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67161.log.gz 2024-04-22T20:01:53.663 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.25213.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25213.log.gz -5 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35521.log: /var/log/ceph/ceph-client.admin.55503.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35521.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.39382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54898.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59274.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55503.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62471.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54898.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59274.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59274.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68731.log 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62471.log.gz 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66808.log/var/log/ceph/ceph-osd.1.log: 2024-04-22T20:01:53.664 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35298.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68731.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66808.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35298.log: /var/log/ceph/ceph-client.admin.48917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35126.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35298.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68601.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35126.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31095.log 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 2024-04-22T20:01:53.665 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61538.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68601.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31095.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66361.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65703.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61538.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54766.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66361.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65703.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58225.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34815.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54766.log.gz 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64759.log 2024-04-22T20:01:53.666 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58225.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34815.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.64759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59183.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64759.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34918.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35223.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59183.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34918.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.34918.log.gz -- 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr: /var/log/ceph/ceph-client.admin.64157.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54122.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35223.log.gz 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-04-22T20:01:53.667 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.64157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64157.log.gz/var/log/ceph/ceph-client.admin.54122.log: 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67414.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54122.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67414.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31529.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31529.log.gz 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66548.log 2024-04-22T20:01:53.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30827.log: /var/log/ceph/ceph-client.admin.34190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59569.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66548.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34644.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59569.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63541.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67644.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34644.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.63541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68497.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63541.log.gz 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66966.log 2024-04-22T20:01:53.669 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.67644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67644.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68497.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68497.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67156.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66966.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62430.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65466.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67156.log: /var/log/ceph/ceph-client.admin.62430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67156.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62430.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34732.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31106.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65466.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34732.log.gz 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31315.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-04-22T20:01:53.670 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31106.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31315.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65648.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35579.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65648.log: /var/log/ceph/ceph-client.admin.35579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63540.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35579.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0%/var/log/ceph/ceph-client.admin.36204.log: -- replaced with /var/log/ceph/ceph-client.admin.65648.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59700.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61653.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.63540.log: /var/log/ceph/ceph-client.admin.59700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68913.log 2024-04-22T20:01:53.671 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59700.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63540.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61653.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68471.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56454.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68913.log: /var/log/ceph/ceph-client.admin.68471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66965.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68471.log.gz 0.0% 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68913.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56454.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66965.log: /var/log/ceph/ceph-client.admin.35066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66965.log.gz 2024-04-22T20:01:53.672 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50744.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30775.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33781.log: /var/log/ceph/ceph-client.admin.50744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54095.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50744.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30775.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53168.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54095.log: /var/log/ceph/ceph-client.admin.32386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59456.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54095.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30853.log 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53168.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59456.log.gz 2024-04-22T20:01:53.673 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61497.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30853.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68419.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30853.log.gz 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61497.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33870.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61497.log.gz 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68419.log.gz 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50146.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59665.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33870.log: /var/log/ceph/ceph-client.admin.50146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33870.log.gz 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50146.log.gz 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66678.log 2024-04-22T20:01:53.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59665.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33751.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33438.log 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66678.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68315.log 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65395.log 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33438.log: /var/log/ceph/ceph-client.admin.68315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33438.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68315.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57980.log 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62924.log 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65395.log: /var/log/ceph/ceph-client.admin.57980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65395.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57980.log.gz 2024-04-22T20:01:53.675 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67356.log 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31579.log 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62924.log: /var/log/ceph/ceph-client.admin.67356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62924.log.gz 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67356.log.gz 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48323.log 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68991.log 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31579.log: /var/log/ceph/ceph-client.admin.48323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31579.log.gz 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48323.log.gz 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34320.log 2024-04-22T20:01:53.720 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38788.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68991.log: /var/log/ceph/ceph-client.admin.34320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68991.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34320.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.38788.log: /var/log/ceph/ceph-client.admin.31295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38788.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68835.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54984.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31629.log: /var/log/ceph/ceph-client.admin.68835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68835.log.gz 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66322.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55323.log 2024-04-22T20:01:53.721 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54984.log: /var/log/ceph/ceph-client.admin.66322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54984.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66322.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32891.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36998.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55323.log: /var/log/ceph/ceph-client.admin.32891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55323.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32891.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34224.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36998.log.gz/var/log/ceph/ops-log-ceph-client.0.log: 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr: 92.0% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34224.log.gz 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66416.log 2024-04-22T20:01:53.722 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67371.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32442.log: /var/log/ceph/ceph-client.admin.66416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66416.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66954.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35906.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67371.log: /var/log/ceph/ceph-client.admin.66954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67371.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66954.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34534.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35906.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67616.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34534.log.gz 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66522.log 2024-04-22T20:01:53.723 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35265.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67616.log: /var/log/ceph/ceph-client.admin.66522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67616.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66522.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58173.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35265.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54869.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58173.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51959.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54869.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67390.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51959.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T20:01:53.724 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67390.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31099.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68965.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31114.log: /var/log/ceph/ceph-client.admin.31099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31099.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32735.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68965.log: /var/log/ceph/ceph-client.admin.32735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68965.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32735.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30904.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33978.log: /var/log/ceph/ceph-client.admin.34390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65581.log 2024-04-22T20:01:53.725 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30905.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30904.log: /var/log/ceph/ceph-client.admin.65581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30904.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65581.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66600.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61728.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30905.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66600.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58310.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61728.log: /var/log/ceph/ceph-client.admin.58310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61728.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58310.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58505.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47132.log 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-04-22T20:01:53.726 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58505.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32675.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47132.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66730.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35348.log: /var/log/ceph/ceph-client.admin.32675.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32675.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45942.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66730.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.39972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34575.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45942.log.gz 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31309.log 2024-04-22T20:01:53.727 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34575.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31309.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31314.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31309.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62768.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66963.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31314.log: /var/log/ceph/ceph-client.admin.62768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31314.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62768.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25023.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66963.log: /var/log/ceph/ceph-client.admin.35724.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66963.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65390.log 2024-04-22T20:01:53.728 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66652.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.25023.log: /var/log/ceph/ceph-client.admin.65390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25023.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65390.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67590.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66652.log: /var/log/ceph/ceph-client.admin.35693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66652.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33179.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67590.log: /var/log/ceph/ceph-client.admin.55262.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz -- replaced with /var/log/ceph/ceph-client.admin.67590.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56687.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58137.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33179.log.gz 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56687.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-04-22T20:01:53.729 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58137.log.gz 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31107.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33937.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31107.log.gz 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49441.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30801.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49441.log.gzgzip 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30724.log 2024-04-22T20:01:53.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30801.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35823.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66964.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30724.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35823.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62809.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66964.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32486.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62809.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32486.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32486.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66961.log 2024-04-22T20:01:53.731 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66961.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68627.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66961.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67170.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57314.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68627.log: /var/log/ceph/ceph-client.admin.67170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68627.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67170.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67360.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42351.log 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57314.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67360.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.67360.log.gz 2024-04-22T20:01:53.732 INFO:teuthology.orchestra.run.smithi111.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59380.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42351.log.gz 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36157.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68367.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59380.log.gz 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.36157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36157.log.gz 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34617.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68367.log.gz 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52553.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34617.log.gz 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52553.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52553.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.60294.log 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.733 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69017.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.35517.log: /var/log/ceph/ceph-client.admin.60294.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60294.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69067.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32483.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.69017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69017.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.69067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69067.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66468.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32483.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45352.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55167.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66468.log.gz 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45352.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53830.log 2024-04-22T20:01:53.734 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55167.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68341.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53830.log: /var/log/ceph/ceph-client.admin.35854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53830.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34035.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68341.log: /var/log/ceph/ceph-client.admin.34035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68341.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34035.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30906.log 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.735 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25280.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54068.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30906.log: /var/log/ceph/ceph-client.admin.25280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30906.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25280.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66955.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54068.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66955.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62611.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67372.log 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62611.log: 0.0%/var/log/ceph/ceph-client.admin.35010.log: -- replaced with /var/log/ceph/ceph-client.admin.62611.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-04-22T20:01:53.736 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58021.log 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31102.log 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67372.log: /var/log/ceph/ceph-client.admin.58021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67372.log.gz 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58021.log.gz 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66756.log 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68809.log 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.31102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31102.log.gz 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66756.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66756.log.gz 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61777.log 2024-04-22T20:01:53.737 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68809.log.gz 2024-04-22T20:01:53.738 INFO:teuthology.orchestra.run.smithi138.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-22T20:01:53.739 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66626.log 2024-04-22T20:01:53.739 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30900.log 2024-04-22T20:01:53.739 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0%/var/log/ceph/ceph-client.admin.66626.log: -- replaced with /var/log/ceph/ceph-client.admin.61777.log.gz 2024-04-22T20:01:53.739 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66626.log.gz 2024-04-22T20:01:53.739 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59536.log 2024-04-22T20:01:53.740 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.30900.log: /var/log/ceph/ceph-client.admin.59536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30900.log.gz 2024-04-22T20:01:53.740 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59536.log.gz 2024-04-22T20:01:53.825 INFO:teuthology.orchestra.run.smithi138.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-22T20:01:53.894 INFO:teuthology.orchestra.run.smithi111.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-22T20:01:54.007 INFO:teuthology.orchestra.run.smithi111.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-22T20:01:54.391 INFO:teuthology.orchestra.run.smithi111.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-22T20:01:54.468 INFO:teuthology.orchestra.run.smithi138.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-22T20:01:54.591 INFO:teuthology.orchestra.run.smithi111.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-22T20:01:54.603 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-22T20:01:54.605 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-22T20:01:54.650 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-22T20:01:54.670 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-22T20:01:54.672 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-22T20:01:54.672 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m1.095s 2024-04-22T20:01:54.673 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m4.098s 2024-04-22T20:01:54.673 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.212s 2024-04-22T20:01:54.926 INFO:teuthology.orchestra.run.smithi111.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-22T20:01:54.928 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-22T20:01:54.928 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m1.391s 2024-04-22T20:01:54.928 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m4.928s 2024-04-22T20:01:54.928 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.309s 2024-04-22T20:01:54.928 INFO:tasks.ceph:Archiving logs... 2024-04-22T20:01:54.928 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi111/log 2024-04-22T20:01:54.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T20:01:55.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-22T20:01:55.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-22T20:01:55.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-22T20:01:55.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-22T20:01:55.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-22T20:01:55.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-22T20:01:55.816 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi138/log 2024-04-22T20:01:55.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T20:01:56.359 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-22T20:01:56.370 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-22T20:01:56.370 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T20:01:56.372 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T20:01:56.438 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-22T20:01:56.447 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-22T20:01:56.447 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T20:01:56.449 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout:+hv01.front.sepi 44.4.53.2 2 u 14 64 377 0.076 -3.493 0.745 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 64 377 0.050 -0.796 0.788 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout:*hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.069 -1.424 0.725 2024-04-22T20:01:56.461 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-22T20:01:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T20:01:56.462 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-22T20:01:56.462 INFO:teuthology.orchestra.run.smithi138.stdout:+hv01.front.sepi 44.4.53.2 2 u 12 64 377 0.103 -4.463 1.357 2024-04-22T20:01:56.463 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.104 -0.482 0.962 2024-04-22T20:01:56.463 INFO:teuthology.orchestra.run.smithi138.stdout:*hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.102 -2.410 1.333 2024-04-22T20:01:56.463 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-22T20:01:56.464 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-22T20:01:56.473 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-22T20:01:56.473 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-22T20:01:56.482 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-22T20:01:56.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-22T20:01:56.501 INFO:teuthology.task.internal:Duration was 1122.679515 seconds 2024-04-22T20:01:56.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-22T20:01:56.511 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-22T20:01:56.511 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T20:01:56.514 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T20:01:56.550 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-22T20:01:56.550 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-04-22T20:01:56.550 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T20:01:56.602 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-04-22T20:01:56.603 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T20:01:56.613 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-22T20:01:56.613 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T20:01:56.647 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T20:01:56.682 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-22T20:01:56.682 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T20:01:56.718 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T20:01:56.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-22T20:01:56.803 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-22T20:01:56.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T20:01:56.814 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T20:01:56.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-22T20:01:56.835 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T20:01:56.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T20:01:56.866 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-04-22T20:01:56.877 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-04-22T20:01:56.986 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T20:01:56.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T20:01:56.991 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T20:01:57.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T20:01:57.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-22T20:01:57.042 INFO:teuthology.task.internal:Transferring archived files... 2024-04-22T20:01:57.043 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi111 2024-04-22T20:01:57.043 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T20:01:57.066 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-22_19:31:26-rgw-wip-65551-distro-default-smithi/7668489/remote/smithi138 2024-04-22T20:01:57.066 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T20:01:57.095 INFO:teuthology.task.internal:Removing archive directory... 2024-04-22T20:01:57.095 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T20:01:57.106 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T20:01:57.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-22T20:01:57.151 INFO:teuthology.task.internal:Not uploading archives. 2024-04-22T20:01:57.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-22T20:01:57.160 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-22T20:01:57.160 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T20:01:57.163 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T20:01:57.166 INFO:teuthology.orchestra.run.smithi111.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 20:01 /home/ubuntu/cephtest 2024-04-22T20:01:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 20:01 /home/ubuntu/cephtest 2024-04-22T20:01:57.189 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-22T20:01:57.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-22T20:01:57.221 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 1122.679515361786 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-04-22T20:01:57.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T20:01:57.323 INFO:teuthology.run:pass